FluidInference / jev-9b-coreml

JEV-9B with vision (Core ML)

AutoTrust's JEV-9B System 1, with vision, converted to Core ML for Apple silicon. It makes typed decisions over text and images: yes/no ( noul ), a 0–5 score , or a choice among 2–256 options. Each decision returns a calibrated probability for every option from a single forward pass ; nothing is generated.

JEV-9B with vision is the stock Qwen3.5-9B , including its unchanged vision tower, plus JEV-9B's System 1 LoRA and decision head ( vl/adapter_vllm ). In this repository:

• The LoRA is merged into the decoder weights.
• The decision head is reduced to the adapted lm_head rows it reads.
• The prompt is exactly JEV's serve_decide.py System 1 template.

Runtime: JevManager in FluidUse (Swift, macOS 15+), with a SwiftUI demo where the model plays Super Mario Bros. 1-1 ( JevMarioDemo ).

Files

Decision:

1. Run the vision tower once per image.
2. Splice its tokens into the prompt at the <|image_pad|> positions.
3. Chain the 8 decoder parts. Their I/O is hidden [1, L, 4096] and cos / sin [L, 64] , all fp16, with interleaved M-RoPE tables built on the host.
4. Take the last prompt row times the head rows, add the bias, divide by the temperature, and softmax over the question's options.

Quality

The fp32 reference is Hugging Face's Qwen3_5VisionModel , plus the same decoder in fp32 with the LoRA merged (streamed 4 layers at a time), plus the head rows. It was run on 12 Super Mario Bros. frames with a choice, a yes/no and a score question on each:

Speed (M5 Pro, 24 GB, GPU; Swift JevManager )

The decoder needs ~7 GB of memory to itself. The Qwen3.5 decoder (Gated DeltaNet layers) does not run on the Neural Engine, so this is a GPU model.

Usage (Swift)

import FluidUse

let jev = try await JevManager.load(from: bundleDirectory, bucket: 256)
let result = try await jev.decide(
    state: [.text("Close-up of the area just ahead of Mario in a Super Mario Bros. level:"), .image(view)],
    questions: [JevQuestion(.noul, "Is there an enemy (a brown Goomba or a Koopa) in this picture?")])
print(result.decisions[0].yes ?? 0, result.totalMilliseconds)

License and credits

Apache-2.0, the same as autotrust/JEV-9B and Qwen/Qwen3.5-9B ( LICENSE is Qwen's). All weights belong to AutoTrust and Qwen; this repository only changes their format and precision. Conversion by Fluid Inference .