mlx-community / Qwen3.5-9B-MLX-4bit

huggingface.co
Total runs: 26.2K
24-hour runs: 245
7-day runs: -291
30-day runs: 2.4K
Model's Last Updated: March 24 2026
image-text-to-text

Introduction of Qwen3.5-9B-MLX-4bit

Model Details of Qwen3.5-9B-MLX-4bit

Qwen3.5-9B-MLX-4bit

This is a quantized MLX version of Qwen/Qwen3.5-9B for Apple Silicon.

Model Details
  • Original Model: Qwen/Qwen3.5-9B
  • Quantization: 4-bit (~5.059 bits per weight)
  • Group Size: 64
  • Format: MLX SafeTensors
  • Framework: mlx-vlm
Conversion Details

This model was converted using mlx-vlm with 4-bit quantization.

Conversion command:

python3 -m mlx_vlm convert \
  --hf-path "Qwen/Qwen3.5-9B" \
  --mlx-path "./mlx_models/Qwen3.5-9B-MLX-4bit" \
  -q --q-bits 4 --q-group-size 64
Important Note

A better, more optimized conversion may be available from @Prince ( @Blaizzy ) in the MLX VLM community. Check the mlx-community organization for updated versions as official Qwen3.5 support is merged into the main mlx-vlm branch.

Usage
from mlx_vlm import load, generate

model, processor = load("mlx-community/Qwen3.5-9B-MLX-4bit")

output = generate(
    model,
    processor,
    prompt="Describe this image in detail",
    image="path/to/image.jpg",
    max_tokens=200
)
print(output)

Or from the command line:

mlx_vlm generate \
  --model mlx-community/Qwen3.5-9B-MLX-4bit \
  --prompt "Describe this image" \
  --image path/to/image.jpg \
  --max-tokens 200
Performance
  • Disk Size: ~5.6 GB
  • Runs efficiently on Apple Silicon Macs (M1/M2/M3/M4)
  • Lower memory footprint compared to 8-bit quantization
License

This model inherits the Apache 2.0 license from the original Qwen3.5-9B model.

Runs of mlx-community Qwen3.5-9B-MLX-4bit on huggingface.co

26.2K
Total runs
245
24-hour runs
-46
3-day runs
-291
7-day runs
2.4K
30-day runs

More Information About Qwen3.5-9B-MLX-4bit huggingface.co Model

More Qwen3.5-9B-MLX-4bit license Visit here:

https://choosealicense.com/licenses/apache-2.0

Qwen3.5-9B-MLX-4bit huggingface.co

Qwen3.5-9B-MLX-4bit huggingface.co is an AI model on huggingface.co that provides Qwen3.5-9B-MLX-4bit's model effect (), which can be used instantly with this mlx-community Qwen3.5-9B-MLX-4bit model. huggingface.co supports a free trial of the Qwen3.5-9B-MLX-4bit model, and also provides paid use of the Qwen3.5-9B-MLX-4bit. Support call Qwen3.5-9B-MLX-4bit model through api, including Node.js, Python, http.

mlx-community Qwen3.5-9B-MLX-4bit online free

Qwen3.5-9B-MLX-4bit huggingface.co is an online trial and call api platform, which integrates Qwen3.5-9B-MLX-4bit's modeling effects, including api services, and provides a free online trial of Qwen3.5-9B-MLX-4bit, you can try Qwen3.5-9B-MLX-4bit online for free by clicking the link below.

mlx-community Qwen3.5-9B-MLX-4bit online free url in huggingface.co:

https://huggingface.co/mlx-community/Qwen3.5-9B-MLX-4bit

Qwen3.5-9B-MLX-4bit install

Qwen3.5-9B-MLX-4bit is an open source model from GitHub that offers a free installation service, and any user can find Qwen3.5-9B-MLX-4bit on GitHub to install. At the same time, huggingface.co provides the effect of Qwen3.5-9B-MLX-4bit install, users can directly use Qwen3.5-9B-MLX-4bit installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Qwen3.5-9B-MLX-4bit install url in huggingface.co:

https://huggingface.co/mlx-community/Qwen3.5-9B-MLX-4bit

Url of Qwen3.5-9B-MLX-4bit

Qwen3.5-9B-MLX-4bit huggingface.co Url

Provider of Qwen3.5-9B-MLX-4bit huggingface.co

mlx-community
ORGANIZATIONS

Other API from mlx-community