mlx-community / KAT-Coder-V2.5-Dev-OptiQ-4bit

huggingface.co
Total runs: 7.9K
24-hour runs: 0
7-day runs: 583
30-day runs: 6.2K
Model's Last Updated: September 15 2026
text-generation

Introduction of KAT-Coder-V2.5-Dev-OptiQ-4bit

Model Details of KAT-Coder-V2.5-Dev-OptiQ-4bit

KAT-Coder-V2.5-Dev-OptiQ-4bit

Built with mlx-optiq , the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon (no PyTorch, no cloud). Try the Lab · All OptiQ quants · Docs

An OptiQ mixed-precision MLX quant of KAT-Coder-V2.5-Dev , a qwen3_5_moe coding model (256-routed-expert sparse MoE with hybrid linear + full attention).

  • Mixed 4/8-bit static build — per-layer bit-widths assigned to a 4.5 target bits-per-weight: 400 projections at 4-bit, 111 at 8-bit.
  • ~4.51 bits per weight , 20 GB on disk.
Requirements
pip install -U optiq

qwen3_5_moe loads under stock mlx-lm too, but optiq serve adds mixed- precision loading, KV-cache quantization, and the OptiQ Lab.

Running it
optiq serve --model mlx-community/KAT-Coder-V2.5-Dev-OptiQ-4bit

Then use the OpenAI-compatible endpoint at http://localhost:8000/v1 , the OptiQ Lab , or point optiq code at it. This is a reasoning coder — it thinks before it answers.

Runs of mlx-community KAT-Coder-V2.5-Dev-OptiQ-4bit on huggingface.co

7.9K
Total runs
0
24-hour runs
110
3-day runs
583
7-day runs
6.2K
30-day runs

More Information About KAT-Coder-V2.5-Dev-OptiQ-4bit huggingface.co Model

More KAT-Coder-V2.5-Dev-OptiQ-4bit license Visit here:

https://choosealicense.com/licenses/apache-2.0

KAT-Coder-V2.5-Dev-OptiQ-4bit huggingface.co

KAT-Coder-V2.5-Dev-OptiQ-4bit huggingface.co is an AI model on huggingface.co that provides KAT-Coder-V2.5-Dev-OptiQ-4bit's model effect (), which can be used instantly with this mlx-community KAT-Coder-V2.5-Dev-OptiQ-4bit model. huggingface.co supports a free trial of the KAT-Coder-V2.5-Dev-OptiQ-4bit model, and also provides paid use of the KAT-Coder-V2.5-Dev-OptiQ-4bit. Support call KAT-Coder-V2.5-Dev-OptiQ-4bit model through api, including Node.js, Python, http.

KAT-Coder-V2.5-Dev-OptiQ-4bit huggingface.co Url

https://huggingface.co/mlx-community/KAT-Coder-V2.5-Dev-OptiQ-4bit

mlx-community KAT-Coder-V2.5-Dev-OptiQ-4bit online free

KAT-Coder-V2.5-Dev-OptiQ-4bit huggingface.co is an online trial and call api platform, which integrates KAT-Coder-V2.5-Dev-OptiQ-4bit's modeling effects, including api services, and provides a free online trial of KAT-Coder-V2.5-Dev-OptiQ-4bit, you can try KAT-Coder-V2.5-Dev-OptiQ-4bit online for free by clicking the link below.

mlx-community KAT-Coder-V2.5-Dev-OptiQ-4bit online free url in huggingface.co:

https://huggingface.co/mlx-community/KAT-Coder-V2.5-Dev-OptiQ-4bit

KAT-Coder-V2.5-Dev-OptiQ-4bit install

KAT-Coder-V2.5-Dev-OptiQ-4bit is an open source model from GitHub that offers a free installation service, and any user can find KAT-Coder-V2.5-Dev-OptiQ-4bit on GitHub to install. At the same time, huggingface.co provides the effect of KAT-Coder-V2.5-Dev-OptiQ-4bit install, users can directly use KAT-Coder-V2.5-Dev-OptiQ-4bit installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

KAT-Coder-V2.5-Dev-OptiQ-4bit install url in huggingface.co:

https://huggingface.co/mlx-community/KAT-Coder-V2.5-Dev-OptiQ-4bit

Url of KAT-Coder-V2.5-Dev-OptiQ-4bit

KAT-Coder-V2.5-Dev-OptiQ-4bit huggingface.co Url

Provider of KAT-Coder-V2.5-Dev-OptiQ-4bit huggingface.co

mlx-community
ORGANIZATIONS

Other API from mlx-community