An
OptiQ
mixed-precision MLX quant of
KAT-Coder-V2.5-Dev
, a
qwen3_5_moe
coding model (256-routed-expert sparse
MoE with hybrid linear + full attention).
Mixed 4/8-bit
static
build
— per-layer bit-widths assigned to a 4.5
target bits-per-weight: 400 projections at 4-bit, 111 at 8-bit.
~4.51 bits per weight
, 20 GB on disk.
Requirements
pip install -U optiq
qwen3_5_moe
loads under stock
mlx-lm
too, but
optiq serve
adds mixed-
precision loading, KV-cache quantization, and the OptiQ Lab.
Then use the OpenAI-compatible endpoint at
http://localhost:8000/v1
, the
OptiQ Lab
, or point
optiq code
at it. This
is a reasoning coder — it thinks before it answers.
Runs of mlx-community KAT-Coder-V2.5-Dev-OptiQ-4bit on huggingface.co
7.9K
Total runs
0
24-hour runs
110
3-day runs
583
7-day runs
6.2K
30-day runs
More Information About KAT-Coder-V2.5-Dev-OptiQ-4bit huggingface.co Model
More KAT-Coder-V2.5-Dev-OptiQ-4bit license Visit here:
KAT-Coder-V2.5-Dev-OptiQ-4bit huggingface.co is an AI model on huggingface.co that provides KAT-Coder-V2.5-Dev-OptiQ-4bit's model effect (), which can be used instantly with this mlx-community KAT-Coder-V2.5-Dev-OptiQ-4bit model. huggingface.co supports a free trial of the KAT-Coder-V2.5-Dev-OptiQ-4bit model, and also provides paid use of the KAT-Coder-V2.5-Dev-OptiQ-4bit. Support call KAT-Coder-V2.5-Dev-OptiQ-4bit model through api, including Node.js, Python, http.
KAT-Coder-V2.5-Dev-OptiQ-4bit huggingface.co is an online trial and call api platform, which integrates KAT-Coder-V2.5-Dev-OptiQ-4bit's modeling effects, including api services, and provides a free online trial of KAT-Coder-V2.5-Dev-OptiQ-4bit, you can try KAT-Coder-V2.5-Dev-OptiQ-4bit online for free by clicking the link below.
mlx-community KAT-Coder-V2.5-Dev-OptiQ-4bit online free url in huggingface.co:
KAT-Coder-V2.5-Dev-OptiQ-4bit is an open source model from GitHub that offers a free installation service, and any user can find KAT-Coder-V2.5-Dev-OptiQ-4bit on GitHub to install. At the same time, huggingface.co provides the effect of KAT-Coder-V2.5-Dev-OptiQ-4bit install, users can directly use KAT-Coder-V2.5-Dev-OptiQ-4bit installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
KAT-Coder-V2.5-Dev-OptiQ-4bit install url in huggingface.co: