Qwable-5-27B-Coder-NVFP4
is the compact NVIDIA ModelOpt release of Qwable: a Qwen3.6-based coder-agent tune trained first on
Claude Fable 5 traces
, then continued on
Kimi 2.7 Coder traces
.
This is the serving-oriented checkpoint: NVFP4 safetensors for runtimes that understand ModelOpt quantization. Use the GGUF repo for llama.cpp and Ollama.
The NVFP4 checkpoint is a quantized release of the same coder-agent model. The target workload remains repository navigation, patch planning, terminal-output analysis, verifier recovery, tool-shaped answers, and long-context coding prompts.
Early maintainer runs show the source Qwable checkpoint outperforming the base model on a private coder benchmark. Public benchmark details are pending, so treat that as early maintainer signal rather than a reproducible leaderboard claim.
Quantization details
From
hf_quant_config.json
:
Field
Value
Producer
modelopt
Producer version
0.44.0
Quant algorithm
NVFP4
Group size
16
KV cache quantization
Not set in this checkpoint
Higher-precision exclusions
lm_head
, SSM
conv1d
modules, and
model.visual*
The config records 4-bit floating-point weights and input activations for
Linear
targets. The excluded modules are intentional: they preserve sensitive output, SSM convolution, and vision-tower components outside the main NVFP4 target set.
Quickstart
Install a runtime with support for ModelOpt NVFP4 checkpoints. Exact package versions change quickly; prefer the current vLLM or TensorRT-LLM documentation for your CUDA stack.
Qwable-5-27B-Coder-NVFP4 huggingface.co is an AI model on huggingface.co that provides Qwable-5-27B-Coder-NVFP4's model effect (), which can be used instantly with this DJLougen Qwable-5-27B-Coder-NVFP4 model. huggingface.co supports a free trial of the Qwable-5-27B-Coder-NVFP4 model, and also provides paid use of the Qwable-5-27B-Coder-NVFP4. Support call Qwable-5-27B-Coder-NVFP4 model through api, including Node.js, Python, http.
Qwable-5-27B-Coder-NVFP4 huggingface.co is an online trial and call api platform, which integrates Qwable-5-27B-Coder-NVFP4's modeling effects, including api services, and provides a free online trial of Qwable-5-27B-Coder-NVFP4, you can try Qwable-5-27B-Coder-NVFP4 online for free by clicking the link below.
DJLougen Qwable-5-27B-Coder-NVFP4 online free url in huggingface.co:
Qwable-5-27B-Coder-NVFP4 is an open source model from GitHub that offers a free installation service, and any user can find Qwable-5-27B-Coder-NVFP4 on GitHub to install. At the same time, huggingface.co provides the effect of Qwable-5-27B-Coder-NVFP4 install, users can directly use Qwable-5-27B-Coder-NVFP4 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
Qwable-5-27B-Coder-NVFP4 install url in huggingface.co: