This is a quantized version of
Qwen/Qwen3.5-27B
. This model accepts text and images as inputs and generates text as outputs. The weights and activations were quantized to FP4 using
llm-compressor
with 512 calibration samples from
neuralmagic/calibration
, reducing the model size from 51.8 GB to 18.4 GB (~2.8x reduction) while maintaining 99.1% average accuracy recovery.
Inference
As of 2/27/2026, this model is supported in vLLM nightly. To serve the model:
Qwen3.5-27B-NVFP4 huggingface.co is an AI model on huggingface.co that provides Qwen3.5-27B-NVFP4's model effect (), which can be used instantly with this apolo13x Qwen3.5-27B-NVFP4 model. huggingface.co supports a free trial of the Qwen3.5-27B-NVFP4 model, and also provides paid use of the Qwen3.5-27B-NVFP4. Support call Qwen3.5-27B-NVFP4 model through api, including Node.js, Python, http.
Qwen3.5-27B-NVFP4 huggingface.co is an online trial and call api platform, which integrates Qwen3.5-27B-NVFP4's modeling effects, including api services, and provides a free online trial of Qwen3.5-27B-NVFP4, you can try Qwen3.5-27B-NVFP4 online for free by clicking the link below.
apolo13x Qwen3.5-27B-NVFP4 online free url in huggingface.co:
Qwen3.5-27B-NVFP4 is an open source model from GitHub that offers a free installation service, and any user can find Qwen3.5-27B-NVFP4 on GitHub to install. At the same time, huggingface.co provides the effect of Qwen3.5-27B-NVFP4 install, users can directly use Qwen3.5-27B-NVFP4 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.