Sponsored by Vmake Labs Video Enhancer
Toolify Toolify logo
AI Models
Qwen3.5-27B-quantized.w4a16

apolo13x / Qwen3.5-27B-quantized.w4a16

Run on huggingface.co
huggingface.co
Total runs: 1.3K
24-hour runs: -30
7-day runs: -285
30-day runs: -457
Model's Last Updated: February 27 2026
image-text-to-text

Introduction of Qwen3.5-27B-quantized.w4a16

Model Details of Qwen3.5-27B-quantized.w4a16

Qwen3.5-27B-quantized.w4a16

This is a quantized version of Qwen/Qwen3.5-27B . This model accepts text and images as inputs and generates text as outputs. The weights were quantized to INT4 using GPTQ via llm-compressor with 512 calibration samples from HuggingFaceH4/ultrachat_200k , reducing the model size from 51.8 GB to 17.3 GB (~3.0x reduction) while maintaining 100.3% average accuracy recovery.

Inference

As of 2/27/2026, this model is supported in vLLM nightly. To serve the model: 

vllm serve Kbenkhaled/Qwen3.5-27B-quantized.w4a16 \
    --reasoning-parser qwen3 \
    --enable-prefix-caching
Evaluation

Evaluated with lm-evaluation-harness , 0-shot, thinking mode ON.

Benchmark Qwen3.5-27B Qwen3.5-27B-quantized.w4a16 (this model) Recovery
GPQA Diamond 80.30% 80.81% 100.6%
IFEval 95.08% 95.20% 100.1%
MMLU-Redux 93.90% 94.13% 100.2%
Average 89.76% 90.05% 100.3%

Runs of apolo13x Qwen3.5-27B-quantized.w4a16 on huggingface.co

1.3K
Total runs
-30
24-hour runs
-109
3-day runs
-285
7-day runs
-457
30-day runs

More Information About Qwen3.5-27B-quantized.w4a16 huggingface.co Model

More Qwen3.5-27B-quantized.w4a16 license Visit here:

https://choosealicense.com/licenses/apache-2.0

Qwen3.5-27B-quantized.w4a16 huggingface.co

Qwen3.5-27B-quantized.w4a16 huggingface.co is an AI model on huggingface.co that provides Qwen3.5-27B-quantized.w4a16's model effect (), which can be used instantly with this apolo13x Qwen3.5-27B-quantized.w4a16 model. huggingface.co supports a free trial of the Qwen3.5-27B-quantized.w4a16 model, and also provides paid use of the Qwen3.5-27B-quantized.w4a16. Support call Qwen3.5-27B-quantized.w4a16 model through api, including Node.js, Python, http.

Qwen3.5-27B-quantized.w4a16 huggingface.co Url

https://huggingface.co/apolo13x/Qwen3.5-27B-quantized.w4a16

apolo13x Qwen3.5-27B-quantized.w4a16 online free

Qwen3.5-27B-quantized.w4a16 huggingface.co is an online trial and call api platform, which integrates Qwen3.5-27B-quantized.w4a16's modeling effects, including api services, and provides a free online trial of Qwen3.5-27B-quantized.w4a16, you can try Qwen3.5-27B-quantized.w4a16 online for free by clicking the link below.

apolo13x Qwen3.5-27B-quantized.w4a16 online free url in huggingface.co:

https://huggingface.co/apolo13x/Qwen3.5-27B-quantized.w4a16

Qwen3.5-27B-quantized.w4a16 install

Qwen3.5-27B-quantized.w4a16 is an open source model from GitHub that offers a free installation service, and any user can find Qwen3.5-27B-quantized.w4a16 on GitHub to install. At the same time, huggingface.co provides the effect of Qwen3.5-27B-quantized.w4a16 install, users can directly use Qwen3.5-27B-quantized.w4a16 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Qwen3.5-27B-quantized.w4a16 install url in huggingface.co:

https://huggingface.co/apolo13x/Qwen3.5-27B-quantized.w4a16

Url of Qwen3.5-27B-quantized.w4a16

Qwen3.5-27B-quantized.w4a16 huggingface.co Url

Provider of Qwen3.5-27B-quantized.w4a16 huggingface.co

apolo13x
ORGANIZATIONS
huggingface.co

Other API from apolo13x