DuoNeural / Qwen3-4B-GGUF

huggingface.co
Total runs: 719
24-hour runs: 17
7-day runs: -72
30-day runs: 341
Model's Last Updated: May 03 2026
text-generation

Introduction of Qwen3-4B-GGUF

Model Details of Qwen3-4B-GGUF

Qwen3-4B — GGUF Quants

Quantized GGUF versions of Qwen/Qwen3-4B — Alibaba's Qwen3 base model at the 4B parameter scale. Qwen3 represents a significant generational leap over Qwen2.5, with improved reasoning, coding, and instruction following packed into an efficient sub-5B footprint.

Available Files
File Quant Size Use Case
Qwen3-4B-Q8_0.gguf Q8_0 ~4.5GB Maximum quality
Qwen3-4B-Q6_K.gguf Q6_K ~3.5GB Near-lossless
Qwen3-4B-Q5_K_M.gguf Q5_K_M ~3.1GB High quality
Qwen3-4B-Q4_K_M.gguf Q4_K_M ~2.6GB Recommended default
Qwen3-4B-Q3_K_M.gguf Q3_K_M ~2.1GB Low VRAM
Qwen3-4B-IQ4_XS.gguf IQ4_XS ~2.4GB Imatrix 4-bit
Qwen3-4B-IQ3_XXS.gguf IQ3_XXS ~1.8GB Imatrix 3-bit
Qwen3-4B-IQ2_M.gguf IQ2_M ~1.6GB Imatrix 2-bit
Qwen3-4B-IQ1_S.gguf IQ1_S ~1.2GB Extreme compression
Qwen3-4B-fp16.gguf FP16 ~8.0GB Full precision
imatrix.dat — — Importance matrix
Usage
# llama.cpp
./llama-cli -m Qwen3-4B-Q4_K_M.gguf \
  --ctx-size 8192 -n 512 \
  -p "<|im_start|>system\nYou are a helpful assistant.<|im_end|>\n<|im_start|>user\nHello!<|im_end|>\n<|im_start|>assistant\n"

# Ollama
ollama run hf.co/DuoNeural/Qwen3-4B-GGUF:Q4_K_M
About Qwen3-4B
  • Parameters : 4B
  • Architecture : Qwen3 decoder-only transformer
  • License : Apache 2.0
  • Strengths : Reasoning, coding, instruction following, multilingual
  • Ideal for : Hardware with 4-6GB VRAM, edge deployment, CPU inference

At Q4_K_M (~2.6GB) this fits on virtually any modern GPU or even CPU-only systems.


Quantized by DuoNeural using llama.cpp on RTX 5090.


DuoNeural

DuoNeural is an open AI research lab — human + AI in collaboration.

DuoNeural Research Publications

Open access, CC BY 4.0. Authored by Archon, Jesse Caldwell, Aura — DuoNeural.

Runs of DuoNeural Qwen3-4B-GGUF on huggingface.co

719
Total runs
17
24-hour runs
25
3-day runs
-72
7-day runs
341
30-day runs

More Information About Qwen3-4B-GGUF huggingface.co Model

More Qwen3-4B-GGUF license Visit here:

https://choosealicense.com/licenses/apache-2.0

Qwen3-4B-GGUF huggingface.co

Qwen3-4B-GGUF huggingface.co is an AI model on huggingface.co that provides Qwen3-4B-GGUF's model effect (), which can be used instantly with this DuoNeural Qwen3-4B-GGUF model. huggingface.co supports a free trial of the Qwen3-4B-GGUF model, and also provides paid use of the Qwen3-4B-GGUF. Support call Qwen3-4B-GGUF model through api, including Node.js, Python, http.

Qwen3-4B-GGUF huggingface.co Url

https://huggingface.co/DuoNeural/Qwen3-4B-GGUF

DuoNeural Qwen3-4B-GGUF online free

Qwen3-4B-GGUF huggingface.co is an online trial and call api platform, which integrates Qwen3-4B-GGUF's modeling effects, including api services, and provides a free online trial of Qwen3-4B-GGUF, you can try Qwen3-4B-GGUF online for free by clicking the link below.

DuoNeural Qwen3-4B-GGUF online free url in huggingface.co:

https://huggingface.co/DuoNeural/Qwen3-4B-GGUF

Qwen3-4B-GGUF install

Qwen3-4B-GGUF is an open source model from GitHub that offers a free installation service, and any user can find Qwen3-4B-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of Qwen3-4B-GGUF install, users can directly use Qwen3-4B-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Qwen3-4B-GGUF install url in huggingface.co:

https://huggingface.co/DuoNeural/Qwen3-4B-GGUF

Url of Qwen3-4B-GGUF

Qwen3-4B-GGUF huggingface.co Url

Provider of Qwen3-4B-GGUF huggingface.co

DuoNeural
ORGANIZATIONS

Other API from DuoNeural