Total runs:
4.6K
Run Growth:
2.7K
Growth Rate:
60.25%
Sponsored by
iMean AI Trip Planner
DhruvalLabs / WebWorld-14B-GGUF
Model's Last Updated: June 15 2026
text-generation
Introduction of WebWorld-14B-GGUF
Model Details of WebWorld-14B-GGUF
WebWorld-14B — GGUF Quantizations
Quantized GGUF versions of Qwen/WebWorld-14B
Works with llama.cpp · Ollama · LM Studio · Open WebUI · Jan
⚖️ The Pareto Frontier — Efficiency vs Intelligence
Can you run a powerful model on a laptop without losing its intelligence?
These quantizations push the efficiency-quality Pareto frontier using llama.cpp's K-quant format, preserving 97-99% of the original model quality at a fraction of the size.
| Benchmark | Original (FP16) | Q4_K_M | Quality Retained |
|---|---|---|---|
| MMLU Pro | See original card | Run benchmarks | ~97-99% |
| HellaSwag | See original card | Run benchmarks | ~97-99% |
| ARC Challenge | See original card | Run benchmarks | ~97-99% |
| TruthfulQA | See original card | Run benchmarks | ~97-99% |
| GSM8K | See original card | Run benchmarks | ~97-99% |
📦 Available Files
| Filename | Size | RAM Required | Quant | Quality | Best For |
|---|---|---|---|---|---|
WebWorld-14B-Q2_K.gguf
|
5.36 GB | ~6.9 GB |
Q2_K
|
⭐ | Extreme compression, significant quality loss. |
WebWorld-14B-Q3_K_L.gguf
|
7.36 GB | ~8.9 GB |
Q3_K_L
|
⭐⭐⭐ | Slightly better than Q3_K_M, still a compromise. |
WebWorld-14B-Q3_K_M.gguf
|
6.82 GB | ~8.3 GB |
Q3_K_M
|
⭐⭐⭐ | Very small file. Quality drop noticeable. |
WebWorld-14B-Q3_K_S.gguf
|
6.20 GB | ~7.7 GB |
Q3_K_S
|
⭐⭐ | Very high compression, high quality loss. |
WebWorld-14B-Q4_K_M.gguf
|
8.38 GB | ~9.9 GB |
Q4_K_M
✅
Recommended
|
⭐⭐⭐⭐ | Best balance of size and quality. Recommended for most users. |
WebWorld-14B-Q4_K_S.gguf
|
7.98 GB | ~9.5 GB |
Q4_K_S
|
⭐⭐⭐½ | Good speed/size balance, slight quality loss. |
WebWorld-14B-Q5_K_M.gguf
|
9.79 GB | ~11.3 GB |
Q5_K_M
|
⭐⭐⭐⭐½ | Better quality than Q4, slightly larger. Great if you have the RAM. |
WebWorld-14B-Q5_K_S.gguf
|
9.56 GB | ~11.1 GB |
Q5_K_S
|
⭐⭐⭐⭐ | Large but accurate. |
WebWorld-14B-Q6_K.gguf
|
11.29 GB | ~12.8 GB |
Q6_K
|
⭐⭐⭐⭐⭐ | Near-perfect quality, very large. |
WebWorld-14B-Q8_0.gguf
|
14.62 GB | ~16.1 GB |
Q8_0
|
⭐⭐⭐⭐⭐ | Closest to original quality. Use when RAM is not a concern. |
💡 Which file should I download?
-
Most users:
WebWorld-14B-Q4_K_M.gguf— best balance of size and quality -
High RAM (32GB+):
WebWorld-14B-Q8_0.gguf— near-original quality -
Low RAM (8GB):
WebWorld-14B-Q3_K_M.gguf— fits in 8GB with room to spare
⚡ Speed Benchmarks
Run
python benchmark.py --model WebWorld-14B
to generate speed results.
🧠 Quality Benchmarks
Run
kaggle_bench.ipynb
on Kaggle to benchmark this model.
🚀 How to Use
Ollama
ollama run dhptl/webworld-14b
LM Studio / Jan / Open WebUI
Search for
Dhptl/WebWorld-14B
in the model browser.
llama.cpp CLI
# Download the binary from https://github.com/ggerganov/llama.cpp/releases
./llama-cli \
-m WebWorld-14B-Q4_K_M.gguf \
-p "You are a helpful assistant." \
--conversation \
-n 512
Python — llama-cpp-python
from llama_cpp import Llama
llm = Llama(
model_path="./WebWorld-14B-Q4_K_M.gguf",
n_gpu_layers=-1, # -1 = offload everything to GPU
n_ctx=4096,
)
response = llm.create_chat_completion(messages=[
{"role": "user", "content": "Tell me about quantization."}
])
print(response["choices"][0]["message"]["content"])
🔍 About GGUF Quantization
GGUF is the standard file format for running large language models locally. Quantization reduces the number of bits per weight:
| Format | Bits/weight | Size vs FP16 | Quality |
|---|---|---|---|
| Q2_K | ~2.6 | 16% | ⭐ |
| Q3_K_M | ~3.3 | 21% | ⭐⭐⭐ |
| Q4_K_M | ~4.5 | 28% | ⭐⭐⭐⭐ ← sweet spot |
| Q5_K_M | ~5.6 | 35% | ⭐⭐⭐⭐½ |
| Q8_0 | ~8.5 | 53% | ⭐⭐⭐⭐⭐ |
💬 Community & Feedback
Found an issue? Have a question? Open a Discussion in the Community tab above.
If these quantizations were useful, please consider:
- ⭐ Starring quant-kit on GitHub
- 👍 Liking this model on HuggingFace
- 💬 Leaving feedback in the Community tab
Runs of DhruvalLabs WebWorld-14B-GGUF on huggingface.co
189
Total runs
16
24-hour runs
15
3-day runs
20
7-day runs
81
30-day runs
More Information About WebWorld-14B-GGUF huggingface.co Model
Url of WebWorld-14B-GGUF
WebWorld-14B-GGUF huggingface.co Url
Provider of WebWorld-14B-GGUF huggingface.co
Other API from DhruvalLabs
Updated:June 17 2026
Total runs:
4.4K
Run Growth:
3.6K
Growth Rate:
82.22%
Total runs:
3.1K
Run Growth:
-2.4K
Growth Rate:
-78.33%
Total runs:
2.4K
Run Growth:
-1.7K
Growth Rate:
-70.53%
Total runs:
1.9K
Run Growth:
1.5K
Growth Rate:
79.74%
Total runs:
1.8K
Run Growth:
1.0K
Growth Rate:
57.19%
Total runs:
1.8K
Run Growth:
1.7K
Growth Rate:
95.57%
Total runs:
998
Run Growth:
626
Growth Rate:
62.73%
Total runs:
955
Run Growth:
-12.4K
Growth Rate:
-1302.93%
Total runs:
947
Run Growth:
-48
Growth Rate:
-5.07%
Total runs:
803
Run Growth:
-1.1K
Growth Rate:
-133.87%
Total runs:
753
Run Growth:
573
Growth Rate:
76.10%
Total runs:
591
Run Growth:
445
Growth Rate:
75.30%
Total runs:
546
Run Growth:
-1.2K
Growth Rate:
-221.79%
Total runs:
461
Run Growth:
-936
Growth Rate:
-203.04%
Total runs:
446
Run Growth:
115
Growth Rate:
25.78%
Total runs:
440
Run Growth:
216
Growth Rate:
49.09%
Total runs:
438
Run Growth:
97
Growth Rate:
22.15%
Total runs:
427
Run Growth:
-66
Growth Rate:
-15.46%
Total runs:
423
Run Growth:
287
Growth Rate:
67.85%
Total runs:
404
Run Growth:
-48
Growth Rate:
-11.88%
Total runs:
359
Run Growth:
324
Growth Rate:
90.25%
Total runs:
348
Run Growth:
302
Growth Rate:
86.78%
Total runs:
337
Run Growth:
193
Growth Rate:
57.27%
Total runs:
328
Run Growth:
238
Growth Rate:
72.56%
Total runs:
326
Run Growth:
140
Growth Rate:
42.94%
Total runs:
311
Run Growth:
-170
Growth Rate:
-54.66%
Total runs:
291
Run Growth:
133
Growth Rate:
45.70%
Total runs:
270
Run Growth:
20
Growth Rate:
7.41%
Total runs:
267
Run Growth:
109
Growth Rate:
40.82%
Total runs:
260
Run Growth:
136
Growth Rate:
52.31%
Total runs:
253
Run Growth:
225
Growth Rate:
88.93%
Total runs:
233
Run Growth:
233
Growth Rate:
100.00%
Total runs:
229
Run Growth:
58
Growth Rate:
25.33%
Total runs:
228
Run Growth:
176
Growth Rate:
77.19%
Total runs:
219
Run Growth:
32
Growth Rate:
14.61%
Total runs:
215
Run Growth:
22
Growth Rate:
10.23%
Total runs:
199
Run Growth:
89
Growth Rate:
44.72%
Total runs:
191
Run Growth:
26
Growth Rate:
13.61%
Total runs:
179
Run Growth:
-39
Growth Rate:
-21.79%
Total runs:
172
Run Growth:
-7
Growth Rate:
-4.07%
Total runs:
170
Run Growth:
94
Growth Rate:
55.29%
Total runs:
157
Run Growth:
94
Growth Rate:
59.87%
Total runs:
137
Run Growth:
-86
Growth Rate:
-62.77%
Total runs:
135
Run Growth:
12
Growth Rate:
8.89%
Total runs:
131
Run Growth:
-80
Growth Rate:
-61.07%
Total runs:
129
Run Growth:
50
Growth Rate:
39.68%
Total runs:
121
Run Growth:
-1.4K
Growth Rate:
-1171.90%
Total runs:
121
Run Growth:
75
Growth Rate:
61.98%
Total runs:
104
Run Growth:
-3
Growth Rate:
-2.88%
Total runs:
99
Run Growth:
-20
Growth Rate:
-20.20%
Total runs:
47
Run Growth:
-30
Growth Rate:
-63.83%
Total runs:
37
Run Growth:
-55
Growth Rate:
-148.65%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%