Total runs:
4.5K
Run Growth:
2.9K
Growth Rate:
64.73%
Sponsored by
APIMaster
DhruvalLabs / stable-code-3b-GGUF
Model's Last Updated: June 18 2026
text-generation
Introduction of stable-code-3b-GGUF
Model Details of stable-code-3b-GGUF
stable-code-3b — GGUF Quantizations
Quantized GGUF versions of stabilityai/stable-code-3b
Works with llama.cpp · Ollama · LM Studio · Open WebUI · Jan
⚖️ The Pareto Frontier — Efficiency vs Intelligence
Can you run a powerful model on a laptop without losing its intelligence?
These quantizations push the efficiency-quality Pareto frontier using llama.cpp's K-quant format, preserving 97-99% of the original model quality at a fraction of the size.
| Benchmark | Original (FP16) | Q4_K_M | Quality Retained |
|---|---|---|---|
| MMLU Pro | See original card | Run benchmarks | ~97-99% |
| HellaSwag | See original card | Run benchmarks | ~97-99% |
| ARC Challenge | See original card | Run benchmarks | ~97-99% |
| TruthfulQA | See original card | Run benchmarks | ~97-99% |
| GSM8K | See original card | Run benchmarks | ~97-99% |
📦 Available Files
| Filename | Size | RAM Required | Quant | Quality | Best For |
|---|---|---|---|---|---|
stable-code-3b-Q2_K.gguf
|
1.01 GB | ~2.5 GB |
Q2_K
|
⭐ | Extreme compression, significant quality loss. |
stable-code-3b-Q3_K_L.gguf
|
1.40 GB | ~2.9 GB |
Q3_K_L
|
⭐⭐⭐ | Slightly better than Q3_K_M, still a compromise. |
stable-code-3b-Q3_K_M.gguf
|
1.30 GB | ~2.8 GB |
Q3_K_M
|
⭐⭐⭐ | Very small file. Quality drop noticeable. |
stable-code-3b-Q3_K_S.gguf
|
1.17 GB | ~2.7 GB |
Q3_K_S
|
⭐⭐ | Very high compression, high quality loss. |
stable-code-3b-Q4_K_M.gguf
|
1.59 GB | ~3.1 GB |
Q4_K_M
✅
Recommended
|
⭐⭐⭐⭐ | Best balance of size and quality. Recommended for most users. |
stable-code-3b-Q4_K_S.gguf
|
1.51 GB | ~3.0 GB |
Q4_K_S
|
⭐⭐⭐½ | Good speed/size balance, slight quality loss. |
stable-code-3b-Q5_K_M.gguf
|
1.86 GB | ~3.4 GB |
Q5_K_M
|
⭐⭐⭐⭐½ | Better quality than Q4, slightly larger. Great if you have the RAM. |
stable-code-3b-Q5_K_S.gguf
|
1.81 GB | ~3.3 GB |
Q5_K_S
|
⭐⭐⭐⭐ | Large but accurate. |
stable-code-3b-Q6_K.gguf
|
2.14 GB | ~3.6 GB |
Q6_K
|
⭐⭐⭐⭐⭐ | Near-perfect quality, very large. |
stable-code-3b-Q8_0.gguf
|
2.77 GB | ~4.3 GB |
Q8_0
|
⭐⭐⭐⭐⭐ | Closest to original quality. Use when RAM is not a concern. |
💡 Which file should I download?
-
Most users:
stable-code-3b-Q4_K_M.gguf— best balance of size and quality -
High RAM (32GB+):
stable-code-3b-Q8_0.gguf— near-original quality -
Low RAM (8GB):
stable-code-3b-Q3_K_M.gguf— fits in 8GB with room to spare
⚡ Speed Benchmarks
Run
python benchmark.py --model stable-code-3b
to generate speed results.
🧠 Quality Benchmarks
Run
kaggle_bench.ipynb
on Kaggle to benchmark this model.
🚀 How to Use
Ollama
ollama run dhptl/stable-code-3b
LM Studio / Jan / Open WebUI
Search for
Dhptl/stable-code-3b
in the model browser.
llama.cpp CLI
# Download the binary from https://github.com/ggerganov/llama.cpp/releases
./llama-cli \
-m stable-code-3b-Q4_K_M.gguf \
-p "You are a helpful assistant." \
--conversation \
-n 512
Python — llama-cpp-python
from llama_cpp import Llama
llm = Llama(
model_path="./stable-code-3b-Q4_K_M.gguf",
n_gpu_layers=-1, # -1 = offload everything to GPU
n_ctx=4096,
)
response = llm.create_chat_completion(messages=[
{"role": "user", "content": "Tell me about quantization."}
])
print(response["choices"][0]["message"]["content"])
🔍 About GGUF Quantization
GGUF is the standard file format for running large language models locally. Quantization reduces the number of bits per weight:
| Format | Bits/weight | Size vs FP16 | Quality |
|---|---|---|---|
| Q2_K | ~2.6 | 16% | ⭐ |
| Q3_K_M | ~3.3 | 21% | ⭐⭐⭐ |
| Q4_K_M | ~4.5 | 28% | ⭐⭐⭐⭐ ← sweet spot |
| Q5_K_M | ~5.6 | 35% | ⭐⭐⭐⭐½ |
| Q8_0 | ~8.5 | 53% | ⭐⭐⭐⭐⭐ |
💬 Community & Feedback
Found an issue? Have a question? Open a Discussion in the Community tab above.
If these quantizations were useful, please consider:
- ⭐ Starring quant-kit on GitHub
- 👍 Liking this model on HuggingFace
- 💬 Leaving feedback in the Community tab
Runs of DhruvalLabs stable-code-3b-GGUF on huggingface.co
141
Total runs
-2
24-hour runs
2
3-day runs
-27
7-day runs
-74
30-day runs
More Information About stable-code-3b-GGUF huggingface.co Model
Url of stable-code-3b-GGUF
stable-code-3b-GGUF huggingface.co Url
Provider of stable-code-3b-GGUF huggingface.co
Other API from DhruvalLabs
Updated:June 17 2026
Total runs:
4.3K
Run Growth:
3.4K
Growth Rate:
80.43%
Total runs:
2.5K
Run Growth:
-2.9K
Growth Rate:
-117.45%
Total runs:
2.4K
Run Growth:
-1.8K
Growth Rate:
-74.51%
Total runs:
1.8K
Run Growth:
1.6K
Growth Rate:
89.51%
Total runs:
1.7K
Run Growth:
1.7K
Growth Rate:
96.39%
Total runs:
1.6K
Run Growth:
944
Growth Rate:
57.77%
Total runs:
973
Run Growth:
625
Growth Rate:
64.23%
Total runs:
961
Run Growth:
-12.4K
Growth Rate:
-1294.07%
Total runs:
935
Run Growth:
337
Growth Rate:
36.04%
Total runs:
763
Run Growth:
595
Growth Rate:
77.98%
Total runs:
588
Run Growth:
418
Growth Rate:
71.09%
Total runs:
548
Run Growth:
-1.2K
Growth Rate:
-214.96%
Total runs:
534
Run Growth:
-1.4K
Growth Rate:
-259.93%
Total runs:
494
Run Growth:
-868
Growth Rate:
-175.71%
Total runs:
461
Run Growth:
146
Growth Rate:
31.67%
Total runs:
457
Run Growth:
229
Growth Rate:
50.11%
Total runs:
439
Run Growth:
81
Growth Rate:
18.45%
Total runs:
427
Run Growth:
-5
Growth Rate:
-1.17%
Total runs:
424
Run Growth:
281
Growth Rate:
66.27%
Total runs:
423
Run Growth:
-42
Growth Rate:
-9.93%
Total runs:
351
Run Growth:
311
Growth Rate:
88.60%
Total runs:
345
Run Growth:
298
Growth Rate:
86.38%
Total runs:
330
Run Growth:
132
Growth Rate:
40.00%
Total runs:
318
Run Growth:
100
Growth Rate:
31.45%
Total runs:
313
Run Growth:
78
Growth Rate:
24.92%
Total runs:
311
Run Growth:
36
Growth Rate:
11.58%
Total runs:
281
Run Growth:
-63
Growth Rate:
-22.42%
Total runs:
270
Run Growth:
103
Growth Rate:
38.15%
Total runs:
266
Run Growth:
163
Growth Rate:
61.28%
Total runs:
264
Run Growth:
87
Growth Rate:
32.95%
Total runs:
264
Run Growth:
5
Growth Rate:
1.89%
Total runs:
241
Run Growth:
209
Growth Rate:
86.72%
Total runs:
235
Run Growth:
138
Growth Rate:
58.72%
Total runs:
234
Run Growth:
191
Growth Rate:
81.62%
Total runs:
233
Run Growth:
233
Growth Rate:
100.00%
Total runs:
232
Run Growth:
141
Growth Rate:
60.78%
Total runs:
219
Run Growth:
32
Growth Rate:
14.61%
Total runs:
204
Run Growth:
21
Growth Rate:
10.29%
Total runs:
201
Run Growth:
45
Growth Rate:
22.39%
Total runs:
180
Run Growth:
-37
Growth Rate:
-20.56%
Total runs:
174
Run Growth:
65
Growth Rate:
37.36%
Total runs:
173
Run Growth:
-7
Growth Rate:
-4.05%
Total runs:
170
Run Growth:
93
Growth Rate:
54.71%
Total runs:
157
Run Growth:
88
Growth Rate:
56.05%
Total runs:
146
Run Growth:
35
Growth Rate:
23.97%
Total runs:
143
Run Growth:
-55
Growth Rate:
-38.46%
Total runs:
126
Run Growth:
39
Growth Rate:
30.95%
Total runs:
121
Run Growth:
75
Growth Rate:
61.98%
Total runs:
112
Run Growth:
-1.4K
Growth Rate:
-1273.21%
Total runs:
100
Run Growth:
-1
Growth Rate:
-1.00%
Total runs:
100
Run Growth:
-36
Growth Rate:
-36.00%
Total runs:
50
Run Growth:
-51
Growth Rate:
-102.00%
Total runs:
42
Run Growth:
-90
Growth Rate:
-214.29%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%