Total runs:
1.5M
Run Growth:
1.4M
Growth Rate:
94.80%
Sponsored by
AdsCreator.com
mradermacher / abyss-tiny-4b-GGUF
Model's Last Updated: July 04 2026
Introduction of abyss-tiny-4b-GGUF
Model Details of abyss-tiny-4b-GGUF
About
static quants of https://huggingface.co/vizgg32dx/abyss-tiny-4b
For a convenient overview and download list, visit our model page for this model .
weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
Usage
If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.
Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|---|---|---|---|
| GGUF | Q2_K | 1.8 | |
| GGUF | Q3_K_S | 2.0 | |
| GGUF | Q3_K_M | 2.2 | lower quality |
| GGUF | Q3_K_L | 2.3 | |
| GGUF | IQ4_XS | 2.4 | |
| GGUF | Q4_K_S | 2.5 | fast, recommended |
| GGUF | Q4_K_M | 2.6 | fast, recommended |
| GGUF | Q5_K_S | 2.9 | |
| GGUF | Q5_K_M | 3.0 | |
| GGUF | Q6_K | 3.4 | very good quality |
| GGUF | Q8_0 | 4.4 | fast, best quality |
| GGUF | f16 | 8.2 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.
Thanks
I thank my company, nethype GmbH , for letting me use its servers and providing upgrades to my workstation to enable this work in my free time.
Runs of mradermacher abyss-tiny-4b-GGUF on huggingface.co
120
Total runs
2
24-hour runs
3
3-day runs
3
7-day runs
92
30-day runs
More Information About abyss-tiny-4b-GGUF huggingface.co Model
Url of abyss-tiny-4b-GGUF
abyss-tiny-4b-GGUF huggingface.co Url
Provider of abyss-tiny-4b-GGUF huggingface.co
Other API from mradermacher
Updated:August 20 2026
Total runs:
665.0K
Run Growth:
6.1K
Growth Rate:
0.91%
Total runs:
365.0K
Run Growth:
362.6K
Growth Rate:
99.37%
Total runs:
276.9K
Run Growth:
254.9K
Growth Rate:
92.04%
Total runs:
276.7K
Run Growth:
256.1K
Growth Rate:
92.56%
Total runs:
181.1K
Run Growth:
-63.3K
Growth Rate:
-34.97%
Total runs:
148.3K
Run Growth:
106.4K
Growth Rate:
71.69%
Total runs:
133.1K
Run Growth:
-76.3K
Growth Rate:
-57.34%
Total runs:
130.8K
Run Growth:
-159.1K
Growth Rate:
-121.61%
Total runs:
124.4K
Run Growth:
122.0K
Growth Rate:
98.09%
Total runs:
101.9K
Run Growth:
82.0K
Growth Rate:
80.51%
Total runs:
101.6K
Run Growth:
101.6K
Growth Rate:
100.00%
Total runs:
96.8K
Run Growth:
42.6K
Growth Rate:
43.95%
Total runs:
89.0K
Run Growth:
-112.6K
Growth Rate:
-126.49%
Total runs:
65.7K
Run Growth:
65.7K
Growth Rate:
99.96%
Total runs:
65.5K
Run Growth:
35.1K
Growth Rate:
53.53%
Total runs:
58.4K
Run Growth:
-21.9K
Growth Rate:
-37.49%
Total runs:
58.4K
Run Growth:
-96.6K
Growth Rate:
-165.48%
Total runs:
57.6K
Run Growth:
55.5K
Growth Rate:
96.45%
Total runs:
51.9K
Run Growth:
49.1K
Growth Rate:
94.66%
Total runs:
47.6K
Run Growth:
39.8K
Growth Rate:
83.55%
Total runs:
45.5K
Run Growth:
15.2K
Growth Rate:
33.45%
Total runs:
45.4K
Run Growth:
22.8K
Growth Rate:
50.26%
Total runs:
43.5K
Run Growth:
-63.4K
Growth Rate:
-145.82%
Total runs:
42.1K
Run Growth:
36.1K
Growth Rate:
85.69%
Total runs:
39.3K
Run Growth:
23.4K
Growth Rate:
59.55%
Total runs:
37.6K
Run Growth:
36.9K
Growth Rate:
98.20%
Total runs:
37.2K
Run Growth:
10.2K
Growth Rate:
27.59%
Total runs:
36.8K
Run Growth:
1.2K
Growth Rate:
3.33%
Total runs:
36.5K
Run Growth:
14.7K
Growth Rate:
40.35%
Total runs:
35.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
35.5K
Run Growth:
5.6K
Growth Rate:
15.78%
Total runs:
35.2K
Run Growth:
7.8K
Growth Rate:
22.08%
Total runs:
34.1K
Run Growth:
27.7K
Growth Rate:
81.19%
Total runs:
33.7K
Run Growth:
22.6K
Growth Rate:
67.10%
Total runs:
32.1K
Run Growth:
32.1K
Growth Rate:
100.00%
Total runs:
31.8K
Run Growth:
6.9K
Growth Rate:
21.87%
Total runs:
31.7K
Run Growth:
31.7K
Growth Rate:
100.00%
Total runs:
30.6K
Run Growth:
14.3K
Growth Rate:
46.84%
Total runs:
29.6K
Run Growth:
9.4K
Growth Rate:
31.86%
Total runs:
29.2K
Run Growth:
29.2K
Growth Rate:
100.00%
Total runs:
28.8K
Run Growth:
276
Growth Rate:
0.96%
Total runs:
28.6K
Run Growth:
-160
Growth Rate:
-0.56%
Total runs:
28.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
28.2K
Run Growth:
3.8K
Growth Rate:
13.55%
Total runs:
28.0K
Run Growth:
3.6K
Growth Rate:
13.01%
Total runs:
27.3K
Run Growth:
9.5K
Growth Rate:
34.90%
Total runs:
27.1K
Run Growth:
22.0K
Growth Rate:
81.43%
Total runs:
26.8K
Run Growth:
26.8K
Growth Rate:
100.00%
Total runs:
26.6K
Run Growth:
11.4K
Growth Rate:
43.00%
Total runs:
26.1K
Run Growth:
2.1K
Growth Rate:
8.10%
Total runs:
25.7K
Run Growth:
113
Growth Rate:
0.44%
Total runs:
25.6K
Run Growth:
20.2K
Growth Rate:
78.72%
Total runs:
24.6K
Run Growth:
5.9K
Growth Rate:
23.92%
Total runs:
24.6K
Run Growth:
606
Growth Rate:
2.47%
Total runs:
24.5K
Run Growth:
134
Growth Rate:
0.55%
Total runs:
24.5K
Run Growth:
258
Growth Rate:
1.05%
Total runs:
24.5K
Run Growth:
24.5K
Growth Rate:
100.00%
Total runs:
24.1K
Run Growth:
401
Growth Rate:
1.66%
Total runs:
24.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23.8K
Run Growth:
272
Growth Rate:
1.14%
Total runs:
23.4K
Run Growth:
17.0K
Growth Rate:
72.68%
Total runs:
23.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
22.9K
Run Growth:
95
Growth Rate:
0.41%
Total runs:
22.7K
Run Growth:
20.5K
Growth Rate:
90.28%
Total runs:
22.5K
Run Growth:
3.9K
Growth Rate:
17.33%
Total runs:
22.3K
Run Growth:
3.4K
Growth Rate:
15.03%
Total runs:
22.3K
Run Growth:
277
Growth Rate:
1.24%
Total runs:
22.3K
Run Growth:
7.3K
Growth Rate:
32.71%
Total runs:
22.3K
Run Growth:
19.3K
Growth Rate:
86.84%
Total runs:
22.0K
Run Growth:
2.1K
Growth Rate:
9.43%
Total runs:
22.0K
Run Growth:
21.6K
Growth Rate:
98.11%
Total runs:
22.0K
Run Growth:
2.7K
Growth Rate:
12.12%
Total runs:
21.9K
Run Growth:
1.6K
Growth Rate:
7.54%
Total runs:
21.8K
Run Growth:
6.7K
Growth Rate:
30.83%
Total runs:
21.8K
Run Growth:
297
Growth Rate:
1.36%
Total runs:
21.6K
Run Growth:
18.9K
Growth Rate:
87.53%
Total runs:
21.3K
Run Growth:
20.4K
Growth Rate:
95.66%
Total runs:
21.1K
Run Growth:
4.2K
Growth Rate:
19.78%
Total runs:
20.8K
Run Growth:
20.8K
Growth Rate:
99.98%
Total runs:
20.7K
Run Growth:
15.3K
Growth Rate:
74.00%
Total runs:
20.6K
Run Growth:
20.6K
Growth Rate:
100.00%
Total runs:
20.5K
Run Growth:
100
Growth Rate:
0.49%
Total runs:
20.4K
Run Growth:
11.5K
Growth Rate:
56.40%
Total runs:
20.2K
Run Growth:
12.0K
Growth Rate:
59.04%
Total runs:
19.8K
Run Growth:
15.7K
Growth Rate:
79.28%
Total runs:
19.6K
Run Growth:
18.2K
Growth Rate:
92.78%
Total runs:
19.6K
Run Growth:
-12.1K
Growth Rate:
-61.83%
Total runs:
19.2K
Run Growth:
13.2K
Growth Rate:
68.97%
Total runs:
19.1K
Run Growth:
14.0K
Growth Rate:
73.40%
Total runs:
19.0K
Run Growth:
14.2K
Growth Rate:
74.92%
Total runs:
18.9K
Run Growth:
10.2K
Growth Rate:
53.80%
Total runs:
18.7K
Run Growth:
6.7K
Growth Rate:
35.85%
Total runs:
18.5K
Run Growth:
130
Growth Rate:
0.70%
Total runs:
18.4K
Run Growth:
2.2K
Growth Rate:
11.84%
Total runs:
18.4K
Run Growth:
18.4K
Growth Rate:
100.00%
Total runs:
18.4K
Run Growth:
278
Growth Rate:
1.51%
Total runs:
18.3K
Run Growth:
764
Growth Rate:
4.16%