Total runs:
1.8M
Run Growth:
1.6M
Growth Rate:
88.40%
Sponsored by
APIMart
mradermacher / boto-9B-GGUF
Model's Last Updated: July 11 2024
Introduction of boto-9B-GGUF
Model Details of boto-9B-GGUF
About
static quants of https://huggingface.co/lucianosb/boto-9B
weighted/imatrix quants are available at https://huggingface.co/mradermacher/boto-9B-i1-GGUF
Usage
If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.
Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|---|---|---|---|
| GGUF | Q2_K | 3.9 | |
| GGUF | IQ3_XS | 4.2 | |
| GGUF | IQ3_S | 4.4 | beats Q3_K* |
| GGUF | Q3_K_S | 4.4 | |
| GGUF | IQ3_M | 4.6 | |
| GGUF | Q3_K_M | 4.9 | lower quality |
| GGUF | Q3_K_L | 5.2 | |
| GGUF | IQ4_XS | 5.3 | |
| GGUF | Q4_K_S | 5.6 | fast, recommended |
| GGUF | Q4_K_M | 5.9 | fast, recommended |
| GGUF | Q5_K_S | 6.6 | |
| GGUF | Q5_K_M | 6.7 | |
| GGUF | Q6_K | 7.7 | very good quality |
| GGUF | Q8_0 | 9.9 | fast, best quality |
| GGUF | f16 | 18.6 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.
Thanks
I thank my company, nethype GmbH , for letting me use its servers and providing upgrades to my workstation to enable this work in my free time.
Runs of mradermacher boto-9B-GGUF on huggingface.co
459
Total runs
-4
24-hour runs
-28
3-day runs
-143
7-day runs
-566
30-day runs
More Information About boto-9B-GGUF huggingface.co Model
Url of boto-9B-GGUF
boto-9B-GGUF huggingface.co Url
Provider of boto-9B-GGUF huggingface.co
Other API from mradermacher
Updated:August 20 2026
Total runs:
665.0K
Run Growth:
6.1K
Growth Rate:
0.91%
Total runs:
626.2K
Run Growth:
592.0K
Growth Rate:
99.61%
Total runs:
276.9K
Run Growth:
254.9K
Growth Rate:
92.04%
Total runs:
276.7K
Run Growth:
256.1K
Growth Rate:
92.56%
Total runs:
262.5K
Run Growth:
325
Growth Rate:
33.27%
Total runs:
211.0K
Run Growth:
181.7K
Growth Rate:
99.67%
Total runs:
196.0K
Run Growth:
186.7K
Growth Rate:
98.74%
Total runs:
194.3K
Run Growth:
160.4K
Growth Rate:
94.50%
Total runs:
181.1K
Run Growth:
-63.3K
Growth Rate:
-34.97%
Total runs:
159.1K
Run Growth:
99.0K
Growth Rate:
61.98%
Total runs:
140.7K
Run Growth:
75.6K
Growth Rate:
57.57%
Total runs:
130.8K
Run Growth:
-159.1K
Growth Rate:
-121.61%
Total runs:
106.7K
Run Growth:
-90.8K
Growth Rate:
-84.22%
Total runs:
105.7K
Run Growth:
105.6K
Growth Rate:
100.00%
Total runs:
103.4K
Run Growth:
61.6K
Growth Rate:
61.18%
Total runs:
89.0K
Run Growth:
-112.6K
Growth Rate:
-126.49%
Total runs:
67.2K
Run Growth:
66.5K
Growth Rate:
99.96%
Total runs:
58.4K
Run Growth:
-21.9K
Growth Rate:
-37.49%
Total runs:
58.4K
Run Growth:
-96.6K
Growth Rate:
-165.48%
Total runs:
57.9K
Run Growth:
55.7K
Growth Rate:
96.34%
Total runs:
54.0K
Run Growth:
-39.2K
Growth Rate:
-71.67%
Total runs:
51.9K
Run Growth:
49.1K
Growth Rate:
94.66%
Total runs:
50.9K
Run Growth:
32.9K
Growth Rate:
66.41%
Total runs:
50.3K
Run Growth:
35.2K
Growth Rate:
76.98%
Total runs:
45.8K
Run Growth:
5.7K
Growth Rate:
13.23%
Total runs:
45.5K
Run Growth:
15.2K
Growth Rate:
33.45%
Total runs:
44.4K
Run Growth:
1.9K
Growth Rate:
4.35%
Total runs:
42.3K
Run Growth:
37.9K
Growth Rate:
90.98%
Total runs:
42.1K
Run Growth:
36.1K
Growth Rate:
85.69%
Total runs:
41.3K
Run Growth:
11.0K
Growth Rate:
27.00%
Total runs:
39.4K
Run Growth:
21.9K
Growth Rate:
58.22%
Total runs:
38.7K
Run Growth:
12.7K
Growth Rate:
30.96%
Total runs:
37.9K
Run Growth:
14.9K
Growth Rate:
39.41%
Total runs:
37.7K
Run Growth:
36.9K
Growth Rate:
97.94%
Total runs:
37.0K
Run Growth:
18.8K
Growth Rate:
50.67%
Total runs:
36.8K
Run Growth:
1.2K
Growth Rate:
3.33%
Total runs:
35.9K
Run Growth:
-90.0K
Growth Rate:
-248.97%
Total runs:
35.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
35.2K
Run Growth:
7.8K
Growth Rate:
22.08%
Total runs:
34.8K
Run Growth:
5.0K
Growth Rate:
14.31%
Total runs:
34.1K
Run Growth:
27.7K
Growth Rate:
81.19%
Total runs:
32.1K
Run Growth:
32.1K
Growth Rate:
100.00%
Total runs:
31.8K
Run Growth:
6.9K
Growth Rate:
21.87%
Total runs:
31.7K
Run Growth:
31.7K
Growth Rate:
100.00%
Total runs:
30.3K
Run Growth:
11.4K
Growth Rate:
37.16%
Total runs:
29.2K
Run Growth:
9.3K
Growth Rate:
32.34%
Total runs:
29.2K
Run Growth:
29.2K
Growth Rate:
100.00%
Total runs:
28.8K
Run Growth:
276
Growth Rate:
0.96%
Total runs:
28.8K
Run Growth:
2.6K
Growth Rate:
9.81%
Total runs:
28.8K
Run Growth:
20.6K
Growth Rate:
79.18%
Total runs:
28.6K
Run Growth:
232
Growth Rate:
0.81%
Total runs:
28.6K
Run Growth:
-160
Growth Rate:
-0.56%
Total runs:
28.2K
Run Growth:
3.8K
Growth Rate:
13.55%
Total runs:
28.0K
Run Growth:
3.6K
Growth Rate:
13.01%
Total runs:
27.6K
Run Growth:
10.3K
Growth Rate:
37.31%
Total runs:
27.3K
Run Growth:
9.5K
Growth Rate:
34.90%
Total runs:
27.1K
Run Growth:
22.0K
Growth Rate:
81.43%
Total runs:
26.8K
Run Growth:
26.8K
Growth Rate:
100.00%
Total runs:
26.6K
Run Growth:
11.4K
Growth Rate:
43.00%
Total runs:
26.1K
Run Growth:
2.1K
Growth Rate:
8.10%
Total runs:
25.9K
Run Growth:
12.2K
Growth Rate:
52.82%
Total runs:
25.7K
Run Growth:
113
Growth Rate:
0.44%
Total runs:
24.6K
Run Growth:
606
Growth Rate:
2.47%
Total runs:
24.5K
Run Growth:
134
Growth Rate:
0.55%
Total runs:
24.5K
Run Growth:
258
Growth Rate:
1.05%
Total runs:
24.5K
Run Growth:
24.5K
Growth Rate:
100.00%
Total runs:
24.1K
Run Growth:
401
Growth Rate:
1.66%
Total runs:
24.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23.8K
Run Growth:
272
Growth Rate:
1.14%
Total runs:
23.4K
Run Growth:
17.0K
Growth Rate:
72.68%
Total runs:
23.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
22.9K
Run Growth:
15.9K
Growth Rate:
69.54%
Total runs:
22.9K
Run Growth:
95
Growth Rate:
0.41%
Total runs:
22.7K
Run Growth:
20.5K
Growth Rate:
90.28%
Total runs:
22.5K
Run Growth:
3.9K
Growth Rate:
17.33%
Total runs:
22.4K
Run Growth:
12.5K
Growth Rate:
57.68%
Total runs:
22.3K
Run Growth:
3.4K
Growth Rate:
15.03%
Total runs:
22.3K
Run Growth:
277
Growth Rate:
1.24%
Total runs:
22.3K
Run Growth:
7.3K
Growth Rate:
32.71%
Total runs:
22.3K
Run Growth:
19.3K
Growth Rate:
86.84%
Total runs:
22.1K
Run Growth:
20.5K
Growth Rate:
92.87%
Total runs:
22.0K
Run Growth:
2.1K
Growth Rate:
9.43%
Total runs:
22.0K
Run Growth:
21.6K
Growth Rate:
98.11%
Total runs:
21.9K
Run Growth:
1.6K
Growth Rate:
7.54%
Total runs:
21.8K
Run Growth:
6.7K
Growth Rate:
30.83%
Total runs:
21.8K
Run Growth:
297
Growth Rate:
1.36%
Total runs:
21.6K
Run Growth:
18.9K
Growth Rate:
87.53%
Total runs:
21.5K
Run Growth:
9.4K
Growth Rate:
44.05%
Total runs:
21.1K
Run Growth:
4.2K
Growth Rate:
19.78%
Total runs:
20.8K
Run Growth:
20.8K
Growth Rate:
99.98%
Total runs:
20.7K
Run Growth:
15.3K
Growth Rate:
74.00%
Total runs:
20.6K
Run Growth:
20.6K
Growth Rate:
100.00%
Total runs:
20.5K
Run Growth:
100
Growth Rate:
0.49%
Total runs:
20.4K
Run Growth:
9.6K
Growth Rate:
47.06%
Total runs:
19.7K
Run Growth:
10.4K
Growth Rate:
52.99%
Total runs:
19.6K
Run Growth:
18.7K
Growth Rate:
95.26%
Total runs:
19.6K
Run Growth:
16.5K
Growth Rate:
84.04%
Total runs:
19.6K
Run Growth:
-12.1K
Growth Rate:
-61.83%