Total runs:
1.7M
Run Growth:
1.5M
Growth Rate:
93.80%
Sponsored by
APIMart
mradermacher / Code-Llama-Bagel-8B-i1-GGUF
Model's Last Updated: August 02 2024
Introduction of Code-Llama-Bagel-8B-i1-GGUF
Model Details of Code-Llama-Bagel-8B-i1-GGUF
About
weighted/imatrix quants of https://huggingface.co/theprint/Code-Llama-Bagel-8B
static quants are available at https://huggingface.co/mradermacher/Code-Llama-Bagel-8B-GGUF
Usage
If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.
Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|---|---|---|---|
| GGUF | i1-IQ1_S | 2.1 | for the desperate |
| GGUF | i1-IQ1_M | 2.3 | mostly desperate |
| GGUF | i1-IQ2_XXS | 2.5 | |
| GGUF | i1-IQ2_XS | 2.7 | |
| GGUF | i1-IQ2_S | 2.9 | |
| GGUF | i1-IQ2_M | 3.0 | |
| GGUF | i1-Q2_K | 3.3 | IQ3_XXS probably better |
| GGUF | i1-IQ3_XXS | 3.4 | lower quality |
| GGUF | i1-IQ3_XS | 3.6 | |
| GGUF | i1-Q3_K_S | 3.8 | IQ3_XS probably better |
| GGUF | i1-IQ3_S | 3.8 | beats Q3_K* |
| GGUF | i1-IQ3_M | 3.9 | |
| GGUF | i1-Q3_K_M | 4.1 | IQ3_S probably better |
| GGUF | i1-Q3_K_L | 4.4 | IQ3_M probably better |
| GGUF | i1-IQ4_XS | 4.5 | |
| GGUF | i1-Q4_0 | 4.8 | fast, low quality |
| GGUF | i1-Q4_K_S | 4.8 | optimal size/speed/quality |
| GGUF | i1-Q4_K_M | 5.0 | fast, recommended |
| GGUF | i1-Q5_K_S | 5.7 | |
| GGUF | i1-Q5_K_M | 5.8 | |
| GGUF | i1-Q6_K | 6.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.
Thanks
I thank my company, nethype GmbH , for letting me use its servers and providing upgrades to my workstation to enable this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
Runs of mradermacher Code-Llama-Bagel-8B-i1-GGUF on huggingface.co
1.6K
Total runs
16
24-hour runs
-408
3-day runs
-770
7-day runs
-1.1K
30-day runs
More Information About Code-Llama-Bagel-8B-i1-GGUF huggingface.co Model
Url of Code-Llama-Bagel-8B-i1-GGUF
Code-Llama-Bagel-8B-i1-GGUF huggingface.co Url
Provider of Code-Llama-Bagel-8B-i1-GGUF huggingface.co
Other API from mradermacher
Updated:August 20 2026
Total runs:
665.0K
Run Growth:
6.1K
Growth Rate:
0.91%
Total runs:
496.9K
Run Growth:
464.6K
Growth Rate:
99.50%
Total runs:
276.9K
Run Growth:
254.9K
Growth Rate:
92.04%
Total runs:
276.7K
Run Growth:
256.1K
Growth Rate:
92.56%
Total runs:
181.1K
Run Growth:
-63.3K
Growth Rate:
-34.97%
Total runs:
164.2K
Run Growth:
137.7K
Growth Rate:
98.30%
Total runs:
156.8K
Run Growth:
104.9K
Growth Rate:
69.78%
Total runs:
130.8K
Run Growth:
-159.1K
Growth Rate:
-121.61%
Total runs:
119.5K
Run Growth:
-64.9K
Growth Rate:
-49.61%
Total runs:
113.2K
Run Growth:
49.5K
Growth Rate:
48.52%
Total runs:
103.6K
Run Growth:
102.0K
Growth Rate:
100.00%
Total runs:
101.9K
Run Growth:
82.0K
Growth Rate:
80.51%
Total runs:
92.5K
Run Growth:
64.5K
Growth Rate:
100.00%
Total runs:
89.0K
Run Growth:
55.0K
Growth Rate:
85.49%
Total runs:
89.0K
Run Growth:
-112.6K
Growth Rate:
-126.49%
Total runs:
78.5K
Run Growth:
36.9K
Growth Rate:
50.42%
Total runs:
66.2K
Run Growth:
65.9K
Growth Rate:
99.96%
Total runs:
58.4K
Run Growth:
-21.9K
Growth Rate:
-37.49%
Total runs:
58.4K
Run Growth:
-96.6K
Growth Rate:
-165.48%
Total runs:
57.9K
Run Growth:
55.5K
Growth Rate:
96.38%
Total runs:
51.9K
Run Growth:
49.1K
Growth Rate:
94.66%
Total runs:
46.7K
Run Growth:
38.5K
Growth Rate:
83.07%
Total runs:
45.5K
Run Growth:
15.2K
Growth Rate:
33.45%
Total runs:
44.9K
Run Growth:
30.7K
Growth Rate:
69.33%
Total runs:
42.1K
Run Growth:
36.1K
Growth Rate:
85.69%
Total runs:
42.0K
Run Growth:
62
Growth Rate:
0.15%
Total runs:
40.5K
Run Growth:
15.2K
Growth Rate:
37.33%
Total runs:
39.7K
Run Growth:
35.4K
Growth Rate:
90.41%
Total runs:
39.3K
Run Growth:
-75.8K
Growth Rate:
-185.21%
Total runs:
37.6K
Run Growth:
36.7K
Growth Rate:
97.79%
Total runs:
37.5K
Run Growth:
15.1K
Growth Rate:
40.30%
Total runs:
37.3K
Run Growth:
4.0K
Growth Rate:
64.31%
Total runs:
36.8K
Run Growth:
1.2K
Growth Rate:
3.33%
Total runs:
36.6K
Run Growth:
6.0K
Growth Rate:
16.69%
Total runs:
35.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
35.2K
Run Growth:
7.8K
Growth Rate:
22.08%
Total runs:
34.5K
Run Growth:
18.2K
Growth Rate:
52.73%
Total runs:
34.5K
Run Growth:
10.5K
Growth Rate:
33.99%
Total runs:
34.1K
Run Growth:
27.7K
Growth Rate:
81.19%
Total runs:
34.0K
Run Growth:
10.8K
Growth Rate:
28.61%
Total runs:
32.1K
Run Growth:
32.1K
Growth Rate:
100.00%
Total runs:
31.8K
Run Growth:
6.9K
Growth Rate:
21.87%
Total runs:
31.7K
Run Growth:
31.7K
Growth Rate:
100.00%
Total runs:
30.4K
Run Growth:
18.0K
Growth Rate:
53.54%
Total runs:
29.2K
Run Growth:
29.2K
Growth Rate:
100.00%
Total runs:
28.8K
Run Growth:
276
Growth Rate:
0.96%
Total runs:
28.7K
Run Growth:
76
Growth Rate:
0.27%
Total runs:
28.6K
Run Growth:
-160
Growth Rate:
-0.56%
Total runs:
28.2K
Run Growth:
3.8K
Growth Rate:
13.55%
Total runs:
28.0K
Run Growth:
3.6K
Growth Rate:
13.01%
Total runs:
27.3K
Run Growth:
9.5K
Growth Rate:
34.90%
Total runs:
27.1K
Run Growth:
22.0K
Growth Rate:
81.43%
Total runs:
26.8K
Run Growth:
26.8K
Growth Rate:
100.00%
Total runs:
26.6K
Run Growth:
11.4K
Growth Rate:
43.00%
Total runs:
26.1K
Run Growth:
2.1K
Growth Rate:
8.10%
Total runs:
25.7K
Run Growth:
7.7K
Growth Rate:
29.79%
Total runs:
25.7K
Run Growth:
113
Growth Rate:
0.44%
Total runs:
25.6K
Run Growth:
20.2K
Growth Rate:
78.72%
Total runs:
24.6K
Run Growth:
606
Growth Rate:
2.47%
Total runs:
24.5K
Run Growth:
134
Growth Rate:
0.55%
Total runs:
24.5K
Run Growth:
258
Growth Rate:
1.05%
Total runs:
24.5K
Run Growth:
24.5K
Growth Rate:
100.00%
Total runs:
24.1K
Run Growth:
401
Growth Rate:
1.66%
Total runs:
24.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23.8K
Run Growth:
272
Growth Rate:
1.14%
Total runs:
23.5K
Run Growth:
2.6K
Growth Rate:
11.60%
Total runs:
23.4K
Run Growth:
17.0K
Growth Rate:
72.68%
Total runs:
23.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
22.9K
Run Growth:
95
Growth Rate:
0.41%
Total runs:
22.7K
Run Growth:
20.5K
Growth Rate:
90.28%
Total runs:
22.5K
Run Growth:
3.9K
Growth Rate:
17.33%
Total runs:
22.3K
Run Growth:
3.4K
Growth Rate:
15.03%
Total runs:
22.3K
Run Growth:
277
Growth Rate:
1.24%
Total runs:
22.3K
Run Growth:
7.3K
Growth Rate:
32.71%
Total runs:
22.3K
Run Growth:
19.3K
Growth Rate:
86.84%
Total runs:
22.0K
Run Growth:
2.1K
Growth Rate:
9.43%
Total runs:
22.0K
Run Growth:
21.6K
Growth Rate:
98.11%
Total runs:
21.9K
Run Growth:
1.6K
Growth Rate:
7.54%
Total runs:
21.8K
Run Growth:
15.6K
Growth Rate:
74.24%
Total runs:
21.8K
Run Growth:
6.7K
Growth Rate:
30.83%
Total runs:
21.8K
Run Growth:
297
Growth Rate:
1.36%
Total runs:
21.7K
Run Growth:
12.5K
Growth Rate:
59.58%
Total runs:
21.6K
Run Growth:
18.9K
Growth Rate:
87.53%
Total runs:
21.1K
Run Growth:
4.2K
Growth Rate:
19.78%
Total runs:
20.8K
Run Growth:
20.8K
Growth Rate:
99.98%
Total runs:
20.7K
Run Growth:
15.3K
Growth Rate:
74.00%
Total runs:
20.6K
Run Growth:
20.6K
Growth Rate:
100.00%
Total runs:
20.6K
Run Growth:
13.7K
Growth Rate:
67.56%
Total runs:
20.5K
Run Growth:
100
Growth Rate:
0.49%
Total runs:
19.6K
Run Growth:
-12.1K
Growth Rate:
-61.83%
Total runs:
19.5K
Run Growth:
18.0K
Growth Rate:
91.51%
Total runs:
19.4K
Run Growth:
16.2K
Growth Rate:
82.90%
Total runs:
19.3K
Run Growth:
10.6K
Growth Rate:
52.28%
Total runs:
19.0K
Run Growth:
14.2K
Growth Rate:
74.92%
Total runs:
18.9K
Run Growth:
10.2K
Growth Rate:
53.80%
Total runs:
18.7K
Run Growth:
6.7K
Growth Rate:
35.85%
Total runs:
18.5K
Run Growth:
130
Growth Rate:
0.70%