Total runs:
149.3K
Run Growth:
-13.8K
Growth Rate:
-9.22%
Sponsored by
APIMart
prithivMLmods / Olmo-3-7B-Instruct-AIO-GGUF
Model's Last Updated: November 22 2025
text-generation
Introduction of Olmo-3-7B-Instruct-AIO-GGUF
Model Details of Olmo-3-7B-Instruct-AIO-GGUF
Olmo-3-7B-Instruct-AIO-GGUF
Olmo-3-7B-Instruct is a 7-billion-parameter transformer-based autoregressive language model from the Allen Institute for AI, fine-tuned with supervised fine-tuning (SFT) and direct preference optimization (DPO) on datasets like Tulu 2 and UltraFeedback for enhanced question answering and instruction following. It supports a context length of 2048 tokens and excels in generating high-quality, context-aware, and safe text responses across various NLP tasks including multi-turn chat, tool use, and detailed instructions. Designed as a research model, it aims to advance understanding of language models with transparency on training and safety considerations, balancing efficient inference with strong performance, making it suitable for applications requiring precise adherence to instructions in domains like technical, educational, and legal fields. The model and its training code are openly available under the Apache 2.0 license.
Olmo-3-7B-Instruct [GGUF]
| File Name | Quant Type | File Size | File Link |
|---|---|---|---|
| Olmo-3-7B-Instruct.BF16.gguf | BF16 | 14.6 GB | Download |
| Olmo-3-7B-Instruct.F16.gguf | F16 | 14.6 GB | Download |
| Olmo-3-7B-Instruct.F32.gguf | F32 | 29.2 GB | Download |
| Olmo-3-7B-Instruct.IQ4_XS.gguf | IQ4_XS | 4.03 GB | Download |
| Olmo-3-7B-Instruct.Q2_K.gguf | Q2_K | 2.86 GB | Download |
| Olmo-3-7B-Instruct.Q3_K_L.gguf | Q3_K_L | 3.95 GB | Download |
| Olmo-3-7B-Instruct.Q3_K_M.gguf | Q3_K_M | 3.65 GB | Download |
| Olmo-3-7B-Instruct.Q3_K_S.gguf | Q3_K_S | 3.3 GB | Download |
| Olmo-3-7B-Instruct.Q4_K_M.gguf | Q4_K_M | 4.47 GB | Download |
| Olmo-3-7B-Instruct.Q4_K_S.gguf | Q4_K_S | 4.25 GB | Download |
| Olmo-3-7B-Instruct.Q5_K_M.gguf | Q5_K_M | 5.21 GB | Download |
| Olmo-3-7B-Instruct.Q5_K_S.gguf | Q5_K_S | 5.08 GB | Download |
| Olmo-3-7B-Instruct.Q6_K.gguf | Q6_K | 5.99 GB | Download |
| Olmo-3-7B-Instruct.Q8_0.gguf | Q8_0 | 7.76 GB | Download |
| Olmo-3-7B-Instruct.i1-IQ1_M.gguf | i1-IQ1_M | 1.94 GB | Download |
| Olmo-3-7B-Instruct.i1-IQ1_S.gguf | i1-IQ1_S | 1.82 GB | Download |
| Olmo-3-7B-Instruct.i1-IQ2_M.gguf | i1-IQ2_M | 2.68 GB | Download |
| Olmo-3-7B-Instruct.i1-IQ2_S.gguf | i1-IQ2_S | 2.51 GB | Download |
| Olmo-3-7B-Instruct.i1-IQ2_XS.gguf | i1-IQ2_XS | 2.32 GB | Download |
| Olmo-3-7B-Instruct.i1-IQ2_XXS.gguf | i1-IQ2_XXS | 2.14 GB | Download |
| Olmo-3-7B-Instruct.i1-IQ3_M.gguf | i1-IQ3_M | 3.47 GB | Download |
| Olmo-3-7B-Instruct.i1-IQ3_S.gguf | i1-IQ3_S | 3.3 GB | Download |
| Olmo-3-7B-Instruct.i1-IQ3_XS.gguf | i1-IQ3_XS | 3.15 GB | Download |
| Olmo-3-7B-Instruct.i1-IQ3_XXS.gguf | i1-IQ3_XXS | 2.9 GB | Download |
| Olmo-3-7B-Instruct.i1-IQ4_NL.gguf | i1-IQ4_NL | 4.22 GB | Download |
| Olmo-3-7B-Instruct.i1-IQ4_XS.gguf | i1-IQ4_XS | 4 GB | Download |
| Olmo-3-7B-Instruct.i1-Q2_K.gguf | i1-Q2_K | 2.86 GB | Download |
| Olmo-3-7B-Instruct.i1-Q2_K_S.gguf | i1-Q2_K_S | 2.64 GB | Download |
| Olmo-3-7B-Instruct.i1-Q3_K_L.gguf | i1-Q3_K_L | 3.95 GB | Download |
| Olmo-3-7B-Instruct.i1-Q3_K_M.gguf | i1-Q3_K_M | 3.65 GB | Download |
| Olmo-3-7B-Instruct.i1-Q3_K_S.gguf | i1-Q3_K_S | 3.3 GB | Download |
| Olmo-3-7B-Instruct.i1-Q4_0.gguf | i1-Q4_0 | 4.23 GB | Download |
| Olmo-3-7B-Instruct.i1-Q4_1.gguf | i1-Q4_1 | 4.65 GB | Download |
| Olmo-3-7B-Instruct.i1-Q4_K_M.gguf | i1-Q4_K_M | 4.47 GB | Download |
| Olmo-3-7B-Instruct.i1-Q4_K_S.gguf | i1-Q4_K_S | 4.25 GB | Download |
| Olmo-3-7B-Instruct.i1-Q5_K_M.gguf | i1-Q5_K_M | 5.21 GB | Download |
| Olmo-3-7B-Instruct.i1-Q5_K_S.gguf | i1-Q5_K_S | 5.08 GB | Download |
| Olmo-3-7B-Instruct.i1-Q6_K.gguf | i1-Q6_K | 5.99 GB | Download |
| Olmo-3-7B-Instruct.imatrix.gguf | imatrix | 4.59 MB | Download |
Quants Usage
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
Runs of prithivMLmods Olmo-3-7B-Instruct-AIO-GGUF on huggingface.co
1.4K
Total runs
167
24-hour runs
176
3-day runs
237
7-day runs
774
30-day runs
More Information About Olmo-3-7B-Instruct-AIO-GGUF huggingface.co Model
Url of Olmo-3-7B-Instruct-AIO-GGUF
Olmo-3-7B-Instruct-AIO-GGUF huggingface.co Url
Provider of Olmo-3-7B-Instruct-AIO-GGUF huggingface.co
Other API from prithivMLmods
Updated:November 12 2025
Total runs:
121.4K
Run Growth:
6.6K
Growth Rate:
5.46%
Total runs:
97.5K
Run Growth:
41.6K
Growth Rate:
42.66%
Total runs:
92.0K
Run Growth:
-290
Growth Rate:
-0.32%
Total runs:
44.6K
Run Growth:
42.6K
Growth Rate:
100.00%
Total runs:
37.5K
Run Growth:
94
Growth Rate:
0.25%
Total runs:
29.7K
Run Growth:
-11.4K
Growth Rate:
-38.25%
Total runs:
26.3K
Run Growth:
3.5K
Growth Rate:
13.18%
Total runs:
25.8K
Run Growth:
21.6K
Growth Rate:
83.56%
Total runs:
23.2K
Run Growth:
-5.2K
Growth Rate:
-22.57%
Total runs:
19.6K
Run Growth:
-39.1K
Growth Rate:
-135.66%
Total runs:
19.2K
Run Growth:
11.9K
Growth Rate:
62.33%
Total runs:
18.4K
Run Growth:
67
Growth Rate:
0.37%
Total runs:
17.4K
Run Growth:
7.0K
Growth Rate:
40.79%
Total runs:
16.0K
Run Growth:
10.4K
Growth Rate:
64.64%
Total runs:
15.5K
Run Growth:
15.5K
Growth Rate:
99.80%
Total runs:
15.1K
Run Growth:
-1.3K
Growth Rate:
-8.59%
Total runs:
13.3K
Run Growth:
2.8K
Growth Rate:
20.84%
Total runs:
12.9K
Run Growth:
12.5K
Growth Rate:
96.52%
Total runs:
11.3K
Run Growth:
-1.5K
Growth Rate:
-13.59%
Total runs:
10.9K
Run Growth:
10.9K
Growth Rate:
100.00%
Total runs:
10.7K
Run Growth:
1.5K
Growth Rate:
13.81%
Total runs:
9.8K
Run Growth:
6.9K
Growth Rate:
70.15%
Total runs:
9.6K
Run Growth:
-297
Growth Rate:
-3.06%
Total runs:
9.3K
Run Growth:
9.3K
Growth Rate:
100.00%
Total runs:
9.3K
Run Growth:
3.0K
Growth Rate:
32.25%
Total runs:
8.8K
Run Growth:
8.5K
Growth Rate:
99.21%
Total runs:
8.8K
Run Growth:
-1.2K
Growth Rate:
-13.78%
Total runs:
8.7K
Run Growth:
7.8K
Growth Rate:
89.26%
Total runs:
8.7K
Run Growth:
2.5K
Growth Rate:
27.93%
Total runs:
8.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8.3K
Run Growth:
-1.5K
Growth Rate:
-18.71%
Total runs:
8.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8.2K
Run Growth:
43
Growth Rate:
0.52%
Total runs:
7.6K
Run Growth:
-1.5K
Growth Rate:
-19.49%
Total runs:
7.6K
Run Growth:
7.6K
Growth Rate:
100.00%
Total runs:
6.7K
Run Growth:
549
Growth Rate:
8.24%
Total runs:
6.2K
Run Growth:
1.1K
Growth Rate:
17.63%
Total runs:
6.1K
Run Growth:
6.0K
Growth Rate:
97.93%
Total runs:
5.9K
Run Growth:
-2.3K
Growth Rate:
-38.36%
Total runs:
5.8K
Run Growth:
3.2K
Growth Rate:
52.81%
Total runs:
5.8K
Run Growth:
2.6K
Growth Rate:
45.51%
Total runs:
4.9K
Run Growth:
4.9K
Growth Rate:
100.00%
Total runs:
4.9K
Run Growth:
1.2K
Growth Rate:
25.62%
Total runs:
4.8K
Run Growth:
1.6K
Growth Rate:
34.01%
Total runs:
4.7K
Run Growth:
690
Growth Rate:
14.64%
Total runs:
4.6K
Run Growth:
2.1K
Growth Rate:
45.20%
Total runs:
4.5K
Run Growth:
-28
Growth Rate:
-0.62%
Total runs:
4.5K
Run Growth:
3.7K
Growth Rate:
81.77%
Total runs:
4.5K
Run Growth:
498
Growth Rate:
11.47%
Total runs:
4.3K
Run Growth:
4.3K
Growth Rate:
100.00%
Total runs:
4.3K
Run Growth:
4.3K
Growth Rate:
100.00%
Total runs:
4.3K
Run Growth:
4.1K
Growth Rate:
95.26%
Total runs:
4.2K
Run Growth:
-386
Growth Rate:
-9.20%
Total runs:
3.8K
Run Growth:
36
Growth Rate:
0.93%
Total runs:
3.8K
Run Growth:
1.1K
Growth Rate:
28.79%
Total runs:
3.6K
Run Growth:
2.6K
Growth Rate:
87.79%
Total runs:
3.5K
Run Growth:
3.5K
Growth Rate:
100.00%
Total runs:
3.5K
Run Growth:
-654
Growth Rate:
-18.71%
Total runs:
3.5K
Run Growth:
2.0K
Growth Rate:
58.53%
Total runs:
3.4K
Run Growth:
-5.9K
Growth Rate:
-174.37%
Total runs:
3.4K
Run Growth:
594
Growth Rate:
17.57%
Total runs:
3.4K
Run Growth:
3.0K
Growth Rate:
90.99%
Total runs:
3.3K
Run Growth:
3.3K
Growth Rate:
99.88%
Total runs:
3.2K
Run Growth:
639
Growth Rate:
20.11%
Total runs:
3.2K
Run Growth:
2.9K
Growth Rate:
100.00%
Total runs:
3.1K
Run Growth:
1.8K
Growth Rate:
57.12%
Total runs:
3.1K
Run Growth:
-1.7K
Growth Rate:
-53.29%
Total runs:
3.1K
Run Growth:
2.1K
Growth Rate:
66.50%
Total runs:
3.1K
Run Growth:
284
Growth Rate:
9.46%
Total runs:
3.0K
Run Growth:
-335
Growth Rate:
-11.08%
Total runs:
3.0K
Run Growth:
98
Growth Rate:
3.27%
Total runs:
3.0K
Run Growth:
2.3K
Growth Rate:
77.32%
Total runs:
3.0K
Run Growth:
2.9K
Growth Rate:
98.29%
Total runs:
3.0K
Run Growth:
576
Growth Rate:
19.26%
Total runs:
3.0K
Run Growth:
3.0K
Growth Rate:
100.00%
Total runs:
3.0K
Run Growth:
-588
Growth Rate:
-19.90%
Total runs:
2.9K
Run Growth:
-131
Growth Rate:
-4.51%
Total runs:
2.8K
Run Growth:
1.6K
Growth Rate:
57.42%
Total runs:
2.8K
Run Growth:
593
Growth Rate:
21.16%
Total runs:
2.8K
Run Growth:
2.5K
Growth Rate:
88.17%
Total runs:
2.8K
Run Growth:
-852
Growth Rate:
-32.90%
Total runs:
2.8K
Run Growth:
2.8K
Growth Rate:
100.00%
Total runs:
2.8K
Run Growth:
2.4K
Growth Rate:
87.06%
Total runs:
2.7K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.7K
Run Growth:
2.7K
Growth Rate:
99.14%
Total runs:
2.7K
Run Growth:
2.7K
Growth Rate:
99.70%
Total runs:
2.6K
Run Growth:
2.6K
Growth Rate:
98.86%
Total runs:
2.5K
Run Growth:
546
Growth Rate:
22.10%
Total runs:
2.5K
Run Growth:
2.5K
Growth Rate:
100.00%
Total runs:
2.4K
Run Growth:
1.2K
Growth Rate:
50.47%
Total runs:
2.4K
Run Growth:
1.5K
Growth Rate:
61.38%
Total runs:
2.4K
Run Growth:
-513
Growth Rate:
-21.25%
Total runs:
2.4K
Run Growth:
1.7K
Growth Rate:
72.18%
Total runs:
2.3K
Run Growth:
1.8K
Growth Rate:
84.74%
Total runs:
2.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.3K
Run Growth:
-220
Growth Rate:
-9.76%
Total runs:
2.3K
Run Growth:
177
Growth Rate:
7.69%
Total runs:
2.3K
Run Growth:
2.3K
Growth Rate:
99.12%
Total runs:
2.3K
Run Growth:
2.3K
Growth Rate:
100.00%