Sponsored by
APIMart
calcuis / olmo-gguf
Model's Last Updated: October 24 2024
text-generation
Introduction of olmo-gguf
Model Details of olmo-gguf
GGUF quantized version of OLMo-7B-0724-Instruct Model
project original source: base model
Q_2_K (not nice)
Q_3_K_S (acceptable)
Q_3_K_M is acceptable (good for running with CPU)
Q_3_K_L (acceptable)
Q_4_K_S (okay)
Q_4_K_M is recommanded (balance)
Q_5_K_S (good)
Q_5_K_M (good in general)
Q_6_K is good also; if you want a better result; take this one instead of Q_5_K_M
Q_8_0 which is very good; need a reasonable size of RAM otherwise you might expect a long wait
f16 is similar to the original hf model; opt this one or hf also fine; make sure you have a good machine
how to run it
use any connector for interacting with gguf; i.e., gguf-connector
this picture is from the base model
Runs of calcuis olmo-gguf on huggingface.co
247
Total runs
-1
24-hour runs
14
3-day runs
35
7-day runs
173
30-day runs
More Information About olmo-gguf huggingface.co Model
Url of olmo-gguf
olmo-gguf huggingface.co Url
Provider of olmo-gguf huggingface.co
Other API from calcuis
Total runs:
14.3K
Run Growth:
9.9K
Growth Rate:
69.49%
Total runs:
13.9K
Run Growth:
-2.8K
Growth Rate:
-19.86%
Total runs:
10.9K
Run Growth:
-1.9K
Growth Rate:
-17.36%
Total runs:
6.7K
Run Growth:
-1.6K
Growth Rate:
-23.44%
Total runs:
5.7K
Run Growth:
3.5K
Growth Rate:
60.66%
Total runs:
4.6K
Run Growth:
-3.0K
Growth Rate:
-65.69%
Total runs:
4.4K
Run Growth:
4.0K
Growth Rate:
90.07%
Total runs:
3.0K
Run Growth:
-4.8K
Growth Rate:
-158.65%
Total runs:
2.9K
Run Growth:
2.9K
Growth Rate:
100.00%
Total runs:
2.5K
Run Growth:
-2.0K
Growth Rate:
-79.24%
Total runs:
2.0K
Run Growth:
226
Growth Rate:
11.38%
Total runs:
1.7K
Run Growth:
975
Growth Rate:
58.42%
Total runs:
268
Run Growth:
-29
Growth Rate:
-10.82%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%