Sponsored by
APIMart
calcuis / olmo-7b-gguf
Model's Last Updated: October 24 2024
text2text-generation
Introduction of olmo-7b-gguf
Model Details of olmo-7b-gguf
GGUF quantized version of OLMo-7B-0724-Instruct Model
project original source: base model
Q_2_K (not nice)
Q_3_K_S (acceptable)
Q_3_K_M is acceptable (good for running with CPU)
Q_3_K_L (acceptable)
Q_4_K_S (okay)
Q_4_K_M is recommanded (balance)
Q_5_K_S (good)
Q_5_K_M (good in general)
Q_6_K is good also; if you want a better result; take this one instead of Q_5_K_M
Q_8_0 which is very good; need a reasonable size of RAM otherwise you might expect a long wait
f16 is similar to the original hf model; opt this one or hf also fine; make sure you have a good machine
how to run it
use any connector for interacting with gguf; i.e., gguf-connector
this picture is from the base model
Runs of calcuis olmo-7b-gguf on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About olmo-7b-gguf huggingface.co Model
Url of olmo-7b-gguf
olmo-7b-gguf huggingface.co Url
Provider of olmo-7b-gguf huggingface.co
Other API from calcuis
Total runs:
15.8K
Run Growth:
-7.6K
Growth Rate:
-47.33%
Total runs:
10.6K
Run Growth:
-670
Growth Rate:
-6.34%
Total runs:
9.0K
Run Growth:
557
Growth Rate:
6.17%
Total runs:
7.9K
Run Growth:
-6.9K
Growth Rate:
-85.57%
Total runs:
7.3K
Run Growth:
2.7K
Growth Rate:
37.23%
Total runs:
4.5K
Run Growth:
1.3K
Growth Rate:
28.43%
Total runs:
4.4K
Run Growth:
4.0K
Growth Rate:
90.07%
Total runs:
2.9K
Run Growth:
2.9K
Growth Rate:
100.00%
Total runs:
2.9K
Run Growth:
-87
Growth Rate:
-2.99%
Total runs:
2.0K
Run Growth:
226
Growth Rate:
11.38%
Total runs:
930
Run Growth:
-746
Growth Rate:
-80.22%
Total runs:
660
Run Growth:
347
Growth Rate:
52.58%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%