Sponsored by
YouArt
calcuis / olmo-7b-0724-instruct-gguf
Model's Last Updated: October 23 2024
text2text-generation
Introduction of olmo-7b-0724-instruct-gguf
Model Details of olmo-7b-0724-instruct-gguf
GGUF quantized version of OLMo-7B-0724-Instruct Model
project original source
Q_2_K (not nice)
Q_3_K_M (acceptable)
Q_4_K_M is recommanded (good for running with CPU as well)
Q_5_K_M (good in general)
Q_6_K is good also; if you want a better result; take this one instead of Q_5_K_M
Q_8_0 which is very good; need a reasonable size of RAM otherwise you might expect a long wait
f16 is similar to the original hf model; opt this or hf also fine; make sure you have a good machine
how to run it
use any connector for interacting with gguf; i.e., gguf-connector
Runs of calcuis olmo-7b-0724-instruct-gguf on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About olmo-7b-0724-instruct-gguf huggingface.co Model
Url of olmo-7b-0724-instruct-gguf
olmo-7b-0724-instruct-gguf huggingface.co Url
Provider of olmo-7b-0724-instruct-gguf huggingface.co
Other API from calcuis
Total runs:
13.9K
Run Growth:
-2.8K
Growth Rate:
-19.86%
Total runs:
10.9K
Run Growth:
-1.9K
Growth Rate:
-17.36%
Total runs:
9.8K
Run Growth:
9.9K
Growth Rate:
69.49%
Total runs:
6.7K
Run Growth:
-1.6K
Growth Rate:
-23.44%
Total runs:
5.7K
Run Growth:
3.5K
Growth Rate:
60.66%
Total runs:
4.6K
Run Growth:
-3.0K
Growth Rate:
-65.69%
Total runs:
4.4K
Run Growth:
4.0K
Growth Rate:
90.07%
Total runs:
3.0K
Run Growth:
-4.8K
Growth Rate:
-158.65%
Total runs:
2.9K
Run Growth:
2.9K
Growth Rate:
100.00%
Total runs:
2.5K
Run Growth:
-2.0K
Growth Rate:
-79.24%
Total runs:
2.0K
Run Growth:
226
Growth Rate:
11.38%
Total runs:
1.7K
Run Growth:
975
Growth Rate:
58.42%
Total runs:
268
Run Growth:
-29
Growth Rate:
-10.82%