Sponsored by
APIMart
calcuis / openmath2-gguf
Model's Last Updated: October 25 2024
text-generation
Introduction of openmath2-gguf
Model Details of openmath2-gguf
GGUF quantized version of OpenMath2-Llama3.1-8B
project original source (finetuned model)
Q_2_K (not nice)
Q_3_K_S (acceptable)
Q_3_K_M is acceptable (good for running with CPU)
Q_3_K_L (acceptable)
Q_4_K_S (okay)
Q_4_K_M is recommanded (balance)
Q_5_K_S (good)
Q_5_K_M (good in general)
Q_6_K is good also; if you want a better result; take this one instead of Q_5_K_M
Q_8_0 which is very good; need a reasonable size of RAM otherwise you might expect a long wait
f16 is similar to the original hf model; opt this one or hf also fine; make sure you have a good machine
how to run it
use any connector for interacting with gguf; i.e., gguf-connector
the chart and figure above are from finetuned model (nvidia side); those are used for comparing between the finetuned model and the base model; and the base model is from meta
Runs of calcuis openmath2-gguf on huggingface.co
211
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About openmath2-gguf huggingface.co Model
Url of openmath2-gguf
openmath2-gguf huggingface.co Url
Provider of openmath2-gguf huggingface.co
Other API from calcuis
Total runs:
16.2K
Run Growth:
-8.7K
Growth Rate:
-54.58%
Total runs:
9.4K
Run Growth:
714
Growth Rate:
7.56%
Total runs:
8.1K
Run Growth:
-6.4K
Growth Rate:
-80.60%
Total runs:
7.1K
Run Growth:
3.7K
Growth Rate:
52.20%
Total runs:
4.4K
Run Growth:
1.7K
Growth Rate:
37.85%
Total runs:
4.4K
Run Growth:
4.0K
Growth Rate:
90.07%
Total runs:
3.0K
Run Growth:
-5.1K
Growth Rate:
-172.53%
Total runs:
2.9K
Run Growth:
2.9K
Growth Rate:
100.00%
Total runs:
2.0K
Run Growth:
226
Growth Rate:
11.38%
Total runs:
891
Run Growth:
-715
Growth Rate:
-78.06%
Total runs:
659
Run Growth:
397
Growth Rate:
61.36%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%