Total runs:
204.5K
Run Growth:
-137.4K
Growth Rate:
-67.21%
Sponsored by
APIMaster
hfl / chinese-mixtral-instruct-gguf
Model's Last Updated: March 27 2024
Introduction of chinese-mixtral-instruct-gguf
Model Details of chinese-mixtral-instruct-gguf
Chinese-Mixtral-Instruct-GGUF
Chinese Mixtral GitHub repository: https://github.com/ymcui/Chinese-Mixtral
This repository contains the GGUF-v3 models (llama.cpp compatible) for Chinese-Mixtral-Instruct (chat/instruction model).
Note: When using instruction/chat model, you MUST follow the official prompt template! Example: chat.sh
Performance
Metric: PPL, lower is better
| Quant | Size ↓ | PPL |
|---|---|---|
| IQ1_S | 9.8 GB | 9.5782 +/- 0.08909 |
| IQ1_M | 10.8 GB | 7.4666 +/- 0.06741 |
| IQ2_XXS | 12.3 GB | 6.3923 +/- 0.05674 |
| IQ2_XS | 13.7 GB | 6.0606 +/- 0.05834 |
| IQ2_S | 14.1 GB | 4.7617 +/- 0.04177 |
| IQ2_M | 15.5 GB | 4.5911 +/- 0.04054 |
| Q2_K | 17.3 GB | 4.8592 +/- 0.04303 |
| IQ3_XXS | 18.3 GB | 4.3557 +/- 0.03846 |
| IQ3_XS | 19.3 GB | 4.3328 +/- 0.03779 |
| IQ3_S | 20.4 GB | 4.3138 +/- 0.03785 |
| IQ3_M | 21.4 GB | 4.3024 +/- 0.03775 |
| Q3_K | 22.5 GB | 4.4334 +/- 0.03937 |
| IQ4_XS | 25.1 GB | 4.2324 +/- 0.03757 |
| Q4_0 | 26.4 GB | 4.2688 +/- 0.03787 |
| IQ4_NL | 26.5 GB | 4.2384 +/- 0.03763 |
| Q4_K | 28.4 GB | 4.2433 +/- 0.03768 |
| Q5_0 | 32.2 GB | 4.2142 +/- 0.03733 |
| Q5_K | 33.2 GB | 4.2177 +/- 0.03743 |
| Q6_K | 38.4 GB | 4.2184 +/- 0.03754 |
| Q8_0 | 49.6 GB | 4.2053 +/- 0.03732 |
| F16 | 93.5 GB | x |
Due to the file size limitation, for F16 model, please use
cat
command to concatenate all parts into a single file.
You must concatenate these parts in order.
Others
For Hugging Face version, please see: https://huggingface.co/hfl/chinese-mixtral-instruct
Please refer to https://github.com/ymcui/Chinese-Mixtral/ for more details.
Citation
Please consider cite our paper if you use the resource of this repository. Paper link: https://arxiv.org/abs/2403.01851
@article{chinese-mixtral,
title={Rethinking LLM Language Adaptation: A Case Study on Chinese Mixtral},
author={Cui, Yiming and Yao, Xin},
journal={arXiv preprint arXiv:2403.01851},
url={https://arxiv.org/abs/2403.01851},
year={2024}
}
Runs of hfl chinese-mixtral-instruct-gguf on huggingface.co
791
Total runs
0
24-hour runs
-21
3-day runs
-13
7-day runs
378
30-day runs
More Information About chinese-mixtral-instruct-gguf huggingface.co Model
Url of chinese-mixtral-instruct-gguf
chinese-mixtral-instruct-gguf huggingface.co Url
Provider of chinese-mixtral-instruct-gguf huggingface.co
Other API from hfl
Updated:May 20 2021
Total runs:
53.8K
Run Growth:
-3.7K
Growth Rate:
-6.88%
Total runs:
25.2K
Run Growth:
-52.3K
Growth Rate:
-207.94%
Total runs:
14.4K
Run Growth:
3.2K
Growth Rate:
22.23%
Total runs:
9.0K
Run Growth:
515
Growth Rate:
5.71%
Total runs:
8.8K
Run Growth:
384
Growth Rate:
4.34%
Total runs:
8.8K
Run Growth:
285
Growth Rate:
3.24%
Total runs:
8.8K
Run Growth:
305
Growth Rate:
3.48%
Total runs:
8.7K
Run Growth:
322
Growth Rate:
3.68%
Total runs:
8.6K
Run Growth:
212
Growth Rate:
2.45%
Total runs:
8.6K
Run Growth:
183
Growth Rate:
2.13%
Total runs:
8.6K
Run Growth:
126
Growth Rate:
1.47%
Total runs:
6.7K
Run Growth:
550
Growth Rate:
8.18%
Total runs:
2.8K
Run Growth:
2.3K
Growth Rate:
84.58%
Total runs:
1.2K
Run Growth:
346
Growth Rate:
28.57%
Total runs:
1.1K
Run Growth:
519
Growth Rate:
46.01%
Total runs:
991
Run Growth:
-779
Growth Rate:
-78.61%
Total runs:
952
Run Growth:
230
Growth Rate:
24.16%
Total runs:
937
Run Growth:
484
Growth Rate:
51.65%
Total runs:
816
Run Growth:
228
Growth Rate:
27.94%
Total runs:
786
Run Growth:
136
Growth Rate:
17.30%
Total runs:
779
Run Growth:
534
Growth Rate:
68.55%
Total runs:
729
Run Growth:
162
Growth Rate:
22.22%
Total runs:
726
Run Growth:
-6.5K
Growth Rate:
-897.93%
Total runs:
680
Run Growth:
-164
Growth Rate:
-24.12%
Total runs:
677
Run Growth:
462
Growth Rate:
68.24%
Total runs:
628
Run Growth:
524
Growth Rate:
83.44%
Total runs:
626
Run Growth:
92
Growth Rate:
14.70%
Total runs:
617
Run Growth:
117
Growth Rate:
18.96%
Total runs:
606
Run Growth:
165
Growth Rate:
27.23%
Total runs:
578
Run Growth:
151
Growth Rate:
26.12%
Total runs:
507
Run Growth:
-395
Growth Rate:
-77.91%
Total runs:
481
Run Growth:
157
Growth Rate:
32.64%
Total runs:
470
Run Growth:
146
Growth Rate:
31.06%
Total runs:
457
Run Growth:
60
Growth Rate:
13.13%
Total runs:
377
Run Growth:
-83
Growth Rate:
-22.02%
Total runs:
367
Run Growth:
40
Growth Rate:
10.90%
Total runs:
354
Run Growth:
-1.7K
Growth Rate:
-469.21%
Total runs:
331
Run Growth:
-216
Growth Rate:
-65.26%
Total runs:
330
Run Growth:
-59
Growth Rate:
-17.88%
Total runs:
232
Run Growth:
4
Growth Rate:
1.72%
Total runs:
185
Run Growth:
129
Growth Rate:
69.73%
Total runs:
183
Run Growth:
-81
Growth Rate:
-44.26%
Total runs:
170
Run Growth:
121
Growth Rate:
71.18%
Total runs:
112
Run Growth:
84
Growth Rate:
75.00%
Total runs:
110
Run Growth:
88
Growth Rate:
79.28%
Total runs:
82
Run Growth:
19
Growth Rate:
23.17%
Total runs:
76
Run Growth:
50
Growth Rate:
65.79%
Total runs:
59
Run Growth:
40
Growth Rate:
66.67%
Total runs:
51
Run Growth:
26
Growth Rate:
50.00%
Total runs:
51
Run Growth:
35
Growth Rate:
70.00%
Total runs:
49
Run Growth:
31
Growth Rate:
62.00%
Total runs:
47
Run Growth:
27
Growth Rate:
58.70%
Total runs:
47
Run Growth:
27
Growth Rate:
56.25%
Total runs:
43
Run Growth:
29
Growth Rate:
67.44%
Total runs:
40
Run Growth:
20
Growth Rate:
50.00%
Total runs:
37
Run Growth:
13
Growth Rate:
35.14%
Total runs:
37
Run Growth:
23
Growth Rate:
60.53%
Total runs:
36
Run Growth:
16
Growth Rate:
44.44%
Total runs:
33
Run Growth:
19
Growth Rate:
55.88%
Total runs:
31
Run Growth:
13
Growth Rate:
41.94%
Total runs:
25
Run Growth:
13
Growth Rate:
52.00%
Total runs:
25
Run Growth:
14
Growth Rate:
56.00%
Total runs:
21
Run Growth:
6
Growth Rate:
28.57%
Total runs:
20
Run Growth:
6
Growth Rate:
30.00%
Total runs:
19
Run Growth:
11
Growth Rate:
57.89%
Total runs:
18
Run Growth:
9
Growth Rate:
50.00%
Total runs:
17
Run Growth:
5
Growth Rate:
29.41%
Total runs:
16
Run Growth:
3
Growth Rate:
18.75%
Total runs:
16
Run Growth:
10
Growth Rate:
62.50%
Total runs:
14
Run Growth:
7
Growth Rate:
50.00%
Total runs:
13
Run Growth:
5
Growth Rate:
38.46%