Sponsored by
APIMart
tencent / Hunyuan-7B-Instruct-0124
Model's Last Updated: July 30 2025
text-generation
Introduction of Hunyuan-7B-Instruct-0124
Model Details of Hunyuan-7B-Instruct-0124
Model Introduction
The 7B models released by Hunyuan this time: Hunyuan-7B-Pretrain-0124 and Hunyuan-7B-Instruct-0124 , use better data allocation and training, have strong performance, and have achieved a good balance between computing and performance. It stands out from many large-scale language models and is currently one of the strongest Chinese 7B Dense models.
Introduction to Technical Advantages
Model
- Extended long text capability to 256K and utilizes Grouped Query Attention (GQA)
Inference Framework
- This open-source release offers two inference backend options tailored for the Hunyuan-7B model: the popular vLLM-backend and the TensorRT-LLM Backend. In this release, we are initially open-sourcing the vLLM solution, with plans to release the TRT-LLM solution in the near future.
Training Framework
- The Hunyuan-7B open-source model is fully compatible with the Hugging Face format, enabling researchers and developers to perform model fine-tuning using the hf-deepspeed framework. Learn more : Tencent-Hunyuan-Large 。
Related News
-
2025.1.24 We have open-sourced
Hunyuan-7B-Pretrain-0124
,
Hunyuan-7B-Instruct-0124
on Hugging Face.
Benchmark
Note: The following benchmarks are evaluated by TRT-LLM-backend
Hunyuan-7B-Pretrain
| Qwen2.5-7B | Llama3-8B | OLMO2-7B | HunYuan-7B-V2 | |
|---|---|---|---|---|
| MMLU | 74.26 | 66.95 | 63.7 | 75.37 |
| MMLU-Pro | 46.17 | 34.04 | 31 | 47.54 |
| MMLU-CF | 61.01 | 55.21 | 52.94 | 59.62 |
| MMLU-Redux | 73.47 | 66.44 | 63.74 | 74.54 |
| BBH | 70.4 | 62.16 | 38.01 | 70.77 |
| HellaSwag | 75.82 | 78.24 | 61.97 | 80.77 |
| WinoGrande | 69.69 | 73.64 | 74.43 | 71.51 |
| PIQA | 79.33 | 80.52 | 80.63 | 81.45 |
| SIQA | 77.48 | 61.05 | 65.2 | 79.73 |
| NaturalQuestions | 31.77 | 35.43 | 36.9 | 33.52 |
| DROP | 68.2 | 60.13 | 60.8 | 68.63 |
| ARC-C | 91.64 | 77.59 | 74.92 | 91.97 |
| TriviaQA | 69.31 | 78.61 | 78 | 74.31 |
| Chinese-SimpleQA | 30.37 | 19.4 | 7.35 | 30.51 |
| SimpleQA | 4.98 | 7.68 | 4.51 | 3.73 |
| CMMLU | 81.39 | 50.25 | 38.79 | 82.19 |
| C-Eval | 81.11 | 50.4 | 38.53 | 82.12 |
| C3 | 71.77 | 61.5 | 54 | 79.07 |
| GSM8K | 82.71 | 57.54 | 67.5 | 93.33 |
| MATH | 49.6 | 18.45 | 19 | 62.15 |
| CMATH | 84.33 | 52.83 | 44 | 88.5 |
| HumanEval | 57.93 | 35.98 | 15.24 | 59.15 |
Hunyuan-7B-Instruct
| Model | Qwen2.5-7B-Instruct | Llama-3-8B-Instruct | OLMo-2-1124-7B-DPO | Hunyuan-7B-Instruct |
|---|---|---|---|---|
| ARC-C | 89.83 | 82.4 | - | 88.81 |
| BBH | 66.24 | - | 46.6 | 76.47 |
| CEval | 76.82 | - | - | 81.8 |
| CMMLU | 78.55 | - | - | 82.29 |
| DROP_F1 | 80.63 | - | 60.5 | 82.96 |
| GPQA | 36.87 | 34.6 | - | 47.98 |
| Gsm8k | 80.14 | 80.6 | 85.1 | 90.14 |
| HellaSwag | 83.34 | - | - | 86.57 |
| HumanEval | 84.8 | 60.4 | - | 84.0 |
| MATH | 72.86 | - | 32.5 | 70.64 |
| MMLU | 72.36 | 68.5 | 61.3 | 79.18 |
Quick Start
You can refer to the content in Tencent-Hunyuan-Large to get started quickly. The training and inference code can use the version provided in this github repository.
Inference Framework
- This open-source release offers two inference backend options tailored for the Hunyuan-7B model: the popular vLLM-backend and the TensorRT-LLM Backend. In this release, we are initially open-sourcing the vLLM solution, with plans to release the TRT-LLM solution in the near future.
Inference Performance
This section presents the efficiency test results of deploying various models using vLLM, including inference speed (tokens/s) under different batch sizes.
| Inference Framework | Model | Number of GPUs (GPU productA) | input_length | batch=1 | batch=4 |
|---|---|---|---|---|---|
| vLLM | hunyuan-7B | 1 | 2048 | 78.9 | 279.5 |
Contact Us
If you would like to leave a message for our R&D and product teams, Welcome to contact our open-source team . You can also contact us via email ( [email protected] ).
Runs of tencent Hunyuan-7B-Instruct-0124 on huggingface.co
167
Total runs
0
24-hour runs
5
3-day runs
25
7-day runs
38
30-day runs
More Information About Hunyuan-7B-Instruct-0124 huggingface.co Model
Url of Hunyuan-7B-Instruct-0124
Hunyuan-7B-Instruct-0124 huggingface.co Url
Provider of Hunyuan-7B-Instruct-0124 huggingface.co
Other API from tencent
Total runs:
355.9K
Run Growth:
310.0K
Growth Rate:
87.29%
Total runs:
97.9K
Run Growth:
-32.1K
Growth Rate:
-32.72%
Total runs:
90.7K
Run Growth:
-582.4K
Growth Rate:
-642.43%
Total runs:
54.6K
Run Growth:
-2.9K
Growth Rate:
-5.34%
Total runs:
45.6K
Run Growth:
15.1K
Growth Rate:
39.03%
Total runs:
45.5K
Run Growth:
399
Growth Rate:
0.89%
Total runs:
39.8K
Run Growth:
39.1K
Growth Rate:
98.30%
Total runs:
30.0K
Run Growth:
3.9K
Growth Rate:
13.02%
Total runs:
18.4K
Run Growth:
-10.9K
Growth Rate:
-57.97%
Total runs:
17.4K
Run Growth:
9.2K
Growth Rate:
53.10%
Total runs:
17.2K
Run Growth:
17.2K
Growth Rate:
100.00%
Total runs:
13.6K
Run Growth:
11.3K
Growth Rate:
83.46%
Total runs:
12.2K
Run Growth:
-17.0K
Growth Rate:
-138.75%
Total runs:
9.1K
Run Growth:
1.1K
Growth Rate:
12.31%
Total runs:
7.3K
Run Growth:
-1.6K
Growth Rate:
-22.19%
Total runs:
5.4K
Run Growth:
5.4K
Growth Rate:
100.00%
Total runs:
5.3K
Run Growth:
5.3K
Growth Rate:
100.00%
Total runs:
5.2K
Run Growth:
-1.4K
Growth Rate:
-26.08%
Total runs:
4.3K
Run Growth:
-1.2K
Growth Rate:
-27.65%
Total runs:
4.0K
Run Growth:
-532
Growth Rate:
-13.05%
Total runs:
3.1K
Run Growth:
1.0K
Growth Rate:
20.32%
Total runs:
2.9K
Run Growth:
-389
Growth Rate:
-14.55%
Total runs:
2.8K
Run Growth:
2.3K
Growth Rate:
80.50%
Total runs:
2.6K
Run Growth:
2.6K
Growth Rate:
100.00%
Total runs:
2.2K
Run Growth:
2.1K
Growth Rate:
92.76%
Total runs:
2.0K
Run Growth:
-18.0K
Growth Rate:
-915.43%
Total runs:
2.0K
Run Growth:
120
Growth Rate:
35.19%
Total runs:
1.8K
Run Growth:
327
Growth Rate:
17.71%
Total runs:
1.7K
Run Growth:
-873
Growth Rate:
-51.17%
Total runs:
1.6K
Run Growth:
477
Growth Rate:
27.67%
Total runs:
1.6K
Run Growth:
-946
Growth Rate:
-58.79%
Total runs:
1.4K
Run Growth:
1.2K
Growth Rate:
82.02%
Total runs:
1.0K
Run Growth:
599
Growth Rate:
59.72%
Total runs:
983
Run Growth:
750
Growth Rate:
76.69%
Total runs:
693
Run Growth:
-114
Growth Rate:
-16.45%
Total runs:
614
Run Growth:
-502
Growth Rate:
-83.53%
Total runs:
579
Run Growth:
189
Growth Rate:
33.10%
Total runs:
552
Run Growth:
-1.7K
Growth Rate:
-301.45%
Total runs:
537
Run Growth:
73
Growth Rate:
13.75%
Total runs:
480
Run Growth:
79
Growth Rate:
16.46%
Total runs:
472
Run Growth:
-106
Growth Rate:
-23.09%
Total runs:
439
Run Growth:
249
Growth Rate:
58.18%
Total runs:
420
Run Growth:
99
Growth Rate:
24.38%
Total runs:
417
Run Growth:
49
Growth Rate:
12.10%
Total runs:
403
Run Growth:
403
Growth Rate:
100.00%
Total runs:
402
Run Growth:
309
Growth Rate:
78.23%
Total runs:
397
Run Growth:
45
Growth Rate:
11.51%
Total runs:
334
Run Growth:
-130
Growth Rate:
-39.16%
Total runs:
317
Run Growth:
-81
Growth Rate:
-25.55%
Total runs:
297
Run Growth:
-416
Growth Rate:
-140.07%
Total runs:
290
Run Growth:
-86
Growth Rate:
-29.66%
Total runs:
289
Run Growth:
175
Growth Rate:
59.93%
Total runs:
280
Run Growth:
-137
Growth Rate:
-48.93%
Total runs:
277
Run Growth:
-69
Growth Rate:
-24.91%
Total runs:
272
Run Growth:
-972
Growth Rate:
-350.90%
Total runs:
249
Run Growth:
-1
Growth Rate:
-0.42%
Total runs:
229
Run Growth:
-384
Growth Rate:
-169.91%
Total runs:
210
Run Growth:
-67
Growth Rate:
-32.21%
Total runs:
203
Run Growth:
37
Growth Rate:
18.50%
Total runs:
197
Run Growth:
-64
Growth Rate:
-33.33%
Total runs:
189
Run Growth:
123
Growth Rate:
66.85%
Total runs:
184
Run Growth:
10
Growth Rate:
5.62%
Total runs:
184
Run Growth:
33
Growth Rate:
18.64%
Total runs:
178
Run Growth:
18
Growth Rate:
9.28%
Total runs:
167
Run Growth:
109
Growth Rate:
66.46%
Total runs:
167
Run Growth:
-66
Growth Rate:
-39.29%
Total runs:
163
Run Growth:
-107
Growth Rate:
-66.05%