Sponsored by
PoYo.AI
internlm / internlm2-math-plus-7b
Model's Last Updated: March 13 2025
text-generation
Introduction of internlm2-math-plus-7b
Model Details of internlm2-math-plus-7b
InternLM-Math-Plus
InternLM-Math
Plus
State-of-the-art bilingual open-sourced Math reasoning LLMs. A solver , prover , verifier , augmentor .
News
- [2024.05.24] We release updated version InternLM2-Math-Plus with 4 sizes and state-of-the-art performances including 1.8B, 7B, 20B, and 8x22B. We improve informal math reasoning performance (chain-of-thought and code-intepreter) and formal math reasoning performance (LEAN 4 translation and LEAN 4 theorem proving) significantly.
- [2024.02.10] We add tech reports and citation reference.
- [2024.01.31] We add MiniF2F results with evaluation codes!
- [2024.01.29] We add checkpoints from ModelScope. Update results about majority voting and Code Intepreter. Tech report is on the way!
- [2024.01.26] We add checkpoints from OpenXLab, which ease Chinese users to download!
Performance
Formal Math Reasoning
We evaluate the performance of InternLM2-Math-Plus on formal math reasoning benchmark MiniF2F-test. The evaluation setting is same as Llemma with LEAN 4.
| Models | MiniF2F-test |
|---|---|
| ReProver | 26.5 |
| LLMStep | 27.9 |
| GPT-F | 36.6 |
| HTPS | 41.0 |
| Llemma-7B | 26.2 |
| Llemma-34B | 25.8 |
| InternLM2-Math-7B-Base | 30.3 |
| InternLM2-Math-20B-Base | 29.5 |
| InternLM2-Math-Plus-1.8B | 38.9 |
| InternLM2-Math-Plus-7B | 43.4 |
| InternLM2-Math-Plus-20B | 42.6 |
| InternLM2-Math-Plus-Mixtral8x22B | 37.3 |
Informal Math Reasoning
We evaluate the performance of InternLM2-Math-Plus on informal math reasoning benchmark MATH and GSM8K. InternLM2-Math-Plus-1.8B outperforms MiniCPM-2B in the smallest size setting. InternLM2-Math-Plus-7B outperforms Deepseek-Math-7B-RL which is the state-of-the-art math reasoning open source model. InternLM2-Math-Plus-Mixtral8x22B achieves 68.5 on MATH (with Python) and 91.8 on GSM8K.
| Model | MATH | MATH-Python | GSM8K |
|---|---|---|---|
| MiniCPM-2B | 10.2 | - | 53.8 |
| InternLM2-Math-Plus-1.8B | 37.0 | 41.5 | 58.8 |
| InternLM2-Math-7B | 34.6 | 50.9 | 78.1 |
| Deepseek-Math-7B-RL | 51.7 | 58.8 | 88.2 |
| InternLM2-Math-Plus-7B | 53.0 | 59.7 | 85.8 |
| InternLM2-Math-20B | 37.7 | 54.3 | 82.6 |
| InternLM2-Math-Plus-20B | 53.8 | 61.8 | 87.7 |
| Mixtral8x22B-Instruct-v0.1 | 41.8 | - | 78.6 |
| Eurux-8x22B-NCA | 49.0 | - | - |
| InternLM2-Math-Plus-Mixtral8x22B | 58.1 | 68.5 | 91.8 |
We also evaluate models on MathBench-A . InternLM2-Math-Plus-Mixtral8x22B has comparable performance compared to Claude 3 Opus.
| Model | Arithmetic | Primary | Middle | High | College | Average |
|---|---|---|---|---|---|---|
| GPT-4o-0513 | 77.7 | 87.7 | 76.3 | 59.0 | 54.0 | 70.9 |
| Claude 3 Opus | 85.7 | 85.0 | 58.0 | 42.7 | 43.7 | 63.0 |
| Qwen-Max-0428 | 72.3 | 86.3 | 65.0 | 45.0 | 27.3 | 59.2 |
| Qwen-1.5-110B | 70.3 | 82.3 | 64.0 | 47.3 | 28.0 | 58.4 |
| Deepseek-V2 | 82.7 | 89.3 | 59.0 | 39.3 | 29.3 | 59.9 |
| Llama-3-70B-Instruct | 70.3 | 86.0 | 53.0 | 38.7 | 34.7 | 56.5 |
| InternLM2-Math-Plus-Mixtral8x22B | 77.5 | 82.0 | 63.6 | 50.3 | 36.8 | 62.0 |
| InternLM2-Math-20B | 58.7 | 70.0 | 43.7 | 24.7 | 12.7 | 42.0 |
| InternLM2-Math-Plus-20B | 65.8 | 79.7 | 59.5 | 47.6 | 24.8 | 55.5 |
| Llama3-8B-Instruct | 54.7 | 71.0 | 25.0 | 19.0 | 14.0 | 36.7 |
| InternLM2-Math-7B | 53.7 | 67.0 | 41.3 | 18.3 | 8.0 | 37.7 |
| Deepseek-Math-7B-RL | 68.0 | 83.3 | 44.3 | 33.0 | 23.0 | 50.3 |
| InternLM2-Math-Plus-7B | 61.4 | 78.3 | 52.5 | 40.5 | 21.7 | 50.9 |
| MiniCPM-2B | 49.3 | 51.7 | 18.0 | 8.7 | 3.7 | 26.3 |
| InternLM2-Math-Plus-1.8B | 43.0 | 43.3 | 25.4 | 18.9 | 4.7 | 27.1 |
Citation and Tech Report
@misc{ying2024internlmmath,
title={InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoning},
author={Huaiyuan Ying and Shuo Zhang and Linyang Li and Zhejian Zhou and Yunfan Shao and Zhaoye Fei and Yichuan Ma and Jiawei Hong and Kuikun Liu and Ziyi Wang and Yudong Wang and Zijian Wu and Shuaibin Li and Fengzhe Zhou and Hongwei Liu and Songyang Zhang and Wenwei Zhang and Hang Yan and Xipeng Qiu and Jiayu Wang and Kai Chen and Dahua Lin},
year={2024},
eprint={2402.06332},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
Runs of internlm internlm2-math-plus-7b on huggingface.co
132
Total runs
0
24-hour runs
0
3-day runs
-1
7-day runs
-35
30-day runs
More Information About internlm2-math-plus-7b huggingface.co Model
Url of internlm2-math-plus-7b
internlm2-math-plus-7b huggingface.co Url
Provider of internlm2-math-plus-7b huggingface.co
Other API from internlm
Total runs:
86.3K
Run Growth:
16.8K
Growth Rate:
19.17%
Total runs:
74.4K
Run Growth:
-3.0K
Growth Rate:
-4.07%
Total runs:
58.9K
Run Growth:
28.3K
Growth Rate:
48.19%
Total runs:
47.7K
Run Growth:
3.7K
Growth Rate:
7.61%
Total runs:
32.7K
Run Growth:
3.4K
Growth Rate:
10.30%
Total runs:
21.2K
Run Growth:
1.7K
Growth Rate:
7.96%
Total runs:
21.1K
Run Growth:
1.6K
Growth Rate:
7.43%
Total runs:
17.3K
Run Growth:
259
Growth Rate:
1.50%
Total runs:
7.9K
Run Growth:
2.0K
Growth Rate:
25.24%
Total runs:
7.6K
Run Growth:
2.7K
Growth Rate:
35.52%
Total runs:
5.6K
Run Growth:
-6
Growth Rate:
-0.11%
Total runs:
5.6K
Run Growth:
1.6K
Growth Rate:
29.30%
Total runs:
4.4K
Run Growth:
1.7K
Growth Rate:
39.44%
Total runs:
4.2K
Run Growth:
-191
Growth Rate:
-4.51%
Total runs:
3.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.0K
Run Growth:
-534
Growth Rate:
-18.05%
Total runs:
2.1K
Run Growth:
1.8K
Growth Rate:
100.00%
Total runs:
1.6K
Run Growth:
-134.7K
Growth Rate:
-8320.57%
Total runs:
1.6K
Run Growth:
-96
Growth Rate:
-5.54%
Total runs:
1.6K
Run Growth:
421
Growth Rate:
26.80%
Total runs:
1.5K
Run Growth:
1.5K
Growth Rate:
100.00%
Total runs:
1.5K
Run Growth:
1.3K
Growth Rate:
100.00%
Total runs:
1.3K
Run Growth:
53
Growth Rate:
3.99%
Total runs:
1.1K
Run Growth:
-372
Growth Rate:
-33.45%
Total runs:
1.0K
Run Growth:
778
Growth Rate:
75.90%
Total runs:
974
Run Growth:
731
Growth Rate:
100.00%
Total runs:
894
Run Growth:
-2
Growth Rate:
-0.22%
Total runs:
855
Run Growth:
-3.0K
Growth Rate:
-356.02%
Total runs:
757
Run Growth:
516
Growth Rate:
68.16%
Total runs:
738
Run Growth:
657
Growth Rate:
100.00%
Total runs:
683
Run Growth:
683
Growth Rate:
100.00%
Total runs:
574
Run Growth:
-690
Growth Rate:
-121.05%
Total runs:
478
Run Growth:
-815
Growth Rate:
-173.40%
Total runs:
471
Run Growth:
-305
Growth Rate:
-64.76%
Total runs:
454
Run Growth:
0
Growth Rate:
0.00%
Total runs:
423
Run Growth:
133
Growth Rate:
31.44%
Total runs:
382
Run Growth:
34
Growth Rate:
8.90%
Total runs:
363
Run Growth:
69
Growth Rate:
19.01%
Total runs:
358
Run Growth:
128
Growth Rate:
35.75%
Total runs:
326
Run Growth:
0
Growth Rate:
0.00%
Total runs:
320
Run Growth:
286
Growth Rate:
89.38%
Total runs:
304
Run Growth:
5
Growth Rate:
1.64%
Total runs:
294
Run Growth:
59
Growth Rate:
20.07%
Total runs:
294
Run Growth:
-30
Growth Rate:
-10.20%
Total runs:
293
Run Growth:
2
Growth Rate:
0.68%
Total runs:
281
Run Growth:
119
Growth Rate:
42.35%
Total runs:
279
Run Growth:
60
Growth Rate:
21.43%
Total runs:
250
Run Growth:
170
Growth Rate:
68.00%
Total runs:
248
Run Growth:
0
Growth Rate:
0.00%
Total runs:
247
Run Growth:
-14
Growth Rate:
-5.79%
Total runs:
242
Run Growth:
58
Growth Rate:
23.77%
Total runs:
229
Run Growth:
75
Growth Rate:
32.61%
Total runs:
215
Run Growth:
102
Growth Rate:
47.44%
Total runs:
211
Run Growth:
-50
Growth Rate:
-23.70%
Total runs:
211
Run Growth:
0
Growth Rate:
0.00%
Total runs:
207
Run Growth:
79
Growth Rate:
38.54%
Total runs:
205
Run Growth:
58
Growth Rate:
28.43%
Total runs:
190
Run Growth:
51
Growth Rate:
26.84%
Total runs:
186
Run Growth:
31
Growth Rate:
16.67%
Total runs:
179
Run Growth:
-169
Growth Rate:
-94.41%
Total runs:
178
Run Growth:
110
Growth Rate:
61.80%
Total runs:
151
Run Growth:
60
Growth Rate:
40.27%
Total runs:
149
Run Growth:
125
Growth Rate:
83.89%
Total runs:
145
Run Growth:
0
Growth Rate:
0.00%
Total runs:
132
Run Growth:
132
Growth Rate:
100.00%
Total runs:
124
Run Growth:
0
Growth Rate:
0.00%
Total runs:
124
Run Growth:
49
Growth Rate:
39.52%
Total runs:
114
Run Growth:
21
Growth Rate:
18.26%
Total runs:
113
Run Growth:
47
Growth Rate:
42.34%
Total runs:
102
Run Growth:
2
Growth Rate:
1.96%
Total runs:
101
Run Growth:
0
Growth Rate:
0.00%
Total runs:
96
Run Growth:
52
Growth Rate:
54.17%
Total runs:
94
Run Growth:
13
Growth Rate:
13.98%
Total runs:
93
Run Growth:
8
Growth Rate:
8.89%
Total runs:
86
Run Growth:
1
Growth Rate:
1.16%
Total runs:
81
Run Growth:
31
Growth Rate:
38.27%
Total runs:
80
Run Growth:
-63
Growth Rate:
-78.75%