Sponsored by
APIMart
internlm / internlm2-math-plus-20b
Model's Last Updated: March 13 2025
text-generation
Introduction of internlm2-math-plus-20b
Model Details of internlm2-math-plus-20b
InternLM-Math-Plus
InternLM-Math
Plus
State-of-the-art bilingual open-sourced Math reasoning LLMs. A solver , prover , verifier , augmentor .
News
- [2024.05.24] We release updated version InternLM2-Math-Plus with 4 sizes and state-of-the-art performances including 1.8B, 7B, 20B, and 8x22B. We improve informal math reasoning performance (chain-of-thought and code-intepreter) and formal math reasoning performance (LEAN 4 translation and LEAN 4 theorem proving) significantly.
- [2024.02.10] We add tech reports and citation reference.
- [2024.01.31] We add MiniF2F results with evaluation codes!
- [2024.01.29] We add checkpoints from ModelScope. Update results about majority voting and Code Intepreter. Tech report is on the way!
- [2024.01.26] We add checkpoints from OpenXLab, which ease Chinese users to download!
Performance
Formal Math Reasoning
We evaluate the performance of InternLM2-Math-Plus on formal math reasoning benchmark MiniF2F-test. The evaluation setting is same as Llemma with LEAN 4.
| Models | MiniF2F-test |
|---|---|
| ReProver | 26.5 |
| LLMStep | 27.9 |
| GPT-F | 36.6 |
| HTPS | 41.0 |
| Llemma-7B | 26.2 |
| Llemma-34B | 25.8 |
| InternLM2-Math-7B-Base | 30.3 |
| InternLM2-Math-20B-Base | 29.5 |
| InternLM2-Math-Plus-1.8B | 38.9 |
| InternLM2-Math-Plus-7B | 43.4 |
| InternLM2-Math-Plus-20B | 42.6 |
| InternLM2-Math-Plus-Mixtral8x22B | 37.3 |
Informal Math Reasoning
We evaluate the performance of InternLM2-Math-Plus on informal math reasoning benchmark MATH and GSM8K. InternLM2-Math-Plus-1.8B outperforms MiniCPM-2B in the smallest size setting. InternLM2-Math-Plus-7B outperforms Deepseek-Math-7B-RL which is the state-of-the-art math reasoning open source model. InternLM2-Math-Plus-Mixtral8x22B achieves 68.5 on MATH (with Python) and 91.8 on GSM8K.
| Model | MATH | MATH-Python | GSM8K |
|---|---|---|---|
| MiniCPM-2B | 10.2 | - | 53.8 |
| InternLM2-Math-Plus-1.8B | 37.0 | 41.5 | 58.8 |
| InternLM2-Math-7B | 34.6 | 50.9 | 78.1 |
| Deepseek-Math-7B-RL | 51.7 | 58.8 | 88.2 |
| InternLM2-Math-Plus-7B | 53.0 | 59.7 | 85.8 |
| InternLM2-Math-20B | 37.7 | 54.3 | 82.6 |
| InternLM2-Math-Plus-20B | 53.8 | 61.8 | 87.7 |
| Mixtral8x22B-Instruct-v0.1 | 41.8 | - | 78.6 |
| Eurux-8x22B-NCA | 49.0 | - | - |
| InternLM2-Math-Plus-Mixtral8x22B | 58.1 | 68.5 | 91.8 |
We also evaluate models on MathBench-A . InternLM2-Math-Plus-Mixtral8x22B has comparable performance compared to Claude 3 Opus.
| Model | Arithmetic | Primary | Middle | High | College | Average |
|---|---|---|---|---|---|---|
| GPT-4o-0513 | 77.7 | 87.7 | 76.3 | 59.0 | 54.0 | 70.9 |
| Claude 3 Opus | 85.7 | 85.0 | 58.0 | 42.7 | 43.7 | 63.0 |
| Qwen-Max-0428 | 72.3 | 86.3 | 65.0 | 45.0 | 27.3 | 59.2 |
| Qwen-1.5-110B | 70.3 | 82.3 | 64.0 | 47.3 | 28.0 | 58.4 |
| Deepseek-V2 | 82.7 | 89.3 | 59.0 | 39.3 | 29.3 | 59.9 |
| Llama-3-70B-Instruct | 70.3 | 86.0 | 53.0 | 38.7 | 34.7 | 56.5 |
| InternLM2-Math-Plus-Mixtral8x22B | 77.5 | 82.0 | 63.6 | 50.3 | 36.8 | 62.0 |
| InternLM2-Math-20B | 58.7 | 70.0 | 43.7 | 24.7 | 12.7 | 42.0 |
| InternLM2-Math-Plus-20B | 65.8 | 79.7 | 59.5 | 47.6 | 24.8 | 55.5 |
| Llama3-8B-Instruct | 54.7 | 71.0 | 25.0 | 19.0 | 14.0 | 36.7 |
| InternLM2-Math-7B | 53.7 | 67.0 | 41.3 | 18.3 | 8.0 | 37.7 |
| Deepseek-Math-7B-RL | 68.0 | 83.3 | 44.3 | 33.0 | 23.0 | 50.3 |
| InternLM2-Math-Plus-7B | 61.4 | 78.3 | 52.5 | 40.5 | 21.7 | 50.9 |
| MiniCPM-2B | 49.3 | 51.7 | 18.0 | 8.7 | 3.7 | 26.3 |
| InternLM2-Math-Plus-1.8B | 43.0 | 43.3 | 25.4 | 18.9 | 4.7 | 27.1 |
Citation and Tech Report
@misc{ying2024internlmmath,
title={InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoning},
author={Huaiyuan Ying and Shuo Zhang and Linyang Li and Zhejian Zhou and Yunfan Shao and Zhaoye Fei and Yichuan Ma and Jiawei Hong and Kuikun Liu and Ziyi Wang and Yudong Wang and Zijian Wu and Shuaibin Li and Fengzhe Zhou and Hongwei Liu and Songyang Zhang and Wenwei Zhang and Hang Yan and Xipeng Qiu and Jiayu Wang and Kai Chen and Dahua Lin},
year={2024},
eprint={2402.06332},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
Runs of internlm internlm2-math-plus-20b on huggingface.co
21
Total runs
0
24-hour runs
0
3-day runs
-26
7-day runs
-142
30-day runs
More Information About internlm2-math-plus-20b huggingface.co Model
Url of internlm2-math-plus-20b
internlm2-math-plus-20b huggingface.co Url
Provider of internlm2-math-plus-20b huggingface.co
Other API from internlm
Total runs:
113.9K
Run Growth:
24.2K
Growth Rate:
21.28%
Total runs:
70.7K
Run Growth:
-13.1K
Growth Rate:
-18.54%
Total runs:
50.4K
Run Growth:
2.5K
Growth Rate:
4.90%
Total runs:
41.6K
Run Growth:
3.5K
Growth Rate:
8.37%
Total runs:
29.7K
Run Growth:
1.5K
Growth Rate:
3.66%
Total runs:
20.2K
Run Growth:
674
Growth Rate:
3.33%
Total runs:
19.8K
Run Growth:
-2.5K
Growth Rate:
-12.46%
Total runs:
19.4K
Run Growth:
-1.3K
Growth Rate:
-6.75%
Total runs:
16.5K
Run Growth:
-1.8K
Growth Rate:
-10.87%
Total runs:
5.9K
Run Growth:
-2.8K
Growth Rate:
-47.13%
Total runs:
5.8K
Run Growth:
1.3K
Growth Rate:
22.76%
Total runs:
4.8K
Run Growth:
-2.7K
Growth Rate:
-55.74%
Total runs:
4.2K
Run Growth:
-191
Growth Rate:
-4.51%
Total runs:
3.4K
Run Growth:
-503
Growth Rate:
-14.61%
Total runs:
3.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.0K
Run Growth:
-534
Growth Rate:
-18.05%
Total runs:
1.8K
Run Growth:
1.7K
Growth Rate:
95.76%
Total runs:
1.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.5K
Run Growth:
-301
Growth Rate:
-19.44%
Total runs:
1.3K
Run Growth:
-42
Growth Rate:
-3.19%
Total runs:
1.3K
Run Growth:
-325
Growth Rate:
-25.21%
Total runs:
1.3K
Run Growth:
-37
Growth Rate:
-2.99%
Total runs:
1.0K
Run Growth:
778
Growth Rate:
75.90%
Total runs:
1.0K
Run Growth:
166
Growth Rate:
16.37%
Total runs:
969
Run Growth:
800
Growth Rate:
82.56%
Total runs:
894
Run Growth:
-2
Growth Rate:
-0.22%
Total runs:
494
Run Growth:
448
Growth Rate:
90.69%
Total runs:
471
Run Growth:
-305
Growth Rate:
-64.76%
Total runs:
454
Run Growth:
0
Growth Rate:
0.00%
Total runs:
365
Run Growth:
-34
Growth Rate:
-9.32%
Total runs:
363
Run Growth:
69
Growth Rate:
19.01%
Total runs:
331
Run Growth:
279
Growth Rate:
93.94%
Total runs:
326
Run Growth:
0
Growth Rate:
0.00%
Total runs:
320
Run Growth:
286
Growth Rate:
89.38%
Total runs:
309
Run Growth:
-116
Growth Rate:
-37.54%
Total runs:
294
Run Growth:
59
Growth Rate:
20.07%
Total runs:
293
Run Growth:
2
Growth Rate:
0.68%
Total runs:
275
Run Growth:
229
Growth Rate:
92.34%
Total runs:
251
Run Growth:
82
Growth Rate:
32.67%
Total runs:
248
Run Growth:
0
Growth Rate:
0.00%
Total runs:
215
Run Growth:
102
Growth Rate:
47.44%
Total runs:
211
Run Growth:
0
Growth Rate:
0.00%
Total runs:
178
Run Growth:
110
Growth Rate:
61.80%
Total runs:
167
Run Growth:
-112
Growth Rate:
-67.07%
Total runs:
164
Run Growth:
14
Growth Rate:
8.54%
Total runs:
145
Run Growth:
0
Growth Rate:
0.00%
Total runs:
132
Run Growth:
-35
Growth Rate:
-26.52%
Total runs:
125
Run Growth:
59
Growth Rate:
47.20%
Total runs:
124
Run Growth:
0
Growth Rate:
0.00%
Total runs:
116
Run Growth:
11
Growth Rate:
9.48%
Total runs:
115
Run Growth:
28
Growth Rate:
24.35%
Total runs:
111
Run Growth:
-27
Growth Rate:
-27.27%
Total runs:
102
Run Growth:
21
Growth Rate:
20.59%
Total runs:
102
Run Growth:
2
Growth Rate:
1.96%
Total runs:
101
Run Growth:
77
Growth Rate:
76.24%
Total runs:
101
Run Growth:
0
Growth Rate:
0.00%
Total runs:
89
Run Growth:
0
Growth Rate:
0.00%
Total runs:
86
Run Growth:
1
Growth Rate:
1.16%
Total runs:
80
Run Growth:
-63
Growth Rate:
-78.75%
Total runs:
75
Run Growth:
-73
Growth Rate:
-97.33%
Total runs:
70
Run Growth:
-58
Growth Rate:
-82.86%
Total runs:
68
Run Growth:
14
Growth Rate:
20.59%
Total runs:
66
Run Growth:
47
Growth Rate:
71.21%
Total runs:
48
Run Growth:
-12
Growth Rate:
-25.00%
Total runs:
42
Run Growth:
0
Growth Rate:
0.00%
Total runs:
41
Run Growth:
7
Growth Rate:
17.07%
Total runs:
39
Run Growth:
-14
Growth Rate:
-35.90%
Total runs:
36
Run Growth:
21
Growth Rate:
58.33%
Total runs:
29
Run Growth:
-61
Growth Rate:
-210.34%
Total runs:
29
Run Growth:
12
Growth Rate:
41.38%
Total runs:
29
Run Growth:
-33
Growth Rate:
-110.00%
Total runs:
25
Run Growth:
-24
Growth Rate:
-96.00%
Total runs:
21
Run Growth:
1
Growth Rate:
4.76%
Total runs:
18
Run Growth:
-140
Growth Rate:
-777.78%