Total runs:
120
Run Growth:
102
Growth Rate:
90.27%
Sponsored by
YouArt
aieng-lab / MathBERT-mamut
Model's Last Updated: July 08 2025
Introduction of MathBERT-mamut
Model Details of MathBERT-mamut
MAMUT-MathBert (Math Mutator MathBERT)
MAMUT-MathBERT is a pretrained language model based on tbs17/MathBERT , further pretrained on mathematical texts and formulas. It was introduced in MAMUT: A Novel Framework for Modifying Mathematical Formulas for the Generation of Specialized Datasets for Language Model Training .
Despite its base model is already a mathematical model, our training aims to improve the mathematical understanding even further, as shown in our paper.
Model Details
Overview
MAMUT-MPBERT was pretrained on four math-specific tasks across four datasets.
- Mathematical Formulas (MF) : A Masked Language Modeling (MLM) task on math formulas written in LaTeX.
- Mathematical Texts (MT) : An MLM task on natural language text containing inline LaTeX math ( mathematical texts ). The masking probability was biased toward mathematical tokens (inside math environment $...$) and domain-specific terms (e.g., sum , one , ...)
- Named Math Formulas (NMF) : A Next-Sentence-Prediction (NSP)-style task: given a formula and the name of a mathematical identity (e.g., Pythagorean Theorem), classify whether they match.
- Math Formula Retrieval (MFR) : Another NSP-style task to decide if two formulas describe the same mathematical identity or concept.
Model Sources
- Base Model: tbs17/MathBERT (whose base model is bert-base-cased )
- Pretraining Code: aieng-lab/transformer-math-pretraining
- MAMUT Repository: aieng-lab/math-mutator
- Paper: MAMUT: A Novel Framework for Modifying Mathematical Formulas for the Generation of Specialized Datasets for Language Model Training
Uses
MAMUT-MathBERT is intended for downstream tasks that require improved mathematical understanding, such as:
- Formula classification
- Retrieval of semantically similar formulas
- Math-related question answering
Note: This model was saved without the MLM or NSP heads and requires fine-tuning before use in downstream tasks.
Similarly trained models are
MAMUT-BERT based on
bert-base-cased
and
MAMUT-MPBERT based on
AnReu/math_structure_bert
(best of the three models according to our evaluation).
Training Details
Training configurations are described in Appendix C of the MAMUT paper .
Evaluation
The model is evaluated in Section 7 and Appendix C.4 of the MAMUT paper (MAMUT-MPBERT).
Environmental Impact
- Hardware Type: 8xA100
- Hours used: 48
- Compute Region: Germany
Citation
BibTeX:
@misc{drechsel2025mamutnovelframeworkmodifying,
title={{MAMUT}: A Novel Framework for Modifying Mathematical Formulas for the Generation of Specialized Datasets for Language Model Training},
author={Jonathan Drechsel and Anja Reusch and Steffen Herbold},
year={2025},
eprint={2502.20855},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2502.20855},
}
Runs of aieng-lab MathBERT-mamut on huggingface.co
123
Total runs
29
24-hour runs
31
3-day runs
30
7-day runs
50
30-day runs
More Information About MathBERT-mamut huggingface.co Model
Url of MathBERT-mamut
MathBERT-mamut huggingface.co Url
Provider of MathBERT-mamut huggingface.co
Other API from aieng-lab
Updated:February 23 2026
Total runs:
72
Run Growth:
49
Growth Rate:
74.24%
Total runs:
63
Run Growth:
45
Growth Rate:
81.82%
Total runs:
61
Run Growth:
34
Growth Rate:
61.82%
Total runs:
58
Run Growth:
43
Growth Rate:
76.79%
Total runs:
54
Run Growth:
25
Growth Rate:
48.08%
Total runs:
53
Run Growth:
15
Growth Rate:
28.30%
Total runs:
53
Run Growth:
39
Growth Rate:
73.58%
Total runs:
37
Run Growth:
-20
Growth Rate:
-55.56%
Total runs:
29
Run Growth:
-35
Growth Rate:
-120.69%
Total runs:
23
Run Growth:
14
Growth Rate:
58.33%
Total runs:
19
Run Growth:
0
Growth Rate:
0.00%
Total runs:
16
Run Growth:
11
Growth Rate:
73.33%
Total runs:
15
Run Growth:
11
Growth Rate:
78.57%
Total runs:
14
Run Growth:
-3
Growth Rate:
-21.43%
Total runs:
14
Run Growth:
11
Growth Rate:
78.57%
Total runs:
14
Run Growth:
7
Growth Rate:
53.85%
Total runs:
13
Run Growth:
6
Growth Rate:
50.00%
Total runs:
13
Run Growth:
-18
Growth Rate:
-128.57%
Total runs:
12
Run Growth:
6
Growth Rate:
54.55%
Total runs:
12
Run Growth:
7
Growth Rate:
63.64%
Total runs:
12
Run Growth:
8
Growth Rate:
66.67%
Total runs:
12
Run Growth:
-12
Growth Rate:
-92.31%
Total runs:
11
Run Growth:
5
Growth Rate:
55.56%
Total runs:
11
Run Growth:
8
Growth Rate:
80.00%
Total runs:
11
Run Growth:
8
Growth Rate:
72.73%
Total runs:
11
Run Growth:
7
Growth Rate:
70.00%
Total runs:
11
Run Growth:
7
Growth Rate:
70.00%
Total runs:
11
Run Growth:
4
Growth Rate:
40.00%
Total runs:
11
Run Growth:
8
Growth Rate:
80.00%
Total runs:
10
Run Growth:
4
Growth Rate:
44.44%
Total runs:
10
Run Growth:
4
Growth Rate:
44.44%
Total runs:
10
Run Growth:
5
Growth Rate:
50.00%
Total runs:
10
Run Growth:
5
Growth Rate:
55.56%
Total runs:
10
Run Growth:
3
Growth Rate:
33.33%
Total runs:
10
Run Growth:
7
Growth Rate:
77.78%
Total runs:
10
Run Growth:
6
Growth Rate:
60.00%
Total runs:
10
Run Growth:
6
Growth Rate:
66.67%
Total runs:
10
Run Growth:
8
Growth Rate:
88.89%
Total runs:
10
Run Growth:
6
Growth Rate:
60.00%
Total runs:
10
Run Growth:
6
Growth Rate:
66.67%
Total runs:
9
Run Growth:
4
Growth Rate:
44.44%
Total runs:
9
Run Growth:
4
Growth Rate:
44.44%
Total runs:
9
Run Growth:
4
Growth Rate:
50.00%
Total runs:
9
Run Growth:
4
Growth Rate:
50.00%
Total runs:
9
Run Growth:
4
Growth Rate:
50.00%
Total runs:
9
Run Growth:
5
Growth Rate:
62.50%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
1
Growth Rate:
14.29%
Total runs:
8
Run Growth:
-3
Growth Rate:
-42.86%
Total runs:
8
Run Growth:
4
Growth Rate:
57.14%
Total runs:
8
Run Growth:
3
Growth Rate:
42.86%
Total runs:
8
Run Growth:
4
Growth Rate:
50.00%
Total runs:
8
Run Growth:
2
Growth Rate:
28.57%
Total runs:
8
Run Growth:
4
Growth Rate:
57.14%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
4
Growth Rate:
50.00%
Total runs:
8
Run Growth:
2
Growth Rate:
28.57%
Total runs:
8
Run Growth:
3
Growth Rate:
37.50%
Total runs:
8
Run Growth:
5
Growth Rate:
62.50%
Total runs:
8
Run Growth:
3
Growth Rate:
42.86%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
4
Growth Rate:
50.00%
Total runs:
8
Run Growth:
5
Growth Rate:
62.50%
Total runs:
8
Run Growth:
3
Growth Rate:
42.86%
Total runs:
8
Run Growth:
2
Growth Rate:
28.57%
Total runs:
8
Run Growth:
4
Growth Rate:
50.00%
Total runs:
7
Run Growth:
4
Growth Rate:
57.14%
Total runs:
7
Run Growth:
1
Growth Rate:
16.67%
Total runs:
7
Run Growth:
2
Growth Rate:
28.57%
Total runs:
7
Run Growth:
5
Growth Rate:
83.33%
Total runs:
7
Run Growth:
3
Growth Rate:
50.00%
Total runs:
7
Run Growth:
2
Growth Rate:
28.57%
Total runs:
7
Run Growth:
2
Growth Rate:
33.33%
Total runs:
7
Run Growth:
-1
Growth Rate:
-16.67%
Total runs:
7
Run Growth:
2
Growth Rate:
40.00%
Total runs:
7
Run Growth:
3
Growth Rate:
50.00%
Total runs:
7
Run Growth:
4
Growth Rate:
66.67%
Total runs:
7
Run Growth:
5
Growth Rate:
62.50%
Total runs:
7
Run Growth:
2
Growth Rate:
28.57%
Total runs:
7
Run Growth:
2
Growth Rate:
33.33%
Total runs:
7
Run Growth:
1
Growth Rate:
16.67%
Total runs:
7
Run Growth:
4
Growth Rate:
57.14%
Total runs:
7
Run Growth:
1
Growth Rate:
16.67%
Total runs:
7
Run Growth:
2
Growth Rate:
33.33%
Total runs:
7
Run Growth:
0
Growth Rate:
0.00%
Total runs:
7
Run Growth:
2
Growth Rate:
33.33%
Total runs:
7
Run Growth:
1
Growth Rate:
16.67%
Total runs:
7
Run Growth:
4
Growth Rate:
57.14%
Total runs:
7
Run Growth:
2
Growth Rate:
28.57%
Total runs:
7
Run Growth:
4
Growth Rate:
50.00%
Total runs:
7
Run Growth:
3
Growth Rate:
42.86%
Total runs:
7
Run Growth:
1
Growth Rate:
16.67%
Total runs:
7
Run Growth:
1
Growth Rate:
16.67%
Total runs:
7
Run Growth:
2
Growth Rate:
33.33%