Total runs:
418
Run Growth:
-49
Growth Rate:
-11.72%
Sponsored by
Vmake Labs Video Enhancer
EpistemeAI / Fireball-MathMistral-Nemo-Base-2407
Model's Last Updated: August 22 2024
text-generation
Introduction of Fireball-MathMistral-Nemo-Base-2407
Model Details of Fireball-MathMistral-Nemo-Base-2407
Uploaded model
- Developed by: EpistemeAI
- License: apache-2.0
- Finetuned from model : unsloth/Mistral-Nemo-Base-2407-bnb-4bit
- This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.
Fireball-MathMistral-Nemo-Base-2407
This model is fine-tune to provide better math response than Mistral-Nemo-Base-2407
Training Dataset
Supervised fine-tuning with datasets with meta-math/MetaMathQA
This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.
Model Card for Mistral-Nemo-Base-2407
The Fireball-MathMistral-Nemo-Base-2407 Large Language Model (LLM) is a pretrained generative text model of 12B parameters, it significantly outperforms existing models smaller or similar in size.
For more details about this model please refer to our release blog post .
Key features
- Released under the Apache 2 License
- Trained with a 128k context window
- Trained on a large proportion of multilingual and code data
- Drop-in replacement of Mistral 7B
Model Architecture
Mistral Nemo is a transformer model, with the following architecture choices:
- Layers: 40
- Dim: 5,120
- Head dim: 128
- Hidden dim: 14,436
- Activation Function: SwiGLU
- Number of heads: 32
- Number of kv-heads: 8 (GQA)
- Vocabulary size: 2**17 ~= 128k
- Rotary embeddings (theta = 1M)
Demo
After installing
mistral_inference
, a
mistral-demo
CLI command should be available in your environment.
Transformers
NOTE: Until a new release has been made, you need to install transformers from source:
pip install git+https://github.com/huggingface/transformers.git
If you want to use Hugging Face
transformers
to generate text, you can do something like this.
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "EpistemeAI/Fireball-MathMistral-Nemo-Base-2407"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id)
inputs = tokenizer("Hello my name is", return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=20)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
Unlike previous Mistral models, Mistral Nemo requires smaller temperatures. We recommend to use a temperature of 0.3.
Note
Mistral-Nemo-Base-2407
is a pretrained base model and therefore does not have any moderation mechanisms.
Runs of EpistemeAI Fireball-MathMistral-Nemo-Base-2407 on huggingface.co
27
Total runs
0
24-hour runs
2
3-day runs
1
7-day runs
9
30-day runs
More Information About Fireball-MathMistral-Nemo-Base-2407 huggingface.co Model
Url of Fireball-MathMistral-Nemo-Base-2407
Fireball-MathMistral-Nemo-Base-2407 huggingface.co Url
Provider of Fireball-MathMistral-Nemo-Base-2407 huggingface.co
Other API from EpistemeAI
Updated:July 09 2026
Total runs:
314
Run Growth:
303
Growth Rate:
96.50%
Total runs:
300
Run Growth:
60
Growth Rate:
20.00%
Total runs:
271
Run Growth:
28
Growth Rate:
10.33%
Total runs:
112
Run Growth:
0
Growth Rate:
0.00%
Total runs:
110
Run Growth:
39
Growth Rate:
35.45%
Total runs:
100
Run Growth:
-62
Growth Rate:
-62.00%
Total runs:
92
Run Growth:
12
Growth Rate:
13.04%
Total runs:
79
Run Growth:
30
Growth Rate:
37.97%
Total runs:
72
Run Growth:
-29
Growth Rate:
-40.28%
Total runs:
70
Run Growth:
70
Growth Rate:
100.00%
Total runs:
62
Run Growth:
0
Growth Rate:
0.00%
Total runs:
59
Run Growth:
-16
Growth Rate:
-27.12%
Total runs:
58
Run Growth:
-1
Growth Rate:
-1.67%
Total runs:
57
Run Growth:
21
Growth Rate:
36.84%
Total runs:
57
Run Growth:
31
Growth Rate:
54.39%
Total runs:
55
Run Growth:
18
Growth Rate:
33.33%
Total runs:
54
Run Growth:
3
Growth Rate:
5.56%
Total runs:
54
Run Growth:
26
Growth Rate:
48.15%
Total runs:
53
Run Growth:
-10
Growth Rate:
-18.87%
Total runs:
53
Run Growth:
17
Growth Rate:
32.69%
Total runs:
53
Run Growth:
23
Growth Rate:
44.23%
Total runs:
53
Run Growth:
15
Growth Rate:
28.85%
Total runs:
52
Run Growth:
-11
Growth Rate:
-21.15%
Total runs:
52
Run Growth:
9
Growth Rate:
17.31%
Total runs:
52
Run Growth:
4
Growth Rate:
9.09%
Total runs:
51
Run Growth:
13
Growth Rate:
26.00%
Total runs:
51
Run Growth:
-3
Growth Rate:
-6.38%
Total runs:
51
Run Growth:
20
Growth Rate:
39.22%
Total runs:
49
Run Growth:
0
Growth Rate:
0.00%
Total runs:
49
Run Growth:
20
Growth Rate:
40.82%
Total runs:
49
Run Growth:
0
Growth Rate:
0.00%
Total runs:
48
Run Growth:
48
Growth Rate:
100.00%
Total runs:
48
Run Growth:
15
Growth Rate:
30.61%
Total runs:
45
Run Growth:
0
Growth Rate:
0.00%
Total runs:
43
Run Growth:
3
Growth Rate:
6.98%
Total runs:
43
Run Growth:
4
Growth Rate:
9.52%
Total runs:
42
Run Growth:
17
Growth Rate:
40.48%
Total runs:
42
Run Growth:
3
Growth Rate:
9.38%
Total runs:
41
Run Growth:
12
Growth Rate:
30.77%
Total runs:
40
Run Growth:
22
Growth Rate:
55.00%
Total runs:
40
Run Growth:
30
Growth Rate:
75.00%
Total runs:
40
Run Growth:
15
Growth Rate:
37.50%
Total runs:
39
Run Growth:
9
Growth Rate:
23.08%
Total runs:
39
Run Growth:
12
Growth Rate:
31.58%
Total runs:
37
Run Growth:
21
Growth Rate:
56.76%
Total runs:
37
Run Growth:
8
Growth Rate:
22.22%
Total runs:
37
Run Growth:
9
Growth Rate:
24.32%
Total runs:
37
Run Growth:
6
Growth Rate:
17.65%
Total runs:
36
Run Growth:
-32
Growth Rate:
-110.34%
Total runs:
36
Run Growth:
15
Growth Rate:
41.67%
Total runs:
35
Run Growth:
-3
Growth Rate:
-8.57%
Total runs:
35
Run Growth:
10
Growth Rate:
28.57%
Total runs:
34
Run Growth:
5
Growth Rate:
15.15%
Total runs:
33
Run Growth:
8
Growth Rate:
24.24%
Total runs:
33
Run Growth:
3
Growth Rate:
9.09%
Total runs:
32
Run Growth:
22
Growth Rate:
68.75%
Total runs:
32
Run Growth:
12
Growth Rate:
37.50%
Total runs:
32
Run Growth:
0
Growth Rate:
0.00%
Total runs:
31
Run Growth:
-23
Growth Rate:
-74.19%
Total runs:
31
Run Growth:
-11
Growth Rate:
-35.48%
Total runs:
30
Run Growth:
22
Growth Rate:
73.33%
Total runs:
30
Run Growth:
16
Growth Rate:
55.17%
Total runs:
29
Run Growth:
6
Growth Rate:
20.69%
Total runs:
29
Run Growth:
6
Growth Rate:
20.69%
Total runs:
28
Run Growth:
-6
Growth Rate:
-21.43%
Total runs:
28
Run Growth:
11
Growth Rate:
39.29%
Total runs:
28
Run Growth:
21
Growth Rate:
72.41%
Total runs:
28
Run Growth:
6
Growth Rate:
21.43%
Total runs:
27
Run Growth:
-19
Growth Rate:
-82.61%
Total runs:
27
Run Growth:
10
Growth Rate:
37.04%
Total runs:
27
Run Growth:
23
Growth Rate:
74.19%
Total runs:
27
Run Growth:
9
Growth Rate:
33.33%
Total runs:
27
Run Growth:
20
Growth Rate:
74.07%
Total runs:
27
Run Growth:
12
Growth Rate:
44.44%
Total runs:
26
Run Growth:
11
Growth Rate:
42.31%
Total runs:
26
Run Growth:
15
Growth Rate:
57.69%
Total runs:
25
Run Growth:
1
Growth Rate:
4.00%
Total runs:
25
Run Growth:
-1
Growth Rate:
-4.00%
Total runs:
25
Run Growth:
6
Growth Rate:
24.00%
Total runs:
24
Run Growth:
11
Growth Rate:
45.83%
Total runs:
24
Run Growth:
-3
Growth Rate:
-12.50%
Total runs:
23
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23
Run Growth:
-1
Growth Rate:
-4.55%
Total runs:
23
Run Growth:
6
Growth Rate:
28.57%
Total runs:
23
Run Growth:
2
Growth Rate:
8.70%
Total runs:
23
Run Growth:
23
Growth Rate:
100.00%
Total runs:
23
Run Growth:
-13
Growth Rate:
-56.52%
Total runs:
23
Run Growth:
9
Growth Rate:
39.13%
Total runs:
23
Run Growth:
12
Growth Rate:
52.17%
Total runs:
22
Run Growth:
-8
Growth Rate:
-36.36%
Total runs:
22
Run Growth:
0
Growth Rate:
0.00%