Total runs:
942
Run Growth:
264
Growth Rate:
28.03%
Sponsored by
Vmake Labs Video Enhancer
mgoin / Minitron-8B-Base-FP8
Model's Last Updated: July 27 2024
text-generation
Introduction of Minitron-8B-Base-FP8
Model Details of Minitron-8B-Base-FP8
Minitron-8B-Base-FP8
FP8 quantized checkpoint of nvidia/Minitron-8B-Base for use with vLLM.
Evaluations
This quantized model:
lm_eval --model vllm --model_args pretrained=Minitron-8B-Base-FP8 --tasks gsm8k --num_fewshot 5 --batch_size auto
vllm (pretrained=Minitron-8B-Base-FP8), gen_kwargs: (None), limit: None, num_fewshot: 5, batch_size: auto
|Tasks|Version| Filter |n-shot| Metric | |Value | |Stderr|
|-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
|gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.5019|± |0.0138|
| | |strict-match | 5|exact_match|↑ |0.4989|± |0.0138|
Baseline:
lm_eval --model vllm --model_args pretrained=nvidia/Minitron-8B-Base --tasks gsm8k --num_fewshot 5 --batch_size auto
vllm (pretrained=nvidia/Minitron-8B-Base), gen_kwargs: (None), limit: None, num_fewshot: 5, batch_size: auto
|Tasks|Version| Filter |n-shot| Metric | |Value | |Stderr|
|-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
|gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.5080|± |0.0138|
| | |strict-match | 5|exact_match|↑ |0.5064|± |0.0138|
The original paper evals:
Runs of mgoin Minitron-8B-Base-FP8 on huggingface.co
11
Total runs
0
24-hour runs
1
3-day runs
6
7-day runs
9
30-day runs
More Information About Minitron-8B-Base-FP8 huggingface.co Model
Url of Minitron-8B-Base-FP8
Minitron-8B-Base-FP8 huggingface.co Url
Provider of Minitron-8B-Base-FP8 huggingface.co
Other API from mgoin
Updated:April 19 2024
Total runs:
463
Run Growth:
100
Growth Rate:
21.69%
Total runs:
224
Run Growth:
139
Growth Rate:
62.05%
Total runs:
203
Run Growth:
-197
Growth Rate:
-98.01%
Total runs:
94
Run Growth:
12
Growth Rate:
12.63%
Total runs:
89
Run Growth:
31
Growth Rate:
35.23%
Total runs:
69
Run Growth:
-21
Growth Rate:
-30.43%
Total runs:
64
Run Growth:
0
Growth Rate:
0.00%
Total runs:
60
Run Growth:
19
Growth Rate:
31.67%
Total runs:
59
Run Growth:
0
Growth Rate:
0.00%
Total runs:
57
Run Growth:
16
Growth Rate:
28.07%
Total runs:
49
Run Growth:
39
Growth Rate:
79.59%
Total runs:
47
Run Growth:
37
Growth Rate:
78.72%
Total runs:
44
Run Growth:
32
Growth Rate:
66.67%
Total runs:
40
Run Growth:
-51
Growth Rate:
-127.50%
Total runs:
29
Run Growth:
22
Growth Rate:
75.86%
Total runs:
26
Run Growth:
-13
Growth Rate:
-50.00%
Total runs:
25
Run Growth:
10
Growth Rate:
40.00%
Total runs:
25
Run Growth:
-7
Growth Rate:
-28.00%
Total runs:
24
Run Growth:
0
Growth Rate:
0.00%
Total runs:
24
Run Growth:
22
Growth Rate:
91.67%
Total runs:
23
Run Growth:
4
Growth Rate:
17.39%
Total runs:
22
Run Growth:
12
Growth Rate:
54.55%
Total runs:
21
Run Growth:
12
Growth Rate:
57.14%
Total runs:
20
Run Growth:
1
Growth Rate:
5.00%
Total runs:
20
Run Growth:
10
Growth Rate:
50.00%
Total runs:
19
Run Growth:
11
Growth Rate:
57.89%
Total runs:
19
Run Growth:
14
Growth Rate:
73.68%
Total runs:
17
Run Growth:
2
Growth Rate:
11.76%
Total runs:
16
Run Growth:
9
Growth Rate:
56.25%
Total runs:
16
Run Growth:
10
Growth Rate:
62.50%
Total runs:
15
Run Growth:
3
Growth Rate:
20.00%
Total runs:
14
Run Growth:
0
Growth Rate:
0.00%
Total runs:
14
Run Growth:
7
Growth Rate:
50.00%
Total runs:
14
Run Growth:
2
Growth Rate:
14.29%
Total runs:
13
Run Growth:
12
Growth Rate:
92.31%
Total runs:
13
Run Growth:
3
Growth Rate:
23.08%
Total runs:
12
Run Growth:
6
Growth Rate:
50.00%
Total runs:
12
Run Growth:
5
Growth Rate:
41.67%
Total runs:
12
Run Growth:
3
Growth Rate:
25.00%
Total runs:
12
Run Growth:
3
Growth Rate:
25.00%
Total runs:
11
Run Growth:
10
Growth Rate:
90.91%
Total runs:
10
Run Growth:
5
Growth Rate:
50.00%
Total runs:
10
Run Growth:
10
Growth Rate:
100.00%
Total runs:
10
Run Growth:
3
Growth Rate:
30.00%
Total runs:
10
Run Growth:
9
Growth Rate:
90.00%
Total runs:
10
Run Growth:
-5
Growth Rate:
-50.00%
Total runs:
10
Run Growth:
9
Growth Rate:
90.00%
Total runs:
10
Run Growth:
6
Growth Rate:
60.00%
Total runs:
9
Run Growth:
8
Growth Rate:
88.89%
Total runs:
9
Run Growth:
6
Growth Rate:
66.67%
Total runs:
8
Run Growth:
7
Growth Rate:
87.50%
Total runs:
8
Run Growth:
5
Growth Rate:
62.50%
Total runs:
7
Run Growth:
-1
Growth Rate:
-14.29%
Total runs:
7
Run Growth:
6
Growth Rate:
85.71%
Total runs:
7
Run Growth:
5
Growth Rate:
71.43%
Total runs:
7
Run Growth:
6
Growth Rate:
85.71%
Total runs:
7
Run Growth:
-2
Growth Rate:
-28.57%
Total runs:
6
Run Growth:
1
Growth Rate:
16.67%
Total runs:
6
Run Growth:
6
Growth Rate:
100.00%
Total runs:
6
Run Growth:
6
Growth Rate:
100.00%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
5
Run Growth:
-2
Growth Rate:
-40.00%
Total runs:
5
Run Growth:
-4
Growth Rate:
-80.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
3
Growth Rate:
60.00%
Total runs:
5
Run Growth:
3
Growth Rate:
60.00%
Total runs:
5
Run Growth:
3
Growth Rate:
60.00%
Total runs:
5
Run Growth:
3
Growth Rate:
60.00%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
5
Run Growth:
4
Growth Rate:
80.00%
Total runs:
5
Run Growth:
4
Growth Rate:
80.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
4
Growth Rate:
100.00%
Total runs:
4
Run Growth:
4
Growth Rate:
100.00%
Total runs:
4
Run Growth:
3
Growth Rate:
75.00%
Total runs:
4
Run Growth:
4
Growth Rate:
100.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
3
Run Growth:
3
Growth Rate:
100.00%