Sponsored by
PostMcpAi
Ba2han / BioMistral-v0.2
Model's Last Updated: April 10 2024
text-generation
Introduction of BioMistral-v0.2
Model Details of BioMistral-v0.2
limit: None, provide_description: False, num_fewshot: 5, batch_size: None
| Task | Version | Metric | Value | Stderr | |
|---|---|---|---|---|---|
| hendrycksTest-college_chemistry | 1 | acc | 0.4600 | ± | 0.0501 |
| acc_norm | 0.4600 | ± | 0.0501 | ||
| hendrycksTest-high_school_chemistry | 1 | acc | 0.5222 | ± | 0.0351 |
| acc_norm | 0.5222 | ± | 0.0351 | ||
| hendrycksTest-college_biology | 1 | acc | 0.7222 | ± | 0.0375 |
| acc_norm | 0.7222 | ± | 0.0375 | ||
| hendrycksTest-high_school_biology | 1 | acc | 0.7355 | ± | 0.0251 |
| acc_norm | 0.7355 | ± | 0.0251 | ||
| winogrande | 0 | acc | 0.7758 | ± | 0.0117 |
This model was trained from base Mistral-7B-Instruct-v0.2 on 710 examples, 200 of which comes from camel-ai/biology set. The rest were scraped personally and consists of very long scientific articles and text books.
It beats Mistral-7B-Instruct-v0.2 in MMLU chemistry and biology. It should be able to generate mostly factual, basic and lengthy scientific text. I guess it could be "we have cosmopedia at home" for people who want to create cheap pretraining datasets from scratch.
Template:
[Context]
You are a helpful assistant. Read the instruction and write a response accordingly.
[User]
{prompt}
[Assistant]
Runs of Ba2han BioMistral-v0.2 on huggingface.co
9
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About BioMistral-v0.2 huggingface.co Model
Url of BioMistral-v0.2
BioMistral-v0.2 huggingface.co Url
Provider of BioMistral-v0.2 huggingface.co
Other API from Ba2han
Total runs:
750
Run Growth:
0
Growth Rate:
0.00%
Total runs:
448
Run Growth:
448
Growth Rate:
100.00%
Total runs:
289
Run Growth:
-3.7K
Growth Rate:
-1266.78%
Total runs:
155
Run Growth:
146
Growth Rate:
94.19%
Total runs:
126
Run Growth:
0
Growth Rate:
0.00%
Total runs:
110
Run Growth:
-1.3K
Growth Rate:
-1170.00%
Total runs:
79
Run Growth:
-222
Growth Rate:
-281.01%
Total runs:
74
Run Growth:
23
Growth Rate:
31.08%
Total runs:
71
Run Growth:
-33
Growth Rate:
-46.48%
Total runs:
62
Run Growth:
11
Growth Rate:
18.33%
Total runs:
61
Run Growth:
8
Growth Rate:
13.11%
Total runs:
56
Run Growth:
56
Growth Rate:
100.00%
Total runs:
56
Run Growth:
30
Growth Rate:
53.57%
Total runs:
49
Run Growth:
-287
Growth Rate:
-585.71%
Total runs:
46
Run Growth:
-5
Growth Rate:
-10.87%
Total runs:
45
Run Growth:
-297
Growth Rate:
-660.00%
Total runs:
30
Run Growth:
30
Growth Rate:
100.00%
Total runs:
29
Run Growth:
2
Growth Rate:
6.90%
Total runs:
29
Run Growth:
11
Growth Rate:
37.93%
Total runs:
27
Run Growth:
20
Growth Rate:
74.07%
Total runs:
23
Run Growth:
0
Growth Rate:
0.00%
Total runs:
14
Run Growth:
3
Growth Rate:
21.43%
Total runs:
12
Run Growth:
6
Growth Rate:
50.00%
Total runs:
12
Run Growth:
5
Growth Rate:
41.67%
Total runs:
12
Run Growth:
-9
Growth Rate:
-75.00%
Total runs:
10
Run Growth:
-2
Growth Rate:
-20.00%
Total runs:
9
Run Growth:
-8
Growth Rate:
-88.89%
Total runs:
9
Run Growth:
-43
Growth Rate:
-477.78%
Total runs:
8
Run Growth:
-69
Growth Rate:
-862.50%
Total runs:
7
Run Growth:
-1
Growth Rate:
-14.29%
Total runs:
6
Run Growth:
-5
Growth Rate:
-83.33%
Total runs:
6
Run Growth:
1
Growth Rate:
16.67%
Total runs:
6
Run Growth:
-4
Growth Rate:
-66.67%
Total runs:
6
Run Growth:
-3
Growth Rate:
-50.00%
Total runs:
6
Run Growth:
-8
Growth Rate:
-133.33%
Total runs:
5
Run Growth:
-2
Growth Rate:
-40.00%
Total runs:
5
Run Growth:
3
Growth Rate:
60.00%
Total runs:
5
Run Growth:
3
Growth Rate:
60.00%
Total runs:
5
Run Growth:
-9
Growth Rate:
-180.00%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%
Total runs:
5
Run Growth:
-3
Growth Rate:
-60.00%
Total runs:
4
Run Growth:
-31
Growth Rate:
-775.00%
Total runs:
4
Run Growth:
1
Growth Rate:
25.00%
Total runs:
4
Run Growth:
-3
Growth Rate:
-75.00%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
-7
Growth Rate:
-233.33%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%