Total runs:
31.5K
Run Growth:
-8.5K
Growth Rate:
-26.87%
Sponsored by
APIMaster
FreedomIntelligence / Apollo2-9B
Model's Last Updated: April 10 2025
question-answering
Introduction of Apollo2-9B
Model Details of Apollo2-9B
Democratizing Medical LLMs For Much More Languages
Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish, Arabic, Russian, Japanese, Korean, German, Italian, Portuguese and 38 Minor Languages So far.
📃 Paper • 🌐 Demo • 🤗 ApolloMoEDataset • 🤗 ApolloMoEBench • 🤗 Models •🌐 Apollo • 🌐 ApolloMoE
🌈 Update
- [2024.10.15] ApolloMoE repo is published！🎉
Languages Coverage
12 Major Languages and 38 Minor Languages
Click to view the Languages Coverage
Architecture
Click to view the MoE routing image
Results
Dense
🤗 Apollo2-0.5B • 🤗 Apollo2-1.5B • 🤗 Apollo2-2B
🤗 Apollo2-3.8B • 🤗 Apollo2-7B • 🤗 Apollo2-9B
Click to view the Dense Models Results
Post-MoE
🤗 Apollo-MoE-0.5B • 🤗 Apollo-MoE-1.5B • 🤗 Apollo-MoE-7B
Click to view the Post-MoE Models Results
Usage Format
Apollo2
- 0.5B, 1.5B, 7B: User:{query}\nAssistant:{response}<|endoftext|>
- 2B, 9B: User:{query}\nAssistant:{response}<eos>
- 3.8B: <|user|>\n{query}<|end|><|assisitant|>\n{response}<|end|>
Apollo-MoE
- 0.5B, 1.5B, 7B: User:{query}\nAssistant:{response}<|endoftext|>
Dataset & Evaluation
-
Dataset 🤗 ApolloMoEDataset
-
Evaluation 🤗 ApolloMoEBench
Click to expand
-
EN:
- MedQA-USMLE
- MedMCQA
- PubMedQA : Because the results fluctuated too much, they were not used in the paper.
-
MMLU-Medical
- Clinical knowledge, Medical genetics, Anatomy, Professional medicine, College biology, College medicine
-
ZH:
- MedQA-MCMLE
-
CMB-single
: Not used in the paper
- Randomly sample 2,000 multiple-choice questions with single answer.
-
CMMLU-Medical
- Anatomy, Clinical_knowledge, College_medicine, Genetics, Nutrition, Traditional_chinese_medicine, Virology
-
CExam
: Not used in the paper
- Randomly sample 2,000 multiple-choice questions
-
ES: Head_qa
-
FR:
- Frenchmedmcqa
-
[MMLU_FR]
- Clinical knowledge, Medical genetics, Anatomy, Professional medicine, College biology, College medicine
-
HI: MMLU_HI
- Clinical knowledge, Medical genetics, Anatomy, Professional medicine, College biology, College medicine
-
AR: MMLU_AR
- Clinical knowledge, Medical genetics, Anatomy, Professional medicine, College biology, College medicine
-
JA: IgakuQA
-
KO: KorMedMCQA
-
IT:
- MedExpQA
-
[MMLU_IT]
- Clinical knowledge, Medical genetics, Anatomy, Professional medicine, College biology, College medicine
-
DE: BioInstructQA : German part
-
PT: BioInstructQA : Portuguese part
-
RU: RuMedBench
-
Results reproduction
Click to expand
We take Apollo2-7B or Apollo-MoE-0.5B as example
-
Download Dataset for project:
bash 0.download_data.sh -
Prepare test and dev data for specific model:
- Create test data for with special token
bash 1.data_process_test&dev.sh -
Prepare train data for specific model (Create tokenized data in advance):
- You can adjust data Training order and Training Epoch in this step
bash 2.data_process_train.sh -
Train the model
- If you want to train in Multi Nodes please refer to ./src/sft/training_config/zero_multi.yaml
bash 3.single_node_train.sh -
Evaluate your model: Generate score for benchmark
bash 4.eval.sh
Citation
Please use the following citation if you intend to use our dataset for training or evaluation:
@misc{zheng2024efficientlydemocratizingmedicalllms,
title={Efficiently Democratizing Medical LLMs for 50 Languages via a Mixture of Language Family Experts},
author={Guorui Zheng and Xidong Wang and Juhao Liang and Nuo Chen and Yuping Zheng and Benyou Wang},
year={2024},
eprint={2410.10626},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2410.10626},
}
Runs of FreedomIntelligence Apollo2-9B on huggingface.co
96
Total runs
2
24-hour runs
2
3-day runs
-7
7-day runs
43
30-day runs
More Information About Apollo2-9B huggingface.co Model
Url of Apollo2-9B
Apollo2-9B huggingface.co Url
Provider of Apollo2-9B huggingface.co
Other API from FreedomIntelligence
Updated:January 17 2026
Total runs:
2.1K
Run Growth:
333
Growth Rate:
18.11%
Total runs:
1.4K
Run Growth:
769
Growth Rate:
54.81%
Total runs:
1.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.3K
Run Growth:
37
Growth Rate:
2.55%
Total runs:
857
Run Growth:
109
Growth Rate:
12.54%
Total runs:
833
Run Growth:
73
Growth Rate:
8.44%
Total runs:
655
Run Growth:
449
Growth Rate:
69.18%
Total runs:
643
Run Growth:
410
Growth Rate:
63.76%
Total runs:
601
Run Growth:
0
Growth Rate:
0.00%
Total runs:
545
Run Growth:
-501
Growth Rate:
-93.30%
Total runs:
497
Run Growth:
-180
Growth Rate:
-36.07%
Total runs:
486
Run Growth:
146
Growth Rate:
30.17%
Total runs:
375
Run Growth:
4
Growth Rate:
1.07%
Total runs:
328
Run Growth:
70
Growth Rate:
20.23%
Total runs:
304
Run Growth:
-105
Growth Rate:
-30.70%
Total runs:
287
Run Growth:
177
Growth Rate:
61.67%
Total runs:
286
Run Growth:
257
Growth Rate:
93.12%
Total runs:
274
Run Growth:
126
Growth Rate:
45.99%
Total runs:
271
Run Growth:
20
Growth Rate:
7.35%
Total runs:
260
Run Growth:
-17
Growth Rate:
-5.90%
Total runs:
240
Run Growth:
-71
Growth Rate:
-30.08%
Total runs:
206
Run Growth:
146
Growth Rate:
80.22%
Total runs:
202
Run Growth:
161
Growth Rate:
79.70%
Total runs:
165
Run Growth:
57
Growth Rate:
31.67%
Total runs:
163
Run Growth:
79
Growth Rate:
49.38%
Total runs:
161
Run Growth:
114
Growth Rate:
70.81%
Total runs:
155
Run Growth:
38
Growth Rate:
24.52%
Total runs:
155
Run Growth:
-186
Growth Rate:
-119.23%
Total runs:
148
Run Growth:
89
Growth Rate:
60.96%
Total runs:
140
Run Growth:
-22
Growth Rate:
-17.60%
Total runs:
139
Run Growth:
110
Growth Rate:
79.71%
Total runs:
135
Run Growth:
47
Growth Rate:
34.81%
Total runs:
126
Run Growth:
9
Growth Rate:
6.98%
Total runs:
120
Run Growth:
112
Growth Rate:
96.55%
Total runs:
118
Run Growth:
-61
Growth Rate:
-54.95%
Total runs:
115
Run Growth:
0
Growth Rate:
0.00%
Total runs:
113
Run Growth:
-13
Growth Rate:
-12.04%
Total runs:
111
Run Growth:
0
Growth Rate:
0.00%
Total runs:
106
Run Growth:
77
Growth Rate:
88.51%
Total runs:
103
Run Growth:
1
Growth Rate:
0.97%
Total runs:
102
Run Growth:
-131
Growth Rate:
-128.43%
Total runs:
100
Run Growth:
-182
Growth Rate:
-175.00%
Total runs:
98
Run Growth:
-73
Growth Rate:
-78.49%
Total runs:
97
Run Growth:
-214
Growth Rate:
-196.33%
Total runs:
88
Run Growth:
21
Growth Rate:
26.25%
Total runs:
84
Run Growth:
64
Growth Rate:
76.19%
Total runs:
76
Run Growth:
56
Growth Rate:
87.50%
Total runs:
74
Run Growth:
0
Growth Rate:
0.00%
Total runs:
73
Run Growth:
-30
Growth Rate:
-43.48%
Total runs:
69
Run Growth:
15
Growth Rate:
20.55%
Total runs:
69
Run Growth:
54
Growth Rate:
78.26%
Total runs:
68
Run Growth:
-8
Growth Rate:
-10.81%
Total runs:
66
Run Growth:
0
Growth Rate:
0.00%
Total runs:
65
Run Growth:
-103
Growth Rate:
-158.46%
Total runs:
64
Run Growth:
21
Growth Rate:
33.33%
Total runs:
64
Run Growth:
-11
Growth Rate:
-23.91%
Total runs:
62
Run Growth:
-57
Growth Rate:
-87.69%
Total runs:
57
Run Growth:
39
Growth Rate:
61.90%
Total runs:
56
Run Growth:
43
Growth Rate:
76.79%
Total runs:
55
Run Growth:
29
Growth Rate:
44.62%
Total runs:
53
Run Growth:
0
Growth Rate:
0.00%
Total runs:
50
Run Growth:
-858
Growth Rate:
-1716.00%
Total runs:
49
Run Growth:
-1
Growth Rate:
-2.04%
Total runs:
46
Run Growth:
-95
Growth Rate:
-206.52%
Total runs:
44
Run Growth:
44
Growth Rate:
100.00%
Total runs:
43
Run Growth:
15
Growth Rate:
35.71%
Total runs:
42
Run Growth:
29
Growth Rate:
63.04%
Total runs:
42
Run Growth:
14
Growth Rate:
33.33%
Total runs:
41
Run Growth:
10
Growth Rate:
23.26%
Total runs:
40
Run Growth:
-32
Growth Rate:
-78.05%
Total runs:
40
Run Growth:
8
Growth Rate:
17.78%
Total runs:
38
Run Growth:
11
Growth Rate:
32.35%
Total runs:
35
Run Growth:
11
Growth Rate:
28.21%
Total runs:
35
Run Growth:
0
Growth Rate:
0.00%
Total runs:
35
Run Growth:
0
Growth Rate:
0.00%
Total runs:
33
Run Growth:
16
Growth Rate:
53.33%
Total runs:
33
Run Growth:
19
Growth Rate:
57.58%
Total runs:
31
Run Growth:
8
Growth Rate:
23.53%
Total runs:
30
Run Growth:
25
Growth Rate:
83.33%
Total runs:
30
Run Growth:
14
Growth Rate:
43.75%
Total runs:
29
Run Growth:
-24
Growth Rate:
-85.71%
Total runs:
28
Run Growth:
13
Growth Rate:
41.94%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
25
Run Growth:
8
Growth Rate:
33.33%
Total runs:
24
Run Growth:
14
Growth Rate:
58.33%
Total runs:
24
Run Growth:
13
Growth Rate:
54.17%
Total runs:
23
Run Growth:
14
Growth Rate:
60.87%
Total runs:
22
Run Growth:
12
Growth Rate:
54.55%
Total runs:
22
Run Growth:
16
Growth Rate:
64.00%
Total runs:
22
Run Growth:
9
Growth Rate:
37.50%
Total runs:
21
Run Growth:
0
Growth Rate:
0.00%
Total runs:
21
Run Growth:
13
Growth Rate:
56.52%
Total runs:
20
Run Growth:
12
Growth Rate:
54.55%
Total runs:
19
Run Growth:
9
Growth Rate:
47.37%
Total runs:
18
Run Growth:
4
Growth Rate:
22.22%
Total runs:
17
Run Growth:
2
Growth Rate:
11.11%
Total runs:
16
Run Growth:
2
Growth Rate:
13.33%
Total runs:
15
Run Growth:
7
Growth Rate:
43.75%
Total runs:
15
Run Growth:
9
Growth Rate:
60.00%