Total runs:
260
Run Growth:
167
Growth Rate:
64.23%
Sponsored by
PoYo.AI
nicoboss / Apollo2-9B-llamacppfixed
Model's Last Updated: October 17 2024
question-answering
Introduction of Apollo2-9B-llamacppfixed
Model Details of Apollo2-9B-llamacppfixed
Democratizing Medical LLMs For Much More Languages
Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish, Arabic, Russian, Japanese, Korean, German, Italian, Portuguese and 38 Minor Languages So far.
📃 Paper • 🌐 Demo • 🤗 ApolloMoEDataset • 🤗 ApolloMoEBench • 🤗 Models •🌐 Apollo • 🌐 ApolloMoE
🌈 Update
- [2024.10.15] ApolloMoE repo is published！🎉
Languages Coverage
12 Major Languages and 38 Minor Languages
Click to view the Languages Coverage
Architecture
Click to view the MoE routing image
Results
Dense
🤗 Apollo2-0.5B • 🤗 Apollo2-1.5B • 🤗 Apollo2-2B
🤗 Apollo2-3.8B • 🤗 Apollo2-7B • 🤗 Apollo2-9B
Click to view the Dense Models Results
Post-MoE
🤗 Apollo-MoE-0.5B • 🤗 Apollo-MoE-1.5B • 🤗 Apollo-MoE-7B
Click to view the Post-MoE Models Results
Usage Format
Apollo2
- 0.5B, 1.5B, 7B: User:{query}\nAssistant:{response}<|endoftext|>
- 2B, 9B: User:{query}\nAssistant:{response}<eos>
- 3.8B: <|user|>\n{query}<|end|><|assisitant|>\n{response}<|end|>
Apollo-MoE
- 0.5B, 1.5B, 7B: User:{query}\nAssistant:{response}<|endoftext|>
Dataset & Evaluation
-
Dataset 🤗 ApolloMoEDataset
-
Evaluation 🤗 ApolloMoEBench
Click to expand
-
EN:
- MedQA-USMLE
- MedMCQA
- PubMedQA : Because the results fluctuated too much, they were not used in the paper.
-
MMLU-Medical
- Clinical knowledge, Medical genetics, Anatomy, Professional medicine, College biology, College medicine
-
ZH:
- MedQA-MCMLE
-
CMB-single
: Not used in the paper
- Randomly sample 2,000 multiple-choice questions with single answer.
-
CMMLU-Medical
- Anatomy, Clinical_knowledge, College_medicine, Genetics, Nutrition, Traditional_chinese_medicine, Virology
-
CExam
: Not used in the paper
- Randomly sample 2,000 multiple-choice questions
-
ES: Head_qa
-
FR:
- Frenchmedmcqa
-
[MMLU_FR]
- Clinical knowledge, Medical genetics, Anatomy, Professional medicine, College biology, College medicine
-
HI: MMLU_HI
- Clinical knowledge, Medical genetics, Anatomy, Professional medicine, College biology, College medicine
-
AR: MMLU_AR
- Clinical knowledge, Medical genetics, Anatomy, Professional medicine, College biology, College medicine
-
JA: IgakuQA
-
KO: KorMedMCQA
-
IT:
- MedExpQA
-
[MMLU_IT]
- Clinical knowledge, Medical genetics, Anatomy, Professional medicine, College biology, College medicine
-
DE: BioInstructQA : German part
-
PT: BioInstructQA : Portuguese part
-
RU: RuMedBench
-
Results reproduction
Click to expand
We take Apollo2-7B or Apollo-MoE-0.5B as example
-
Download Dataset for project:
bash 0.download_data.sh -
Prepare test and dev data for specific model:
- Create test data for with special token
bash 1.data_process_test&dev.sh -
Prepare train data for specific model (Create tokenized data in advance):
- You can adjust data Training order and Training Epoch in this step
bash 2.data_process_train.sh -
Train the model
- If you want to train in Multi Nodes please refer to ./src/sft/training_config/zero_multi.yaml
bash 3.single_node_train.sh -
Evaluate your model: Generate score for benchmark
bash 4.eval.sh
Citation
Please use the following citation if you intend to use our dataset for training or evaluation:
@misc{zheng2024efficientlydemocratizingmedicalllms,
title={Efficiently Democratizing Medical LLMs for 50 Languages via a Mixture of Language Family Experts},
author={Guorui Zheng and Xidong Wang and Juhao Liang and Nuo Chen and Yuping Zheng and Benyou Wang},
year={2024},
eprint={2410.10626},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2410.10626},
}
Runs of nicoboss Apollo2-9B-llamacppfixed on huggingface.co
24
Total runs
0
24-hour runs
0
3-day runs
1
7-day runs
20
30-day runs
More Information About Apollo2-9B-llamacppfixed huggingface.co Model
Url of Apollo2-9B-llamacppfixed
Apollo2-9B-llamacppfixed huggingface.co Url
Provider of Apollo2-9B-llamacppfixed huggingface.co
Other API from nicoboss
Updated:July 27 2025
Total runs:
160
Run Growth:
67
Growth Rate:
41.88%
Total runs:
62
Run Growth:
32
Growth Rate:
51.61%
Total runs:
61
Run Growth:
-60
Growth Rate:
-98.36%
Total runs:
58
Run Growth:
45
Growth Rate:
77.59%
Total runs:
55
Run Growth:
50
Growth Rate:
87.72%
Total runs:
53
Run Growth:
-14
Growth Rate:
-26.42%
Total runs:
39
Run Growth:
0
Growth Rate:
0.00%
Total runs:
39
Run Growth:
33
Growth Rate:
84.62%
Total runs:
32
Run Growth:
25
Growth Rate:
78.13%
Total runs:
31
Run Growth:
17
Growth Rate:
54.84%
Total runs:
29
Run Growth:
-4
Growth Rate:
-13.79%
Total runs:
29
Run Growth:
2
Growth Rate:
6.90%
Total runs:
21
Run Growth:
15
Growth Rate:
71.43%
Total runs:
20
Run Growth:
14
Growth Rate:
63.64%
Total runs:
18
Run Growth:
12
Growth Rate:
66.67%
Total runs:
18
Run Growth:
12
Growth Rate:
66.67%
Total runs:
16
Run Growth:
11
Growth Rate:
68.75%
Total runs:
16
Run Growth:
13
Growth Rate:
81.25%
Total runs:
15
Run Growth:
10
Growth Rate:
66.67%
Total runs:
13
Run Growth:
2
Growth Rate:
15.38%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
-24
Growth Rate:
-300.00%
Total runs:
7
Run Growth:
3
Growth Rate:
42.86%
Total runs:
7
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
2
Growth Rate:
33.33%
Total runs:
6
Run Growth:
5
Growth Rate:
83.33%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
1
Growth Rate:
20.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-3
Growth Rate:
-75.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
-3
Growth Rate:
-150.00%
Total runs:
2
Run Growth:
1
Growth Rate:
50.00%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
-11
Growth Rate:
-1100.00%
Total runs:
1
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
-3
Growth Rate:
-300.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-3
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-3
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-1
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
-15
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%