Total runs:
31.5K
Run Growth:
-8.5K
Growth Rate:
-26.87%
Sponsored by
APIMaster
FreedomIntelligence / Apollo-MedJamba
Model's Last Updated: April 25 2024
text-generation
Introduction of Apollo-MedJamba
Model Details of Apollo-MedJamba
MedJamba
Multilingual Medical Model Based On Jamba
🌈 Update
- [2024.04.25] MedJamba Model is published！🎉
Results
🤗 Apollo-0.5B • 🤗 Apollo-1.8B • 🤗 Apollo-2B • 🤗 Apollo-6B • 🤗 Apollo-7B • 🤗 Apollo-34B • 🤗 Apollo-72B
🤗 MedJamba
🤗 Apollo-0.5B-GGUF • 🤗 Apollo-2B-GGUF • 🤗 Apollo-6B-GGUF • 🤗 Apollo-7B-GGUF
Dataset & Evaluation
-
Dataset 🤗 ApolloCorpus
Click to expand
- Zip File
-
Data category
-
Pretrain:
-
data item:
- json_name: {data_source} {language} {data_type}.json
- data_type: medicalBook, medicalGuideline, medicalPaper, medicalWeb(from online forum), medicalWiki
- language: en(English), zh(chinese), es(spanish), fr(french), hi(Hindi)
- data_type: qa(generated qa from text)
-
data_type==text: list of string
[ "string1", "string2", ... ] -
data_type==qa: list of qa pairs(list of string)
[ [ "q1", "a1", "q2", "a2", ... ], ... ]
-
data item:
-
SFT:
- json_name: {data_source}_{language}.json
- data_type: code, general, math, medicalExam, medicalPatient
-
data item: list of qa pairs(list of string)
[ [ "q1", "a1", "q2", "a2", ... ], ... ]
-
Pretrain:
-
Evaluation 🤗 XMedBench
Click to expand
-
EN:
- MedQA-USMLE
- MedMCQA
- PubMedQA : Because the results fluctuated too much, they were not used in the paper.
-
MMLU-Medical
- Clinical knowledge, Medical genetics, Anatomy, Professional medicine, College biology, College medicine
-
ZH:
- MedQA-MCMLE
-
CMB-single
: Not used in the paper
- Randomly sample 2,000 multiple-choice questions with single answer.
-
CMMLU-Medical
- Anatomy, Clinical_knowledge, College_medicine, Genetics, Nutrition, Traditional_chinese_medicine, Virology
-
CExam
: Not used in the paper
- Randomly sample 2,000 multiple-choice questions
-
ES: Head_qa
-
FR: Frenchmedmcqa
-
HI: MMLU_HI
- Clinical knowledge, Medical genetics, Anatomy, Professional medicine, College biology, College medicine
-
AR: MMLU_Ara
- Clinical knowledge, Medical genetics, Anatomy, Professional medicine, College biology, College medicine
-
Results reproduction
Click to expand
-
Download Dataset for project:
bash 0.download_data.sh -
Prepare test and dev for specific model:
- Create test data for with special token, you can use ./util/check.ipynb to check models' special tokens
bash 1.data_process_test&dev.sh -
Prepare train data for specific model (Create tokenized data in advance):
- You can adjust data Training order and Training Epoch in this step
bash 2.data_process_train.sh -
Train the model
- Multi Nodes refer to ./scripts/multi_node_train_*.sh
pip install causal-conv1d>=1.2.0 pip install mamba-ssmNode 0:
bash ./scripts/3.multinode_train_jamba_rank0.sh... Node 4:
bash ./scripts/3.multinode_train_jamba_rank4.sh -
Evaluate your model: Generate score for benchmark
bash 4.eval.sh -
Evaluate your model: Play with your ckpts in bash
python ./src/evaluate/cli_demo.py --model_name='./ckpts/your/path/tfmr'
To do
- Long Context Capability Evaluation and new Long-Med Benchmark
Acknowledgment
Citation
Please use the following citation if you intend to use our dataset for training or evaluation:
@misc{wang2024apollo,
title={Apollo: Lightweight Multilingual Medical LLMs towards Democratizing Medical AI to 6B People},
author={Xidong Wang and Nuo Chen and Junyin Chen and Yan Hu and Yidong Wang and Xiangbo Wu and Anningzhe Gao and Xiang Wan and Haizhou Li and Benyou Wang},
year={2024},
eprint={2403.03640},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
Runs of FreedomIntelligence Apollo-MedJamba on huggingface.co
73
Total runs
0
24-hour runs
-3
3-day runs
2
7-day runs
19
30-day runs
More Information About Apollo-MedJamba huggingface.co Model
Url of Apollo-MedJamba
Apollo-MedJamba huggingface.co Url
Provider of Apollo-MedJamba huggingface.co
Other API from FreedomIntelligence
Updated:January 17 2026
Total runs:
1.8K
Run Growth:
-306
Growth Rate:
-25.39%
Total runs:
1.4K
Run Growth:
194
Growth Rate:
12.75%
Total runs:
1.4K
Run Growth:
793
Growth Rate:
56.89%
Total runs:
1.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
869
Run Growth:
141
Growth Rate:
15.70%
Total runs:
865
Run Growth:
45
Growth Rate:
5.20%
Total runs:
649
Run Growth:
433
Growth Rate:
68.40%
Total runs:
643
Run Growth:
410
Growth Rate:
63.76%
Total runs:
601
Run Growth:
0
Growth Rate:
0.00%
Total runs:
537
Run Growth:
-578
Growth Rate:
-109.68%
Total runs:
499
Run Growth:
-224
Growth Rate:
-45.90%
Total runs:
484
Run Growth:
146
Growth Rate:
30.17%
Total runs:
375
Run Growth:
4
Growth Rate:
1.07%
Total runs:
346
Run Growth:
104
Growth Rate:
28.57%
Total runs:
342
Run Growth:
-57
Growth Rate:
-15.83%
Total runs:
288
Run Growth:
25
Growth Rate:
8.14%
Total runs:
287
Run Growth:
184
Growth Rate:
63.67%
Total runs:
276
Run Growth:
233
Growth Rate:
92.46%
Total runs:
274
Run Growth:
126
Growth Rate:
45.99%
Total runs:
272
Run Growth:
20
Growth Rate:
7.35%
Total runs:
236
Run Growth:
-71
Growth Rate:
-30.08%
Total runs:
202
Run Growth:
161
Growth Rate:
79.70%
Total runs:
182
Run Growth:
129
Growth Rate:
79.63%
Total runs:
180
Run Growth:
57
Growth Rate:
31.67%
Total runs:
161
Run Growth:
114
Growth Rate:
70.81%
Total runs:
160
Run Growth:
79
Growth Rate:
49.38%
Total runs:
156
Run Growth:
-186
Growth Rate:
-119.23%
Total runs:
155
Run Growth:
38
Growth Rate:
24.52%
Total runs:
146
Run Growth:
89
Growth Rate:
60.96%
Total runs:
138
Run Growth:
110
Growth Rate:
79.71%
Total runs:
135
Run Growth:
47
Growth Rate:
34.81%
Total runs:
129
Run Growth:
9
Growth Rate:
6.98%
Total runs:
125
Run Growth:
-50
Growth Rate:
-51.02%
Total runs:
116
Run Growth:
110
Growth Rate:
96.49%
Total runs:
115
Run Growth:
0
Growth Rate:
0.00%
Total runs:
111
Run Growth:
0
Growth Rate:
0.00%
Total runs:
111
Run Growth:
-42
Growth Rate:
-32.56%
Total runs:
109
Run Growth:
-214
Growth Rate:
-196.33%
Total runs:
108
Run Growth:
-14
Growth Rate:
-13.08%
Total runs:
104
Run Growth:
-182
Growth Rate:
-175.00%
Total runs:
103
Run Growth:
1
Growth Rate:
0.97%
Total runs:
102
Run Growth:
-101
Growth Rate:
-81.45%
Total runs:
93
Run Growth:
25
Growth Rate:
27.47%
Total runs:
93
Run Growth:
-39
Growth Rate:
-43.82%
Total runs:
87
Run Growth:
58
Growth Rate:
85.29%
Total runs:
82
Run Growth:
63
Growth Rate:
76.83%
Total runs:
80
Run Growth:
5
Growth Rate:
7.81%
Total runs:
74
Run Growth:
-8
Growth Rate:
-10.81%
Total runs:
74
Run Growth:
0
Growth Rate:
0.00%
Total runs:
69
Run Growth:
-35
Growth Rate:
-53.85%
Total runs:
69
Run Growth:
54
Growth Rate:
78.26%
Total runs:
66
Run Growth:
0
Growth Rate:
0.00%
Total runs:
65
Run Growth:
-103
Growth Rate:
-160.94%
Total runs:
65
Run Growth:
-24
Growth Rate:
-30.00%
Total runs:
65
Run Growth:
29
Growth Rate:
44.62%
Total runs:
64
Run Growth:
36
Growth Rate:
85.71%
Total runs:
63
Run Growth:
20
Growth Rate:
32.79%
Total runs:
63
Run Growth:
41
Growth Rate:
64.06%
Total runs:
56
Run Growth:
43
Growth Rate:
76.79%
Total runs:
53
Run Growth:
0
Growth Rate:
0.00%
Total runs:
50
Run Growth:
-858
Growth Rate:
-1716.00%
Total runs:
49
Run Growth:
-7
Growth Rate:
-15.91%
Total runs:
46
Run Growth:
31
Growth Rate:
65.96%
Total runs:
46
Run Growth:
-14
Growth Rate:
-31.82%
Total runs:
46
Run Growth:
-92
Growth Rate:
-200.00%
Total runs:
45
Run Growth:
8
Growth Rate:
17.78%
Total runs:
44
Run Growth:
44
Growth Rate:
100.00%
Total runs:
43
Run Growth:
11
Growth Rate:
25.58%
Total runs:
42
Run Growth:
14
Growth Rate:
33.33%
Total runs:
42
Run Growth:
12
Growth Rate:
30.00%
Total runs:
41
Run Growth:
-32
Growth Rate:
-78.05%
Total runs:
39
Run Growth:
15
Growth Rate:
37.50%
Total runs:
38
Run Growth:
1
Growth Rate:
2.63%
Total runs:
35
Run Growth:
0
Growth Rate:
0.00%
Total runs:
34
Run Growth:
9
Growth Rate:
25.71%
Total runs:
34
Run Growth:
16
Growth Rate:
45.71%
Total runs:
33
Run Growth:
20
Growth Rate:
60.61%
Total runs:
32
Run Growth:
14
Growth Rate:
43.75%
Total runs:
31
Run Growth:
16
Growth Rate:
50.00%
Total runs:
30
Run Growth:
25
Growth Rate:
83.33%
Total runs:
30
Run Growth:
18
Growth Rate:
58.06%
Total runs:
28
Run Growth:
-24
Growth Rate:
-85.71%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
25
Run Growth:
18
Growth Rate:
69.23%
Total runs:
24
Run Growth:
14
Growth Rate:
58.33%
Total runs:
24
Run Growth:
8
Growth Rate:
33.33%
Total runs:
24
Run Growth:
9
Growth Rate:
37.50%
Total runs:
23
Run Growth:
13
Growth Rate:
59.09%
Total runs:
23
Run Growth:
12
Growth Rate:
52.17%
Total runs:
23
Run Growth:
13
Growth Rate:
56.52%
Total runs:
22
Run Growth:
12
Growth Rate:
54.55%
Total runs:
22
Run Growth:
13
Growth Rate:
56.52%
Total runs:
21
Run Growth:
2
Growth Rate:
9.09%
Total runs:
19
Run Growth:
9
Growth Rate:
47.37%
Total runs:
18
Run Growth:
2
Growth Rate:
11.11%
Total runs:
18
Run Growth:
4
Growth Rate:
22.22%
Total runs:
16
Run Growth:
8
Growth Rate:
50.00%
Total runs:
16
Run Growth:
10
Growth Rate:
55.56%
Total runs:
15
Run Growth:
2
Growth Rate:
13.33%