Total runs:
58.1M
Run Growth:
-6.4M
Growth Rate:
-11.08%
Sponsored by
APIMart
BAAI / OPI-Llama-3.1-8B-Instruct
Model's Last Updated: March 12 2025
text-generation
Introduction of OPI-Llama-3.1-8B-Instruct
Model Details of OPI-Llama-3.1-8B-Instruct
Model Card of OPI-Llama-3.1-8B-Instruct
OPI-Llama-3.1-8B-Instruct was fine-tuned from the Meta-Llama-3.1-8B-Instruct model using the complete OPI dataset (i.e., OPI_full_1.61M.json ). For more details of training and testing, please visit https://github.com/baaihealth/opi .
Evaluation of OPI-Llama-3.1-8B-Instruct on 9 tasks
Each testing result is derived from the Meta-Llama-3.1-8B-Instruct model that has been fine-tuned using OPI_full_1.61M.json and subsequently evaluated on the respective testing set for each specific task.
| Task Type | Task Name | Testing file | Accuracy | Precision | Recall | F1 | Rouge-L |
|---|---|---|---|---|---|---|---|
| Sequence Understanding | EC Number Prediction (split100) | CLEAN_EC_number_new_test | - | 0.3724 | 0.3374 | 0.3468 | - |
| CLEAN_EC_number_price_test | - | 0.0738 | 0.0738 | 0.0738 | - | ||
| Fold Type Prediction | fold_type_test_Fold_Holdout | 0.1045 | - | - | - | - | |
| fold_type_test_Superfamily_Holdout | 0.1507 | - | - | - | - | ||
| fold_type_test_Family_Holdout | 0.6145 | - | - | - | - | ||
| Subcellular Localization Prediction | subcell_loc_test | 0.4214 | - | - | - | - | |
| Annotation Prediction | Function Keywords Prediction | CASPSimilarSeq_keywords_test | - | 0.4202 | 0.5057 | 0.4385 | - |
| IDFilterSeq_keywords_test | - | 0.6762 | 0.6905 | 0.6650 | - | ||
| UniProtSeq_keywords_test | - | 0.7606 | 0.7489 | 0.7374 | - | ||
| Gene Ontology(GO) Terms Prediction | CASPSimilarSeq_go_terms_test | - | 0.1113 | 0.0936 | 0.099 | - | |
| IDFilterSeq_go_terms_test | - | 0.6686 | 0.6287 | 0.6304 | - | ||
| UniProtSeq_go_terms_test | - | 0.7150 | 0.6897 | 0.6849 | - | ||
| Function Description Prediction | CASPSimilarSeq_function_test | - | - | - | - | 0.7524 | |
| IDFilterSeq_function_test | - | - | - | - | 0.4786 | ||
| UniProtSeq_function_test | - | - | - | - | 0.5144 | ||
| Knowledge Mining | Tissue Location Prediction from Gene Symbol | gene_symbol_to_tissue_test | - | 0.4002 | 0.9356 | 0.5466 | - |
| Cancer Prediction from Gene Symbol | gene_symbol_to_cancer_test | - | 0.2890 | 0.2701 | 0.2664 | - | |
| Cancer Prediction from Gene Name | gene_name_to_cancer_test | - | 0.2786 | 0.2707 | 0.2659 | - |
Prediction comparison with SOTA mdoels
Runs of BAAI OPI-Llama-3.1-8B-Instruct on huggingface.co
156
Total runs
0
24-hour runs
9
3-day runs
12
7-day runs
22
30-day runs
More Information About OPI-Llama-3.1-8B-Instruct huggingface.co Model
Url of OPI-Llama-3.1-8B-Instruct
OPI-Llama-3.1-8B-Instruct huggingface.co Url
Provider of OPI-Llama-3.1-8B-Instruct huggingface.co
Other API from BAAI
Updated:February 22 2024
Total runs:
15.7M
Run Growth:
-2.1M
Growth Rate:
-13.37%
Total runs:
10.0M
Run Growth:
-1.6M
Growth Rate:
-15.61%
Total runs:
9.0M
Run Growth:
-1.5M
Growth Rate:
-17.17%
Total runs:
3.8M
Run Growth:
-1.3M
Growth Rate:
-33.77%
Total runs:
3.4M
Run Growth:
-579.8K
Growth Rate:
-16.91%
Total runs:
2.1M
Run Growth:
-732.4K
Growth Rate:
-35.21%
Total runs:
381.6K
Run Growth:
-425.8K
Growth Rate:
-111.58%
Total runs:
343.3K
Run Growth:
-767.9K
Growth Rate:
-223.70%
Total runs:
191.1K
Run Growth:
-29.1K
Growth Rate:
-15.21%
Total runs:
167.2K
Run Growth:
-109.2K
Growth Rate:
-65.34%
Total runs:
149.6K
Run Growth:
-14.9K
Growth Rate:
-9.95%
Total runs:
37.4K
Run Growth:
-29.0K
Growth Rate:
-77.38%
Total runs:
16.7K
Run Growth:
-169.9K
Growth Rate:
-1006.85%
Total runs:
16.5K
Run Growth:
-298
Growth Rate:
-1.81%
Total runs:
8.8K
Run Growth:
126
Growth Rate:
1.43%
Total runs:
8.7K
Run Growth:
14
Growth Rate:
0.16%
Total runs:
2.9K
Run Growth:
-877
Growth Rate:
-30.24%
Total runs:
1.9K
Run Growth:
-550
Growth Rate:
-28.28%
Total runs:
1.4K
Run Growth:
-2.2K
Growth Rate:
-151.44%
Total runs:
1.2K
Run Growth:
312
Growth Rate:
26.55%
Total runs:
743
Run Growth:
-2.3K
Growth Rate:
-308.75%
Total runs:
664
Run Growth:
0
Growth Rate:
0.00%
Total runs:
644
Run Growth:
0
Growth Rate:
0.00%
Total runs:
578
Run Growth:
-173
Growth Rate:
-29.93%
Total runs:
519
Run Growth:
-727
Growth Rate:
-140.08%
Total runs:
393
Run Growth:
-9.8K
Growth Rate:
-2490.33%
Total runs:
367
Run Growth:
-194
Growth Rate:
-52.86%
Total runs:
245
Run Growth:
45
Growth Rate:
18.37%
Total runs:
201
Run Growth:
44
Growth Rate:
21.89%
Total runs:
201
Run Growth:
22
Growth Rate:
10.95%
Total runs:
194
Run Growth:
32
Growth Rate:
16.49%
Total runs:
193
Run Growth:
0
Growth Rate:
0.00%