Total runs:
63.9M
Run Growth:
-10.2M
Growth Rate:
-16.01%
Sponsored by
PostMcpAi
BAAI / OPI-Llama-3.1-8B-Instruct
Model's Last Updated: March 12 2025
text-generation
Introduction of OPI-Llama-3.1-8B-Instruct
Model Details of OPI-Llama-3.1-8B-Instruct
Model Card of OPI-Llama-3.1-8B-Instruct
OPI-Llama-3.1-8B-Instruct was fine-tuned from the Meta-Llama-3.1-8B-Instruct model using the complete OPI dataset (i.e., OPI_full_1.61M.json ). For more details of training and testing, please visit https://github.com/baaihealth/opi .
Evaluation of OPI-Llama-3.1-8B-Instruct on 9 tasks
Each testing result is derived from the Meta-Llama-3.1-8B-Instruct model that has been fine-tuned using OPI_full_1.61M.json and subsequently evaluated on the respective testing set for each specific task.
| Task Type | Task Name | Testing file | Accuracy | Precision | Recall | F1 | Rouge-L |
|---|---|---|---|---|---|---|---|
| Sequence Understanding | EC Number Prediction (split100) | CLEAN_EC_number_new_test | - | 0.3724 | 0.3374 | 0.3468 | - |
| CLEAN_EC_number_price_test | - | 0.0738 | 0.0738 | 0.0738 | - | ||
| Fold Type Prediction | fold_type_test_Fold_Holdout | 0.1045 | - | - | - | - | |
| fold_type_test_Superfamily_Holdout | 0.1507 | - | - | - | - | ||
| fold_type_test_Family_Holdout | 0.6145 | - | - | - | - | ||
| Subcellular Localization Prediction | subcell_loc_test | 0.4214 | - | - | - | - | |
| Annotation Prediction | Function Keywords Prediction | CASPSimilarSeq_keywords_test | - | 0.4202 | 0.5057 | 0.4385 | - |
| IDFilterSeq_keywords_test | - | 0.6762 | 0.6905 | 0.6650 | - | ||
| UniProtSeq_keywords_test | - | 0.7606 | 0.7489 | 0.7374 | - | ||
| Gene Ontology(GO) Terms Prediction | CASPSimilarSeq_go_terms_test | - | 0.1113 | 0.0936 | 0.099 | - | |
| IDFilterSeq_go_terms_test | - | 0.6686 | 0.6287 | 0.6304 | - | ||
| UniProtSeq_go_terms_test | - | 0.7150 | 0.6897 | 0.6849 | - | ||
| Function Description Prediction | CASPSimilarSeq_function_test | - | - | - | - | 0.7524 | |
| IDFilterSeq_function_test | - | - | - | - | 0.4786 | ||
| UniProtSeq_function_test | - | - | - | - | 0.5144 | ||
| Knowledge Mining | Tissue Location Prediction from Gene Symbol | gene_symbol_to_tissue_test | - | 0.4002 | 0.9356 | 0.5466 | - |
| Cancer Prediction from Gene Symbol | gene_symbol_to_cancer_test | - | 0.2890 | 0.2701 | 0.2664 | - | |
| Cancer Prediction from Gene Name | gene_name_to_cancer_test | - | 0.2786 | 0.2707 | 0.2659 | - |
Prediction comparison with SOTA mdoels
Runs of BAAI OPI-Llama-3.1-8B-Instruct on huggingface.co
149
Total runs
1
24-hour runs
0
3-day runs
2
7-day runs
62
30-day runs
More Information About OPI-Llama-3.1-8B-Instruct huggingface.co Model
Url of OPI-Llama-3.1-8B-Instruct
OPI-Llama-3.1-8B-Instruct huggingface.co Url
Provider of OPI-Llama-3.1-8B-Instruct huggingface.co
Other API from BAAI
Updated:February 22 2024
Total runs:
18.0M
Run Growth:
-845.4K
Growth Rate:
-4.67%
Total runs:
12.4M
Run Growth:
-89.9K
Growth Rate:
-0.71%
Total runs:
10.4M
Run Growth:
-1.1M
Growth Rate:
-10.16%
Total runs:
5.0M
Run Growth:
97.3K
Growth Rate:
1.96%
Total runs:
3.8M
Run Growth:
-327.6K
Growth Rate:
-8.73%
Total runs:
1.2M
Run Growth:
-288.5K
Growth Rate:
-23.93%
Total runs:
793.7K
Run Growth:
-700.0K
Growth Rate:
-88.30%
Total runs:
237.5K
Run Growth:
96.3K
Growth Rate:
40.60%
Total runs:
233.6K
Run Growth:
-661.8K
Growth Rate:
-314.72%
Total runs:
223.4K
Run Growth:
-1.3M
Growth Rate:
-588.78%
Total runs:
163.5K
Run Growth:
-1.3K
Growth Rate:
-0.80%
Total runs:
54.9K
Run Growth:
-114.8K
Growth Rate:
-199.94%
Total runs:
16.7K
Run Growth:
798
Growth Rate:
4.78%
Total runs:
10.9K
Run Growth:
-15.4K
Growth Rate:
-140.42%
Total runs:
8.6K
Run Growth:
226
Growth Rate:
2.61%
Total runs:
8.6K
Run Growth:
360
Growth Rate:
4.18%
Total runs:
4.4K
Run Growth:
-2.0K
Growth Rate:
-44.74%
Total runs:
3.5K
Run Growth:
2.6K
Growth Rate:
73.26%
Total runs:
2.7K
Run Growth:
1.9K
Growth Rate:
69.10%
Total runs:
2.0K
Run Growth:
-535
Growth Rate:
-26.34%
Total runs:
1.2K
Run Growth:
-1.3K
Growth Rate:
-104.95%
Total runs:
846
Run Growth:
-145
Growth Rate:
-17.18%
Total runs:
664
Run Growth:
0
Growth Rate:
0.00%
Total runs:
651
Run Growth:
-862
Growth Rate:
-142.24%
Total runs:
644
Run Growth:
0
Growth Rate:
0.00%
Total runs:
618
Run Growth:
613
Growth Rate:
100.00%
Total runs:
519
Run Growth:
-764
Growth Rate:
-146.64%
Total runs:
330
Run Growth:
-291
Growth Rate:
-89.54%
Total runs:
276
Run Growth:
-3.9K
Growth Rate:
-1368.44%
Total runs:
190
Run Growth:
54
Growth Rate:
29.19%
Total runs:
174
Run Growth:
58
Growth Rate:
34.12%
Total runs:
168
Run Growth:
-545
Growth Rate:
-336.42%
Total runs:
155
Run Growth:
52
Growth Rate:
34.90%
Total runs:
149
Run Growth:
29
Growth Rate:
20.42%