allenai / biomed_roberta_base

huggingface.co
Total runs: 26.6K
24-hour runs: 1.6K
7-day runs: 1.5K
30-day runs: 3.2K
Model's Last Updated: October 04 2022

Introduction of biomed_roberta_base

Model Details of biomed_roberta_base

BioMed-RoBERTa-base

BioMed-RoBERTa-base is a language model based on the RoBERTa-base (Liu et. al, 2019) architecture. We adapt RoBERTa-base to 2.68 million scientific papers from the Semantic Scholar corpus via continued pretraining. This amounts to 7.55B tokens and 47GB of data. We use the full text of the papers in training, not just abstracts.

Specific details of the adaptive pretraining procedure can be found in Gururangan et. al, 2020.

Evaluation

BioMed-RoBERTa achieves competitive performance to state of the art models on a number of NLP tasks in the biomedical domain (numbers are mean (standard deviation) over 3+ random seeds)

Task Task Type RoBERTa-base BioMed-RoBERTa-base
RCT-180K Text Classification 86.4 (0.3) 86.9 (0.2)
ChemProt Relation Extraction 81.1 (1.1) 83.0 (0.7)
JNLPBA NER 74.3 (0.2) 75.2 (0.1)
BC5CDR NER 85.6 (0.1) 87.8 (0.1)
NCBI-Disease NER 86.6 (0.3) 87.1 (0.8)

More evaluations TBD.

Citation

If using this model, please cite the following paper:

@inproceedings{domains,
 author = {Suchin Gururangan and Ana Marasović and Swabha Swayamdipta and Kyle Lo and Iz Beltagy and Doug Downey and Noah A. Smith},
 title = {Don't Stop Pretraining: Adapt Language Models to Domains and Tasks},
 year = {2020},
 booktitle = {Proceedings of ACL},
}

Runs of allenai biomed_roberta_base on huggingface.co

26.6K
Total runs
1.6K
24-hour runs
1.8K
3-day runs
1.5K
7-day runs
3.2K
30-day runs

More Information About biomed_roberta_base huggingface.co Model

biomed_roberta_base huggingface.co

biomed_roberta_base huggingface.co is an AI model on huggingface.co that provides biomed_roberta_base's model effect (), which can be used instantly with this allenai biomed_roberta_base model. huggingface.co supports a free trial of the biomed_roberta_base model, and also provides paid use of the biomed_roberta_base. Support call biomed_roberta_base model through api, including Node.js, Python, http.

biomed_roberta_base huggingface.co Url

https://huggingface.co/allenai/biomed_roberta_base

allenai biomed_roberta_base online free

biomed_roberta_base huggingface.co is an online trial and call api platform, which integrates biomed_roberta_base's modeling effects, including api services, and provides a free online trial of biomed_roberta_base, you can try biomed_roberta_base online for free by clicking the link below.

allenai biomed_roberta_base online free url in huggingface.co:

https://huggingface.co/allenai/biomed_roberta_base

biomed_roberta_base install

biomed_roberta_base is an open source model from GitHub that offers a free installation service, and any user can find biomed_roberta_base on GitHub to install. At the same time, huggingface.co provides the effect of biomed_roberta_base install, users can directly use biomed_roberta_base installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

biomed_roberta_base install url in huggingface.co:

https://huggingface.co/allenai/biomed_roberta_base

Url of biomed_roberta_base

biomed_roberta_base huggingface.co Url

Provider of biomed_roberta_base huggingface.co

allenai
ORGANIZATIONS

Other API from allenai

huggingface.co

Total runs: 1.1M
Run Growth: 355.2K
Growth Rate: 33.34%
Updated:December 04 2024
huggingface.co

Total runs: 146.4K
Run Growth: 19.3K
Growth Rate: 13.21%
Updated:July 28 2025
huggingface.co

Total runs: 136.2K
Run Growth: -2.6K
Growth Rate: -1.93%
Updated:January 23 2026
huggingface.co

Total runs: 114.5K
Run Growth: -141.3K
Growth Rate: -123.42%
Updated:January 23 2026
huggingface.co

Total runs: 100.0K
Run Growth: 37.8K
Growth Rate: 37.79%
Updated:January 23 2026
huggingface.co

Total runs: 55.7K
Run Growth: 53.5K
Growth Rate: 95.99%
Updated:October 10 2025
huggingface.co

Total runs: 38.2K
Run Growth: 10.4K
Growth Rate: 27.18%
Updated:August 15 2024
huggingface.co

Total runs: 21.6K
Run Growth: 4.8K
Growth Rate: 22.37%
Updated:October 18 2023
huggingface.co

Total runs: 11.5K
Run Growth: -434
Growth Rate: -12.70%
Updated:May 23 2026
huggingface.co

Total runs: 7.2K
Run Growth: 1.3K
Growth Rate: 18.08%
Updated:April 11 2026
huggingface.co

Total runs: 5.1K
Run Growth: 1.2K
Growth Rate: 23.17%
Updated:December 04 2024
huggingface.co

Total runs: 4.5K
Run Growth: -25.0K
Growth Rate: -543.08%
Updated:June 23 2026
huggingface.co

Total runs: 4.4K
Run Growth: -1.2K
Growth Rate: -27.97%
Updated:July 17 2024
huggingface.co

Total runs: 3.9K
Run Growth: -788
Growth Rate: -20.07%
Updated:March 19 2026
huggingface.co

Total runs: 3.9K
Run Growth: -341
Growth Rate: -8.79%
Updated:June 23 2026
huggingface.co

Total runs: 3.3K
Run Growth: -998
Growth Rate: -30.33%
Updated:July 17 2024
huggingface.co

Total runs: 3.0K
Run Growth: 3.0K
Growth Rate: 100.00%
Updated:June 23 2026
huggingface.co

Total runs: 2.6K
Run Growth: -3.3K
Growth Rate: -127.96%
Updated:May 21 2026
huggingface.co

Total runs: 2.0K
Run Growth: -2.4K
Growth Rate: -119.11%
Updated:October 09 2025
huggingface.co

Total runs: 1.7K
Run Growth: -390
Growth Rate: -22.47%
Updated:April 11 2026