bio-distilbert-uncased huggingface.co api & nlpie bio-distilbert-uncased github AI Model

Introduction of bio-distilbert-uncased

Model Details of bio-distilbert-uncased

Model Description

BioDistilBERT-uncased is the result of training the DistilBERT-uncased model in a continual learning fashion for 200k training steps using a total batch size of 192 on the PubMed dataset.

Initialisation

We initialise our model with the pre-trained checkpoints of the DistilBERT-uncased model available on Huggingface.

Architecture

In this model, the size of the hidden dimension and the embedding layer are both set to 768. The vocabulary size is 30522. The number of transformer layers is 6 and the expansion rate of the feed-forward layer is 4. Overall, this model has around 65 million parameters.

Citation

If you use this model, please consider citing the following paper:

@article{rohanian2023effectiveness,
  title={On the effectiveness of compact biomedical transformers},
  author={Rohanian, Omid and Nouriborji, Mohammadmahdi and Kouchaki, Samaneh and Clifton, David A},
  journal={Bioinformatics},
  volume={39},
  number={3},
  pages={btad103},
  year={2023},
  publisher={Oxford University Press}
}

Runs of nlpie bio-distilbert-uncased on huggingface.co

152

Total runs

24-hour runs

3-day runs

7-day runs

30-day runs

More Information About bio-distilbert-uncased huggingface.co Model

More bio-distilbert-uncased license Visit here:

https://choosealicense.com/licenses/mit

bio-distilbert-uncased huggingface.co

bio-distilbert-uncased huggingface.co is an AI model on huggingface.co that provides bio-distilbert-uncased's model effect (), which can be used instantly with this nlpie bio-distilbert-uncased model. huggingface.co supports a free trial of the bio-distilbert-uncased model, and also provides paid use of the bio-distilbert-uncased. Support call bio-distilbert-uncased model through api, including Node.js, Python, http.

bio-distilbert-uncased huggingface.co Url

https://huggingface.co/nlpie/bio-distilbert-uncased

nlpie bio-distilbert-uncased online free

bio-distilbert-uncased huggingface.co is an online trial and call api platform, which integrates bio-distilbert-uncased's modeling effects, including api services, and provides a free online trial of bio-distilbert-uncased, you can try bio-distilbert-uncased online for free by clicking the link below.

nlpie bio-distilbert-uncased online free url in huggingface.co:

https://huggingface.co/nlpie/bio-distilbert-uncased

bio-distilbert-uncased install

bio-distilbert-uncased is an open source model from GitHub that offers a free installation service, and any user can find bio-distilbert-uncased on GitHub to install. At the same time, huggingface.co provides the effect of bio-distilbert-uncased install, users can directly use bio-distilbert-uncased installed effect in huggingface.co for debugging and trial. It also supports api for free installation.