bio-distilbert-cased huggingface.co api & nlpie bio-distilbert-cased github AI Model

Introduction of bio-distilbert-cased

Model Details of bio-distilbert-cased

Model Description

BioDistilBERT-cased was developed by training the DistilBERT-cased model in a continual learning fashion for 200k training steps using a total batch size of 192 on the PubMed dataset.

Initialisation

We initialise our model with the pre-trained checkpoints of the DistilBERT-cased model available on Huggingface.

Architecture

In this model, the size of the hidden dimension and the embedding layer are both set to 768. The vocabulary size is 28996. The number of transformer layers is 6 and the expansion rate of the feed-forward layer is 4. Overall, this model has around 65 million parameters.

Citation

If you use this model, please consider citing the following paper:

@article{rohanian2023effectiveness,
  title={On the effectiveness of compact biomedical transformers},
  author={Rohanian, Omid and Nouriborji, Mohammadmahdi and Kouchaki, Samaneh and Clifton, David A},
  journal={Bioinformatics},
  volume={39},
  number={3},
  pages={btad103},
  year={2023},
  publisher={Oxford University Press}
}

Runs of nlpie bio-distilbert-cased on huggingface.co

Total runs

24-hour runs

3-day runs

7-day runs

30-day runs

More Information About bio-distilbert-cased huggingface.co Model

More bio-distilbert-cased license Visit here:

https://choosealicense.com/licenses/mit

bio-distilbert-cased huggingface.co

bio-distilbert-cased huggingface.co is an AI model on huggingface.co that provides bio-distilbert-cased's model effect (), which can be used instantly with this nlpie bio-distilbert-cased model. huggingface.co supports a free trial of the bio-distilbert-cased model, and also provides paid use of the bio-distilbert-cased. Support call bio-distilbert-cased model through api, including Node.js, Python, http.

bio-distilbert-cased huggingface.co Url

https://huggingface.co/nlpie/bio-distilbert-cased

nlpie bio-distilbert-cased online free

bio-distilbert-cased huggingface.co is an online trial and call api platform, which integrates bio-distilbert-cased's modeling effects, including api services, and provides a free online trial of bio-distilbert-cased, you can try bio-distilbert-cased online for free by clicking the link below.

nlpie bio-distilbert-cased online free url in huggingface.co:

https://huggingface.co/nlpie/bio-distilbert-cased

bio-distilbert-cased install

bio-distilbert-cased is an open source model from GitHub that offers a free installation service, and any user can find bio-distilbert-cased on GitHub to install. At the same time, huggingface.co provides the effect of bio-distilbert-cased install, users can directly use bio-distilbert-cased installed effect in huggingface.co for debugging and trial. It also supports api for free installation.