gsarti / biobert-nli

huggingface.co
Total runs: 399
24-hour runs: -18
7-day runs: -5
30-day runs: -465
Model's Last Updated: May 20 2021
feature-extraction

Introduction of biobert-nli

Model Details of biobert-nli

BioBERT-NLI

This is the model BioBERT [1] fine-tuned on the SNLI and the MultiNLI datasets using the sentence-transformers library to produce universal sentence embeddings [2].

The model uses the original BERT wordpiece vocabulary and was trained using the average pooling strategy and a softmax loss .

Base model : monologg/biobert_v1.1_pubmed from HuggingFace's AutoModel .

Training time : ~6 hours on the NVIDIA Tesla P100 GPU provided in Kaggle Notebooks.

Parameters :

Parameter Value
Batch size 64
Training steps 30000
Warmup steps 1450
Lowercasing False
Max. Seq. Length 128

Performances : The performance was evaluated on the test portion of the STS dataset using Spearman rank correlation and compared to the performances of a general BERT base model obtained with the same procedure to verify their similarity.

Model Score
biobert-nli (this) 73.40
gsarti/scibert-nli 74.50
bert-base-nli-mean-tokens [3] 77.12

An example usage for similarity-based scientific paper retrieval is provided in the Covid Papers Browser repository.

References:

[1] J. Lee et al, BioBERT: a pre-trained biomedical language representation model for biomedical text mining

[2] A. Conneau et al., Supervised Learning of Universal Sentence Representations from Natural Language Inference Data

[3] N. Reimers et I. Gurevych, Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Runs of gsarti biobert-nli on huggingface.co

399
Total runs
-18
24-hour runs
9
3-day runs
-5
7-day runs
-465
30-day runs

More Information About biobert-nli huggingface.co Model

biobert-nli huggingface.co

biobert-nli huggingface.co is an AI model on huggingface.co that provides biobert-nli's model effect (), which can be used instantly with this gsarti biobert-nli model. huggingface.co supports a free trial of the biobert-nli model, and also provides paid use of the biobert-nli. Support call biobert-nli model through api, including Node.js, Python, http.

biobert-nli huggingface.co Url

https://huggingface.co/gsarti/biobert-nli

gsarti biobert-nli online free

biobert-nli huggingface.co is an online trial and call api platform, which integrates biobert-nli's modeling effects, including api services, and provides a free online trial of biobert-nli, you can try biobert-nli online for free by clicking the link below.

gsarti biobert-nli online free url in huggingface.co:

https://huggingface.co/gsarti/biobert-nli

biobert-nli install

biobert-nli is an open source model from GitHub that offers a free installation service, and any user can find biobert-nli on GitHub to install. At the same time, huggingface.co provides the effect of biobert-nli install, users can directly use biobert-nli installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

biobert-nli install url in huggingface.co:

https://huggingface.co/gsarti/biobert-nli

Url of biobert-nli

biobert-nli huggingface.co Url

Provider of biobert-nli huggingface.co

gsarti
ORGANIZATIONS

Other API from gsarti

huggingface.co

Total runs: 150
Run Growth: 74
Growth Rate: 49.33%
Updated:June 17 2024
huggingface.co

Total runs: 85
Run Growth: 38
Growth Rate: 44.71%
Updated:June 17 2024
huggingface.co

Total runs: 73
Run Growth: -7
Growth Rate: -9.59%
Updated:May 20 2021
huggingface.co

Total runs: 29
Run Growth: 1
Growth Rate: 3.45%
Updated:June 17 2024
huggingface.co

Total runs: 17
Run Growth: -2
Growth Rate: -11.76%
Updated:January 24 2024
huggingface.co

Total runs: 9
Run Growth: 0
Growth Rate: 0.00%
Updated:September 27 2021
huggingface.co

Total runs: 7
Run Growth: 1
Growth Rate: 14.29%
Updated:October 05 2021