gsarti / covidbert-nli

huggingface.co
Total runs: 12
24-hour runs: 0
7-day runs: -44
30-day runs: -42
Model's Last Updated: May 20 2021
feature-extraction

Introduction of covidbert-nli

Model Details of covidbert-nli

CovidBERT-NLI

This is the model CovidBERT trained by DeepSet on AllenAI's CORD19 Dataset of scientific articles about coronaviruses.

The model uses the original BERT wordpiece vocabulary and was subsequently fine-tuned on the SNLI and the MultiNLI datasets using the sentence-transformers library to produce universal sentence embeddings [1] using the average pooling strategy and a softmax loss .

Parameter details for the original training on CORD-19 are available on DeepSet's MLFlow

Base model : deepset/covid_bert_base from HuggingFace's AutoModel .

Training time : ~6 hours on the NVIDIA Tesla P100 GPU provided in Kaggle Notebooks.

Parameters :

Parameter Value
Batch size 64
Training steps 23000
Warmup steps 1450
Lowercasing True
Max. Seq. Length 128

Performances : The performance was evaluated on the test portion of the STS dataset using Spearman rank correlation and compared to the performances of similar models obtained with the same procedure to verify its performances.

Model Score
covidbert-nli (this) 67.52
gsarti/biobert-nli 73.40
gsarti/scibert-nli 74.50
bert-base-nli-mean-tokens [2] 77.12

An example usage for similarity-based scientific paper retrieval is provided in the Covid-19 Semantic Browser repository.

References:

[1] A. Conneau et al., Supervised Learning of Universal Sentence Representations from Natural Language Inference Data

[2] N. Reimers et I. Gurevych, Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Runs of gsarti covidbert-nli on huggingface.co

12
Total runs
0
24-hour runs
0
3-day runs
-44
7-day runs
-42
30-day runs

More Information About covidbert-nli huggingface.co Model

covidbert-nli huggingface.co

covidbert-nli huggingface.co is an AI model on huggingface.co that provides covidbert-nli's model effect (), which can be used instantly with this gsarti covidbert-nli model. huggingface.co supports a free trial of the covidbert-nli model, and also provides paid use of the covidbert-nli. Support call covidbert-nli model through api, including Node.js, Python, http.

covidbert-nli huggingface.co Url

https://huggingface.co/gsarti/covidbert-nli

gsarti covidbert-nli online free

covidbert-nli huggingface.co is an online trial and call api platform, which integrates covidbert-nli's modeling effects, including api services, and provides a free online trial of covidbert-nli, you can try covidbert-nli online for free by clicking the link below.

gsarti covidbert-nli online free url in huggingface.co:

https://huggingface.co/gsarti/covidbert-nli

covidbert-nli install

covidbert-nli is an open source model from GitHub that offers a free installation service, and any user can find covidbert-nli on GitHub to install. At the same time, huggingface.co provides the effect of covidbert-nli install, users can directly use covidbert-nli installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

covidbert-nli install url in huggingface.co:

https://huggingface.co/gsarti/covidbert-nli

Url of covidbert-nli

covidbert-nli huggingface.co Url

Provider of covidbert-nli huggingface.co

gsarti
ORGANIZATIONS

Other API from gsarti

huggingface.co

Total runs: 1.0K
Run Growth: -45
Growth Rate: -4.35%
Updated:May 20 2021
huggingface.co

Total runs: 118
Run Growth: 32
Growth Rate: 21.33%
Updated:May 20 2021
huggingface.co

Total runs: 73
Run Growth: -104
Growth Rate: -146.48%
Updated:June 17 2024
huggingface.co

Total runs: 61
Run Growth: -26
Growth Rate: -42.62%
Updated:June 17 2024
huggingface.co

Total runs: 28
Run Growth: -54
Growth Rate: -192.86%
Updated:June 17 2024
huggingface.co

Total runs: 19
Run Growth: 2
Growth Rate: 10.53%
Updated:January 24 2024
huggingface.co

Total runs: 9
Run Growth: 1
Growth Rate: 11.11%
Updated:September 27 2021
huggingface.co

Total runs: 6
Run Growth: 0
Growth Rate: 0.00%
Updated:October 05 2021