gsarti / scibert-nli

huggingface.co
Total runs: 173
24-hour runs: 0
7-day runs: -1
30-day runs: -1.6K
Model's Last Updated: May 20 2021
feature-extraction

Introduction of scibert-nli

Model Details of scibert-nli

SciBERT-NLI

This is the model SciBERT [1] fine-tuned on the SNLI and the MultiNLI datasets using the sentence-transformers library to produce universal sentence embeddings [2].

The model uses the original scivocab wordpiece vocabulary and was trained using the average pooling strategy and a softmax loss .

Base model : allenai/scibert-scivocab-cased from HuggingFace's AutoModel .

Training time : ~4 hours on the NVIDIA Tesla P100 GPU provided in Kaggle Notebooks.

Parameters :

Parameter Value
Batch size 64
Training steps 20000
Warmup steps 1450
Lowercasing True
Max. Seq. Length 128

Performances : The performance was evaluated on the test portion of the STS dataset using Spearman rank correlation and compared to the performances of a general BERT base model obtained with the same procedure to verify their similarity.

Model Score
scibert-nli (this) 74.50
bert-base-nli-mean-tokens [3] 77.12

An example usage for similarity-based scientific paper retrieval is provided in the Covid Papers Browser repository.

References:

[1] I. Beltagy et al, SciBERT: A Pretrained Language Model for Scientific Text

[2] A. Conneau et al., Supervised Learning of Universal Sentence Representations from Natural Language Inference Data

[3] N. Reimers et I. Gurevych, Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Runs of gsarti scibert-nli on huggingface.co

173
Total runs
0
24-hour runs
14
3-day runs
-1
7-day runs
-1.6K
30-day runs

More Information About scibert-nli huggingface.co Model

scibert-nli huggingface.co

scibert-nli huggingface.co is an AI model on huggingface.co that provides scibert-nli's model effect (), which can be used instantly with this gsarti scibert-nli model. huggingface.co supports a free trial of the scibert-nli model, and also provides paid use of the scibert-nli. Support call scibert-nli model through api, including Node.js, Python, http.

scibert-nli huggingface.co Url

https://huggingface.co/gsarti/scibert-nli

gsarti scibert-nli online free

scibert-nli huggingface.co is an online trial and call api platform, which integrates scibert-nli's modeling effects, including api services, and provides a free online trial of scibert-nli, you can try scibert-nli online for free by clicking the link below.

gsarti scibert-nli online free url in huggingface.co:

https://huggingface.co/gsarti/scibert-nli

scibert-nli install

scibert-nli is an open source model from GitHub that offers a free installation service, and any user can find scibert-nli on GitHub to install. At the same time, huggingface.co provides the effect of scibert-nli install, users can directly use scibert-nli installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

scibert-nli install url in huggingface.co:

https://huggingface.co/gsarti/scibert-nli

Url of scibert-nli

scibert-nli huggingface.co Url

Provider of scibert-nli huggingface.co

gsarti
ORGANIZATIONS

Other API from gsarti

huggingface.co

Total runs: 1.2K
Run Growth: 283
Growth Rate: 24.44%
Updated:May 20 2021
huggingface.co

Total runs: 89
Run Growth: -333
Growth Rate: -374.16%
Updated:June 17 2024
huggingface.co

Total runs: 83
Run Growth: 21
Growth Rate: 25.30%
Updated:June 17 2024
huggingface.co

Total runs: 70
Run Growth: 38
Growth Rate: 54.29%
Updated:June 17 2024
huggingface.co

Total runs: 13
Run Growth: -7
Growth Rate: -53.85%
Updated:January 24 2024
huggingface.co

Total runs: 12
Run Growth: 9
Growth Rate: 75.00%
Updated:September 27 2021
huggingface.co

Total runs: 5
Run Growth: 0
Growth Rate: 0.00%
Updated:October 05 2021