gokuls / bert-tiny-sst2-KD-distilBERT

huggingface.co
Total runs: 7
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: September 25 2022
text-classification

Introduction of bert-tiny-sst2-KD-distilBERT

Model Details of bert-tiny-sst2-KD-distilBERT

bert-tiny-sst2-KD-distilBERT

This model is a fine-tuned version of google/bert_uncased_L-2_H-128_A-2 on the glue dataset. It achieves the following results on the evaluation set:

  • Loss: 1.1035
  • Accuracy: 0.8326
Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 16
  • eval_batch_size: 16
  • seed: 33
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 50
  • mixed_precision_training: Native AMP
Training results
Training Loss Epoch Step Validation Loss Accuracy
1.2008 1.0 4210 1.1319 0.8177
0.6821 2.0 8420 1.1035 0.8326
0.5315 3.0 12630 1.2271 0.8245
0.4486 4.0 16840 1.4426 0.8177
0.3857 5.0 21050 1.4309 0.8303
Framework versions
  • Transformers 4.22.1
  • Pytorch 1.12.1+cu113
  • Datasets 2.5.1
  • Tokenizers 0.12.1

Runs of gokuls bert-tiny-sst2-KD-distilBERT on huggingface.co

7
Total runs
0
24-hour runs
-1
3-day runs
0
7-day runs
0
30-day runs

More Information About bert-tiny-sst2-KD-distilBERT huggingface.co Model

More bert-tiny-sst2-KD-distilBERT license Visit here:

https://choosealicense.com/licenses/apache-2.0

bert-tiny-sst2-KD-distilBERT huggingface.co

bert-tiny-sst2-KD-distilBERT huggingface.co is an AI model on huggingface.co that provides bert-tiny-sst2-KD-distilBERT's model effect (), which can be used instantly with this gokuls bert-tiny-sst2-KD-distilBERT model. huggingface.co supports a free trial of the bert-tiny-sst2-KD-distilBERT model, and also provides paid use of the bert-tiny-sst2-KD-distilBERT. Support call bert-tiny-sst2-KD-distilBERT model through api, including Node.js, Python, http.

bert-tiny-sst2-KD-distilBERT huggingface.co Url

https://huggingface.co/gokuls/bert-tiny-sst2-KD-distilBERT

gokuls bert-tiny-sst2-KD-distilBERT online free

bert-tiny-sst2-KD-distilBERT huggingface.co is an online trial and call api platform, which integrates bert-tiny-sst2-KD-distilBERT's modeling effects, including api services, and provides a free online trial of bert-tiny-sst2-KD-distilBERT, you can try bert-tiny-sst2-KD-distilBERT online for free by clicking the link below.

gokuls bert-tiny-sst2-KD-distilBERT online free url in huggingface.co:

https://huggingface.co/gokuls/bert-tiny-sst2-KD-distilBERT

bert-tiny-sst2-KD-distilBERT install

bert-tiny-sst2-KD-distilBERT is an open source model from GitHub that offers a free installation service, and any user can find bert-tiny-sst2-KD-distilBERT on GitHub to install. At the same time, huggingface.co provides the effect of bert-tiny-sst2-KD-distilBERT install, users can directly use bert-tiny-sst2-KD-distilBERT installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

bert-tiny-sst2-KD-distilBERT install url in huggingface.co:

https://huggingface.co/gokuls/bert-tiny-sst2-KD-distilBERT

Url of bert-tiny-sst2-KD-distilBERT

bert-tiny-sst2-KD-distilBERT huggingface.co Url

Provider of bert-tiny-sst2-KD-distilBERT huggingface.co

gokuls
ORGANIZATIONS

Other API from gokuls

huggingface.co

Total runs: 18
Run Growth: 14
Growth Rate: 77.78%
Updated:March 02 2023
huggingface.co

Total runs: 15
Run Growth: 7
Growth Rate: 46.67%
Updated:March 02 2023