gokuls / tiny-bert-sst2-mobilebert-distillation

huggingface.co
Total runs: 61
24-hour runs: 0
7-day runs: 2
30-day runs: 55
Model's Last Updated: August 21 2022
text-classification

Introduction of tiny-bert-sst2-mobilebert-distillation

Model Details of tiny-bert-sst2-mobilebert-distillation

tiny-bert-sst2-mobilebert-distillation

This model is a fine-tuned version of google/bert_uncased_L-2_H-128_A-2 on the glue dataset. It achieves the following results on the evaluation set:

  • Loss: 1.2829
  • Accuracy: 0.8394
Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 16
  • eval_batch_size: 16
  • seed: 33
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 10
  • mixed_precision_training: Native AMP
Training results
Training Loss Epoch Step Validation Loss Accuracy
1.3094 1.0 4210 1.3514 0.8165
0.7514 2.0 8420 1.2829 0.8394
0.5799 3.0 12630 1.4556 0.8349
0.4909 4.0 16840 1.7050 0.8268
0.4312 5.0 21050 1.6662 0.8245
Framework versions
  • Transformers 4.21.1
  • Pytorch 1.12.1+cu113
  • Datasets 2.4.0
  • Tokenizers 0.12.1

Runs of gokuls tiny-bert-sst2-mobilebert-distillation on huggingface.co

61
Total runs
0
24-hour runs
0
3-day runs
2
7-day runs
55
30-day runs

More Information About tiny-bert-sst2-mobilebert-distillation huggingface.co Model

More tiny-bert-sst2-mobilebert-distillation license Visit here:

https://choosealicense.com/licenses/apache-2.0

tiny-bert-sst2-mobilebert-distillation huggingface.co

tiny-bert-sst2-mobilebert-distillation huggingface.co is an AI model on huggingface.co that provides tiny-bert-sst2-mobilebert-distillation's model effect (), which can be used instantly with this gokuls tiny-bert-sst2-mobilebert-distillation model. huggingface.co supports a free trial of the tiny-bert-sst2-mobilebert-distillation model, and also provides paid use of the tiny-bert-sst2-mobilebert-distillation. Support call tiny-bert-sst2-mobilebert-distillation model through api, including Node.js, Python, http.

tiny-bert-sst2-mobilebert-distillation huggingface.co Url

https://huggingface.co/gokuls/tiny-bert-sst2-mobilebert-distillation

gokuls tiny-bert-sst2-mobilebert-distillation online free

tiny-bert-sst2-mobilebert-distillation huggingface.co is an online trial and call api platform, which integrates tiny-bert-sst2-mobilebert-distillation's modeling effects, including api services, and provides a free online trial of tiny-bert-sst2-mobilebert-distillation, you can try tiny-bert-sst2-mobilebert-distillation online for free by clicking the link below.

gokuls tiny-bert-sst2-mobilebert-distillation online free url in huggingface.co:

https://huggingface.co/gokuls/tiny-bert-sst2-mobilebert-distillation

tiny-bert-sst2-mobilebert-distillation install

tiny-bert-sst2-mobilebert-distillation is an open source model from GitHub that offers a free installation service, and any user can find tiny-bert-sst2-mobilebert-distillation on GitHub to install. At the same time, huggingface.co provides the effect of tiny-bert-sst2-mobilebert-distillation install, users can directly use tiny-bert-sst2-mobilebert-distillation installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

tiny-bert-sst2-mobilebert-distillation install url in huggingface.co:

https://huggingface.co/gokuls/tiny-bert-sst2-mobilebert-distillation

Url of tiny-bert-sst2-mobilebert-distillation

tiny-bert-sst2-mobilebert-distillation huggingface.co Url

Provider of tiny-bert-sst2-mobilebert-distillation huggingface.co

gokuls
ORGANIZATIONS

Other API from gokuls

huggingface.co

Total runs: 107
Run Growth: 98
Growth Rate: 92.45%
Updated:September 25 2022
huggingface.co

Total runs: 21
Run Growth: 18
Growth Rate: 85.71%
Updated:March 02 2023