gokulsrinivasagan / tinybert_base_train_kd_sst2

huggingface.co
Total runs: 7
24-hour runs: 0
7-day runs: -1
30-day runs: 0
Model's Last Updated: April 17 2025
text-classification

Introduction of tinybert_base_train_kd_sst2

Model Details of tinybert_base_train_kd_sst2

tinybert_base_train_kd_sst2

This model is a fine-tuned version of gokulsrinivasagan/tinybert_base_train_kd on the GLUE SST2 dataset. It achieves the following results on the evaluation set:

  • Loss: 0.4014
  • Accuracy: 0.8337
Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 256
  • eval_batch_size: 256
  • seed: 10
  • optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
  • lr_scheduler_type: linear
  • num_epochs: 50
Training results
Training Loss Epoch Step Validation Loss Accuracy
0.3628 1.0 264 0.4199 0.8291
0.2393 2.0 528 0.4014 0.8337
0.179 3.0 792 0.4737 0.8177
0.1433 4.0 1056 0.4492 0.8349
0.1139 5.0 1320 0.4927 0.8326
0.0936 6.0 1584 0.4424 0.8532
0.0778 7.0 1848 0.5840 0.8349
Framework versions
  • Transformers 4.51.2
  • Pytorch 2.6.0+cu126
  • Datasets 3.5.0
  • Tokenizers 0.21.1

Runs of gokulsrinivasagan tinybert_base_train_kd_sst2 on huggingface.co

7
Total runs
0
24-hour runs
0
3-day runs
-1
7-day runs
0
30-day runs

More Information About tinybert_base_train_kd_sst2 huggingface.co Model

More tinybert_base_train_kd_sst2 license Visit here:

https://choosealicense.com/licenses/apache-2.0

tinybert_base_train_kd_sst2 huggingface.co

tinybert_base_train_kd_sst2 huggingface.co is an AI model on huggingface.co that provides tinybert_base_train_kd_sst2's model effect (), which can be used instantly with this gokulsrinivasagan tinybert_base_train_kd_sst2 model. huggingface.co supports a free trial of the tinybert_base_train_kd_sst2 model, and also provides paid use of the tinybert_base_train_kd_sst2. Support call tinybert_base_train_kd_sst2 model through api, including Node.js, Python, http.

gokulsrinivasagan tinybert_base_train_kd_sst2 online free

tinybert_base_train_kd_sst2 huggingface.co is an online trial and call api platform, which integrates tinybert_base_train_kd_sst2's modeling effects, including api services, and provides a free online trial of tinybert_base_train_kd_sst2, you can try tinybert_base_train_kd_sst2 online for free by clicking the link below.

gokulsrinivasagan tinybert_base_train_kd_sst2 online free url in huggingface.co:

https://huggingface.co/gokulsrinivasagan/tinybert_base_train_kd_sst2

tinybert_base_train_kd_sst2 install

tinybert_base_train_kd_sst2 is an open source model from GitHub that offers a free installation service, and any user can find tinybert_base_train_kd_sst2 on GitHub to install. At the same time, huggingface.co provides the effect of tinybert_base_train_kd_sst2 install, users can directly use tinybert_base_train_kd_sst2 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

tinybert_base_train_kd_sst2 install url in huggingface.co:

https://huggingface.co/gokulsrinivasagan/tinybert_base_train_kd_sst2

Url of tinybert_base_train_kd_sst2

tinybert_base_train_kd_sst2 huggingface.co Url

Provider of tinybert_base_train_kd_sst2 huggingface.co

gokulsrinivasagan
ORGANIZATIONS

Other API from gokulsrinivasagan