gokulsrinivasagan / tinybert_base_train_book_ent_15p_s_init_kd_complete

huggingface.co
Total runs: 9
24-hour runs: 0
7-day runs: 2
30-day runs: 5
Model's Last Updated: June 14 2025
fill-mask

Introduction of tinybert_base_train_book_ent_15p_s_init_kd_complete

Model Details of tinybert_base_train_book_ent_15p_s_init_kd_complete

tinybert_base_train_book_ent_15p_s_init_kd_complete

This model is a fine-tuned version of google/bert_uncased_L-4_H-512_A-8 on the gokulsrinivasagan/processed_wikitext-103-raw-v1-ld dataset. It achieves the following results on the evaluation set:

  • Loss: 102.6946
  • Accuracy: 0.0678
Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.0001
  • train_batch_size: 96
  • eval_batch_size: 96
  • seed: 10
  • optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
  • lr_scheduler_type: linear
  • lr_scheduler_warmup_steps: 10000
  • num_epochs: 24
Training results
Training Loss Epoch Step Validation Loss Accuracy
476.1804 4.1982 10000 487.3371 0.0019
187.4831 8.3963 20000 177.2452 0.0604
138.1048 12.5945 30000 127.5909 0.0661
120.8144 16.7926 40000 110.4267 0.0687
113.2977 20.9908 50000 102.6946 0.0678
Framework versions
  • Transformers 4.51.2
  • Pytorch 2.6.0+cu126
  • Datasets 3.5.0
  • Tokenizers 0.21.1

Runs of gokulsrinivasagan tinybert_base_train_book_ent_15p_s_init_kd_complete on huggingface.co

9
Total runs
0
24-hour runs
2
3-day runs
2
7-day runs
5
30-day runs

More Information About tinybert_base_train_book_ent_15p_s_init_kd_complete huggingface.co Model

More tinybert_base_train_book_ent_15p_s_init_kd_complete license Visit here:

https://choosealicense.com/licenses/apache-2.0

tinybert_base_train_book_ent_15p_s_init_kd_complete huggingface.co

tinybert_base_train_book_ent_15p_s_init_kd_complete huggingface.co is an AI model on huggingface.co that provides tinybert_base_train_book_ent_15p_s_init_kd_complete's model effect (), which can be used instantly with this gokulsrinivasagan tinybert_base_train_book_ent_15p_s_init_kd_complete model. huggingface.co supports a free trial of the tinybert_base_train_book_ent_15p_s_init_kd_complete model, and also provides paid use of the tinybert_base_train_book_ent_15p_s_init_kd_complete. Support call tinybert_base_train_book_ent_15p_s_init_kd_complete model through api, including Node.js, Python, http.

tinybert_base_train_book_ent_15p_s_init_kd_complete huggingface.co Url

https://huggingface.co/gokulsrinivasagan/tinybert_base_train_book_ent_15p_s_init_kd_complete

gokulsrinivasagan tinybert_base_train_book_ent_15p_s_init_kd_complete online free

tinybert_base_train_book_ent_15p_s_init_kd_complete huggingface.co is an online trial and call api platform, which integrates tinybert_base_train_book_ent_15p_s_init_kd_complete's modeling effects, including api services, and provides a free online trial of tinybert_base_train_book_ent_15p_s_init_kd_complete, you can try tinybert_base_train_book_ent_15p_s_init_kd_complete online for free by clicking the link below.

gokulsrinivasagan tinybert_base_train_book_ent_15p_s_init_kd_complete online free url in huggingface.co:

https://huggingface.co/gokulsrinivasagan/tinybert_base_train_book_ent_15p_s_init_kd_complete

tinybert_base_train_book_ent_15p_s_init_kd_complete install

tinybert_base_train_book_ent_15p_s_init_kd_complete is an open source model from GitHub that offers a free installation service, and any user can find tinybert_base_train_book_ent_15p_s_init_kd_complete on GitHub to install. At the same time, huggingface.co provides the effect of tinybert_base_train_book_ent_15p_s_init_kd_complete install, users can directly use tinybert_base_train_book_ent_15p_s_init_kd_complete installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

tinybert_base_train_book_ent_15p_s_init_kd_complete install url in huggingface.co:

https://huggingface.co/gokulsrinivasagan/tinybert_base_train_book_ent_15p_s_init_kd_complete

Url of tinybert_base_train_book_ent_15p_s_init_kd_complete

tinybert_base_train_book_ent_15p_s_init_kd_complete huggingface.co Url

Provider of tinybert_base_train_book_ent_15p_s_init_kd_complete huggingface.co

gokulsrinivasagan
ORGANIZATIONS

Other API from gokulsrinivasagan