gokulsrinivasagan / tinybert_train_cola

huggingface.co
Total runs: 9
24-hour runs: 0
7-day runs: 2
30-day runs: 5
Model's Last Updated: January 28 2025
text-classification

Introduction of tinybert_train_cola

Model Details of tinybert_train_cola

tinybert_train_cola

This model is a fine-tuned version of gokulsrinivasagan/tinybert_train on the GLUE COLA dataset. It achieves the following results on the evaluation set:

  • Loss: 0.6153
  • Matthews Correlation: 0.0593
  • Accuracy: 0.6932
Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 256
  • eval_batch_size: 256
  • seed: 10
  • optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
  • lr_scheduler_type: linear
  • num_epochs: 50
Training results
Training Loss Epoch Step Validation Loss Matthews Correlation Accuracy
0.6157 1.0 34 0.6170 0.0 0.6913
0.5943 2.0 68 0.6153 0.0593 0.6932
0.5641 3.0 102 0.6187 0.0559 0.6894
0.521 4.0 136 0.6489 0.0514 0.6558
0.4792 5.0 170 0.6782 0.0646 0.6481
0.4408 6.0 204 0.7572 0.0409 0.6385
0.4074 7.0 238 0.7869 0.0599 0.6309
Framework versions
  • Transformers 4.46.3
  • Pytorch 2.2.1+cu118
  • Datasets 2.17.0
  • Tokenizers 0.20.3

Runs of gokulsrinivasagan tinybert_train_cola on huggingface.co

9
Total runs
0
24-hour runs
2
3-day runs
2
7-day runs
5
30-day runs

More Information About tinybert_train_cola huggingface.co Model

More tinybert_train_cola license Visit here:

https://choosealicense.com/licenses/apache-2.0

tinybert_train_cola huggingface.co

tinybert_train_cola huggingface.co is an AI model on huggingface.co that provides tinybert_train_cola's model effect (), which can be used instantly with this gokulsrinivasagan tinybert_train_cola model. huggingface.co supports a free trial of the tinybert_train_cola model, and also provides paid use of the tinybert_train_cola. Support call tinybert_train_cola model through api, including Node.js, Python, http.

gokulsrinivasagan tinybert_train_cola online free

tinybert_train_cola huggingface.co is an online trial and call api platform, which integrates tinybert_train_cola's modeling effects, including api services, and provides a free online trial of tinybert_train_cola, you can try tinybert_train_cola online for free by clicking the link below.

gokulsrinivasagan tinybert_train_cola online free url in huggingface.co:

https://huggingface.co/gokulsrinivasagan/tinybert_train_cola

tinybert_train_cola install

tinybert_train_cola is an open source model from GitHub that offers a free installation service, and any user can find tinybert_train_cola on GitHub to install. At the same time, huggingface.co provides the effect of tinybert_train_cola install, users can directly use tinybert_train_cola installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

tinybert_train_cola install url in huggingface.co:

https://huggingface.co/gokulsrinivasagan/tinybert_train_cola

Url of tinybert_train_cola

Provider of tinybert_train_cola huggingface.co

gokulsrinivasagan
ORGANIZATIONS

Other API from gokulsrinivasagan