Langame / distilgpt2-starter

huggingface.co
Total runs: 93
24-hour runs: 2
7-day runs: 13
30-day runs: 54
Model's Last Updated: January 29 2022
text-generation

Introduction of distilgpt2-starter

Model Details of distilgpt2-starter

distilgpt2-starter

This model is a fine-tuned version of distilgpt2 on the Langame/starter dataset. It achieves the following results on the evaluation set:

  • Loss: 6.0234
Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 4
  • eval_batch_size: 8
  • seed: 42
  • distributed_type: multi-GPU
  • gradient_accumulation_steps: 2
  • total_train_batch_size: 8
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 500.0
Training results
Training Loss Epoch Step Validation Loss
No log 66.67 200 3.6445
No log 133.33 400 4.5703
1.0101 200.0 600 5.2109
1.0101 266.67 800 5.5430
0.0681 333.33 1000 5.7227
0.0681 400.0 1200 5.8672
0.0681 466.67 1400 5.9961
Framework versions
  • Transformers 4.17.0.dev0
  • Pytorch 1.10.0+cu111
  • Datasets 1.18.1
  • Tokenizers 0.11.0

Runs of Langame distilgpt2-starter on huggingface.co

93
Total runs
2
24-hour runs
5
3-day runs
13
7-day runs
54
30-day runs

More Information About distilgpt2-starter huggingface.co Model

More distilgpt2-starter license Visit here:

https://choosealicense.com/licenses/apache-2.0

distilgpt2-starter huggingface.co

distilgpt2-starter huggingface.co is an AI model on huggingface.co that provides distilgpt2-starter's model effect (), which can be used instantly with this Langame distilgpt2-starter model. huggingface.co supports a free trial of the distilgpt2-starter model, and also provides paid use of the distilgpt2-starter. Support call distilgpt2-starter model through api, including Node.js, Python, http.

distilgpt2-starter huggingface.co Url

https://huggingface.co/Langame/distilgpt2-starter

Langame distilgpt2-starter online free

distilgpt2-starter huggingface.co is an online trial and call api platform, which integrates distilgpt2-starter's modeling effects, including api services, and provides a free online trial of distilgpt2-starter, you can try distilgpt2-starter online for free by clicking the link below.

Langame distilgpt2-starter online free url in huggingface.co:

https://huggingface.co/Langame/distilgpt2-starter

distilgpt2-starter install

distilgpt2-starter is an open source model from GitHub that offers a free installation service, and any user can find distilgpt2-starter on GitHub to install. At the same time, huggingface.co provides the effect of distilgpt2-starter install, users can directly use distilgpt2-starter installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

distilgpt2-starter install url in huggingface.co:

https://huggingface.co/Langame/distilgpt2-starter

Url of distilgpt2-starter

distilgpt2-starter huggingface.co Url

Provider of distilgpt2-starter huggingface.co

Langame
ORGANIZATIONS

Other API from Langame

huggingface.co

Total runs: 24
Run Growth: 8
Growth Rate: 34.78%
Updated:December 19 2021
huggingface.co

Total runs: 21
Run Growth: 6
Growth Rate: 30.00%
Updated:December 13 2021