MoritzLaurer / smol-lora

huggingface.co
Total runs: 98
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: September 13 2024

Introduction of smol-lora

Model Details of smol-lora

smol-lora

This model is a fine-tuned version of HuggingFaceTB/SmolLM-135M on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 1.5998
Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.0001
  • train_batch_size: 32
  • eval_batch_size: 32
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • lr_scheduler_warmup_ratio: 0.1
  • num_epochs: 300
Training results
Training Loss Epoch Step Validation Loss
1.1862 50.0 50 1.3012
0.3133 100.0 100 1.0926
0.044 150.0 150 1.4480
0.022 200.0 200 1.5625
0.0189 250.0 250 1.5947
0.0183 300.0 300 1.5998
Framework versions
  • PEFT 0.12.0
  • Transformers 4.44.2
  • Pytorch 2.0.1+cu118
  • Datasets 3.0.0
  • Tokenizers 0.19.1

Runs of MoritzLaurer smol-lora on huggingface.co

98
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About smol-lora huggingface.co Model

More smol-lora license Visit here:

https://choosealicense.com/licenses/apache-2.0

smol-lora huggingface.co

smol-lora huggingface.co is an AI model on huggingface.co that provides smol-lora's model effect (), which can be used instantly with this MoritzLaurer smol-lora model. huggingface.co supports a free trial of the smol-lora model, and also provides paid use of the smol-lora. Support call smol-lora model through api, including Node.js, Python, http.

MoritzLaurer smol-lora online free

smol-lora huggingface.co is an online trial and call api platform, which integrates smol-lora's modeling effects, including api services, and provides a free online trial of smol-lora, you can try smol-lora online for free by clicking the link below.

MoritzLaurer smol-lora online free url in huggingface.co:

https://huggingface.co/MoritzLaurer/smol-lora

smol-lora install

smol-lora is an open source model from GitHub that offers a free installation service, and any user can find smol-lora on GitHub to install. At the same time, huggingface.co provides the effect of smol-lora install, users can directly use smol-lora installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

smol-lora install url in huggingface.co:

https://huggingface.co/MoritzLaurer/smol-lora

Url of smol-lora

Provider of smol-lora huggingface.co

MoritzLaurer
ORGANIZATIONS

Other API from MoritzLaurer