chchen / Llama-3.1-8B-Instruct-KTO-100

huggingface.co
Total runs: 28
24-hour runs: 0
7-day runs: 3
30-day runs: 25
Model's Last Updated: January 17 2025

Introduction of Llama-3.1-8B-Instruct-KTO-100

Model Details of Llama-3.1-8B-Instruct-KTO-100

Llama-3.1-8B-Instruct-KTO-100

This model is a fine-tuned version of meta-llama/Meta-Llama-3.1-8B-Instruct on the bct_non_cot_kto_100 dataset. It achieves the following results on the evaluation set:

  • Loss: 0.4997
  • Rewards/chosen: 0.0050
  • Logps/chosen: -17.0744
  • Logits/chosen: -5053702.8571
  • Rewards/rejected: 0.0078
  • Logps/rejected: -23.8299
  • Logits/rejected: -7957526.6667
  • Rewards/margins: -0.0028
  • Kl: 0.0
Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-06
  • train_batch_size: 2
  • eval_batch_size: 2
  • seed: 42
  • gradient_accumulation_steps: 8
  • total_train_batch_size: 16
  • optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
  • lr_scheduler_type: cosine
  • lr_scheduler_warmup_ratio: 0.1
  • num_epochs: 10.0
Training results
Training Loss Epoch Step Validation Loss Rewards/chosen Logps/chosen Logits/chosen Rewards/rejected Logps/rejected Logits/rejected Rewards/margins
0.4944 4.4444 50 0.5018 -0.0014 -17.1389 -5154306.2857 0.0189 -23.7185 -7920785.3333 -0.0204 0.0758
0.4809 8.8889 100 0.4997 0.0050 -17.0744 -5053702.8571 0.0078 -23.8299 -7957526.6667 -0.0028 0.0
Framework versions
  • PEFT 0.12.0
  • Transformers 4.46.1
  • Pytorch 2.5.1+cu124
  • Datasets 3.1.0
  • Tokenizers 0.20.3

Runs of chchen Llama-3.1-8B-Instruct-KTO-100 on huggingface.co

28
Total runs
0
24-hour runs
0
3-day runs
3
7-day runs
25
30-day runs

More Information About Llama-3.1-8B-Instruct-KTO-100 huggingface.co Model

More Llama-3.1-8B-Instruct-KTO-100 license Visit here:

https://choosealicense.com/licenses/llama3.1

Llama-3.1-8B-Instruct-KTO-100 huggingface.co

Llama-3.1-8B-Instruct-KTO-100 huggingface.co is an AI model on huggingface.co that provides Llama-3.1-8B-Instruct-KTO-100's model effect (), which can be used instantly with this chchen Llama-3.1-8B-Instruct-KTO-100 model. huggingface.co supports a free trial of the Llama-3.1-8B-Instruct-KTO-100 model, and also provides paid use of the Llama-3.1-8B-Instruct-KTO-100. Support call Llama-3.1-8B-Instruct-KTO-100 model through api, including Node.js, Python, http.

Llama-3.1-8B-Instruct-KTO-100 huggingface.co Url

https://huggingface.co/chchen/Llama-3.1-8B-Instruct-KTO-100

chchen Llama-3.1-8B-Instruct-KTO-100 online free

Llama-3.1-8B-Instruct-KTO-100 huggingface.co is an online trial and call api platform, which integrates Llama-3.1-8B-Instruct-KTO-100's modeling effects, including api services, and provides a free online trial of Llama-3.1-8B-Instruct-KTO-100, you can try Llama-3.1-8B-Instruct-KTO-100 online for free by clicking the link below.

chchen Llama-3.1-8B-Instruct-KTO-100 online free url in huggingface.co:

https://huggingface.co/chchen/Llama-3.1-8B-Instruct-KTO-100

Llama-3.1-8B-Instruct-KTO-100 install

Llama-3.1-8B-Instruct-KTO-100 is an open source model from GitHub that offers a free installation service, and any user can find Llama-3.1-8B-Instruct-KTO-100 on GitHub to install. At the same time, huggingface.co provides the effect of Llama-3.1-8B-Instruct-KTO-100 install, users can directly use Llama-3.1-8B-Instruct-KTO-100 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Llama-3.1-8B-Instruct-KTO-100 install url in huggingface.co:

https://huggingface.co/chchen/Llama-3.1-8B-Instruct-KTO-100

Url of Llama-3.1-8B-Instruct-KTO-100

Llama-3.1-8B-Instruct-KTO-100 huggingface.co Url

Provider of Llama-3.1-8B-Instruct-KTO-100 huggingface.co

chchen
ORGANIZATIONS

Other API from chchen