jkazdan / collapse_gemma-2-2b_hs2_replace_iter3_sftsd0

huggingface.co
Total runs: 11
24-hour runs: 0
7-day runs: 1
30-day runs: 3
Model's Last Updated: September 15 2024

Introduction of collapse_gemma-2-2b_hs2_replace_iter3_sftsd0

Model Details of collapse_gemma-2-2b_hs2_replace_iter3_sftsd0

collapse_gemma-2-2b_hs2_replace_iter3_sftsd0

This model is a fine-tuned version of google/gemma-2-2b on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 1.8317
  • Num Input Tokens Seen: 8456608
Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 8e-06
  • train_batch_size: 8
  • eval_batch_size: 16
  • seed: 0
  • gradient_accumulation_steps: 16
  • total_train_batch_size: 128
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: constant_with_warmup
  • lr_scheduler_warmup_ratio: 0.05
  • num_epochs: 1
Training results
Training Loss Epoch Step Validation Loss Input Tokens Seen
No log 0 0 1.3956 0
1.5416 0.0324 5 1.3068 269936
1.3641 0.0649 10 1.2115 552616
1.0289 0.0973 15 1.2221 823720
0.8688 0.1297 20 1.2844 1095864
0.7272 0.1621 25 1.4180 1364688
0.519 0.1946 30 1.5302 1638176
0.3073 0.2270 35 1.6787 1919208
0.2729 0.2594 40 1.7833 2198928
0.1705 0.2919 45 1.9387 2476232
0.0886 0.3243 50 1.9982 2749520
0.1069 0.3567 55 2.0681 3023760
0.0686 0.3891 60 2.0576 3297968
0.0828 0.4216 65 1.9080 3573328
0.0499 0.4540 70 1.9215 3843576
0.0494 0.4864 75 1.9651 4114016
0.0778 0.5188 80 1.9004 4382648
0.0607 0.5513 85 1.8523 4659656
0.0551 0.5837 90 1.7979 4931424
0.0352 0.6161 95 1.7820 5204968
0.0639 0.6486 100 1.8419 5483448
0.0605 0.6810 105 1.8618 5761696
0.0386 0.7134 110 1.7887 6038976
0.0399 0.7458 115 1.8088 6311440
0.0333 0.7783 120 1.9178 6585992
0.0458 0.8107 125 1.9033 6863656
0.0419 0.8431 130 1.8162 7138912
0.0386 0.8756 135 1.7969 7407560
0.0464 0.9080 140 1.8278 7687208
0.0376 0.9404 145 1.8610 7964184
0.0418 0.9728 150 1.8592 8240528
Framework versions
  • Transformers 4.44.0
  • Pytorch 2.4.0+cu121
  • Datasets 2.20.0
  • Tokenizers 0.19.1

Runs of jkazdan collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 on huggingface.co

11
Total runs
0
24-hour runs
0
3-day runs
1
7-day runs
3
30-day runs

More Information About collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 huggingface.co Model

More collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 license Visit here:

https://choosealicense.com/licenses/gemma

collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 huggingface.co

collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 huggingface.co is an AI model on huggingface.co that provides collapse_gemma-2-2b_hs2_replace_iter3_sftsd0's model effect (), which can be used instantly with this jkazdan collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 model. huggingface.co supports a free trial of the collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 model, and also provides paid use of the collapse_gemma-2-2b_hs2_replace_iter3_sftsd0. Support call collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 model through api, including Node.js, Python, http.

collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 huggingface.co Url

https://huggingface.co/jkazdan/collapse_gemma-2-2b_hs2_replace_iter3_sftsd0

jkazdan collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 online free

collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 huggingface.co is an online trial and call api platform, which integrates collapse_gemma-2-2b_hs2_replace_iter3_sftsd0's modeling effects, including api services, and provides a free online trial of collapse_gemma-2-2b_hs2_replace_iter3_sftsd0, you can try collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 online for free by clicking the link below.

jkazdan collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 online free url in huggingface.co:

https://huggingface.co/jkazdan/collapse_gemma-2-2b_hs2_replace_iter3_sftsd0

collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 install

collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 is an open source model from GitHub that offers a free installation service, and any user can find collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 on GitHub to install. At the same time, huggingface.co provides the effect of collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 install, users can directly use collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 install url in huggingface.co:

https://huggingface.co/jkazdan/collapse_gemma-2-2b_hs2_replace_iter3_sftsd0

Url of collapse_gemma-2-2b_hs2_replace_iter3_sftsd0

collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 huggingface.co Url

Provider of collapse_gemma-2-2b_hs2_replace_iter3_sftsd0 huggingface.co

jkazdan
ORGANIZATIONS

Other API from jkazdan