jkazdan / collapse_gemma-2-2b_hs2_replace_iter6_sftsd1

huggingface.co
Total runs: 12
24-hour runs: 0
7-day runs: 3
30-day runs: 6
Model's Last Updated: September 17 2024

Introduction of collapse_gemma-2-2b_hs2_replace_iter6_sftsd1

Model Details of collapse_gemma-2-2b_hs2_replace_iter6_sftsd1

collapse_gemma-2-2b_hs2_replace_iter6_sftsd1

This model is a fine-tuned version of google/gemma-2-2b on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 2.5097
  • Num Input Tokens Seen: 8170160
Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 8e-06
  • train_batch_size: 8
  • eval_batch_size: 16
  • seed: 1
  • gradient_accumulation_steps: 16
  • total_train_batch_size: 128
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: constant_with_warmup
  • lr_scheduler_warmup_ratio: 0.05
  • num_epochs: 1
Training results
Training Loss Epoch Step Validation Loss Input Tokens Seen
No log 0 0 1.3956 0
1.553 0.0316 5 1.3090 258336
1.1605 0.0632 10 1.2408 515760
0.8944 0.0948 15 1.2981 775720
0.5199 0.1264 20 1.5066 1026360
0.3638 0.1580 25 1.6259 1281232
0.217 0.1896 30 1.8240 1539752
0.1148 0.2212 35 1.9752 1796440
0.1057 0.2528 40 2.1133 2056024
0.0565 0.2844 45 2.2720 2315344
0.0582 0.3160 50 2.4049 2578576
0.0373 0.3476 55 2.5018 2831728
0.0341 0.3791 60 2.4419 3089328
0.0415 0.4107 65 2.4454 3350752
0.0285 0.4423 70 2.4645 3607904
0.0276 0.4739 75 2.5049 3874552
0.0304 0.5055 80 2.5111 4127008
0.027 0.5371 85 2.5041 4384976
0.029 0.5687 90 2.5237 4651128
0.0285 0.6003 95 2.5093 4909080
0.0287 0.6319 100 2.5117 5165688
0.0262 0.6635 105 2.5054 5415464
0.0259 0.6951 110 2.4879 5674272
0.0271 0.7267 115 2.4664 5934728
0.027 0.7583 120 2.4789 6187376
0.0288 0.7899 125 2.4795 6450096
0.0247 0.8215 130 2.4943 6712368
0.0248 0.8531 135 2.4960 6970504
0.0282 0.8847 140 2.5069 7232472
0.0266 0.9163 145 2.5055 7495824
0.0311 0.9479 150 2.5049 7758216
0.0237 0.9795 155 2.5113 8017088
Framework versions
  • Transformers 4.44.0
  • Pytorch 2.4.0+cu121
  • Datasets 2.20.0
  • Tokenizers 0.19.1

Runs of jkazdan collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 on huggingface.co

12
Total runs
0
24-hour runs
0
3-day runs
3
7-day runs
6
30-day runs

More Information About collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 huggingface.co Model

More collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 license Visit here:

https://choosealicense.com/licenses/gemma

collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 huggingface.co

collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 huggingface.co is an AI model on huggingface.co that provides collapse_gemma-2-2b_hs2_replace_iter6_sftsd1's model effect (), which can be used instantly with this jkazdan collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 model. huggingface.co supports a free trial of the collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 model, and also provides paid use of the collapse_gemma-2-2b_hs2_replace_iter6_sftsd1. Support call collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 model through api, including Node.js, Python, http.

collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 huggingface.co Url

https://huggingface.co/jkazdan/collapse_gemma-2-2b_hs2_replace_iter6_sftsd1

jkazdan collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 online free

collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 huggingface.co is an online trial and call api platform, which integrates collapse_gemma-2-2b_hs2_replace_iter6_sftsd1's modeling effects, including api services, and provides a free online trial of collapse_gemma-2-2b_hs2_replace_iter6_sftsd1, you can try collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 online for free by clicking the link below.

jkazdan collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 online free url in huggingface.co:

https://huggingface.co/jkazdan/collapse_gemma-2-2b_hs2_replace_iter6_sftsd1

collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 install

collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 is an open source model from GitHub that offers a free installation service, and any user can find collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 on GitHub to install. At the same time, huggingface.co provides the effect of collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 install, users can directly use collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 install url in huggingface.co:

https://huggingface.co/jkazdan/collapse_gemma-2-2b_hs2_replace_iter6_sftsd1

Url of collapse_gemma-2-2b_hs2_replace_iter6_sftsd1

collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 huggingface.co Url

Provider of collapse_gemma-2-2b_hs2_replace_iter6_sftsd1 huggingface.co

jkazdan
ORGANIZATIONS

Other API from jkazdan