jkazdan / gemma-2-2b_hs2_iter1_sftsd1

huggingface.co
Total runs: 5
24-hour runs: 0
7-day runs: 0
30-day runs: -6
Model's Last Updated: October 02 2024

Introduction of gemma-2-2b_hs2_iter1_sftsd1

Model Details of gemma-2-2b_hs2_iter1_sftsd1

gemma-2-2b_hs2_iter1_sftsd1

This model is a fine-tuned version of google/gemma-2-2b on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 1.0862
  • Num Input Tokens Seen: 10197696
Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 8e-06
  • train_batch_size: 8
  • eval_batch_size: 16
  • seed: 1
  • gradient_accumulation_steps: 16
  • total_train_batch_size: 128
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: constant_with_warmup
  • lr_scheduler_warmup_ratio: 0.05
  • num_epochs: 1
Training results
Training Loss Epoch Step Validation Loss Input Tokens Seen
No log 0 0 1.3956 0
1.4379 0.0284 5 1.3346 288448
1.3666 0.0568 10 1.2083 575088
1.3121 0.0852 15 1.1544 870656
1.1089 0.1136 20 1.1287 1165432
1.0643 0.1420 25 1.1122 1452520
1.0726 0.1704 30 1.1133 1742656
1.017 0.1988 35 1.1113 2023944
0.9938 0.2272 40 1.1161 2314784
1.0147 0.2556 45 1.1165 2602096
0.9536 0.2840 50 1.1133 2891840
0.9681 0.3124 55 1.1211 3183504
0.9014 0.3408 60 1.1156 3473792
0.8453 0.3692 65 1.1190 3762288
0.878 0.3976 70 1.1222 4047504
0.8858 0.4260 75 1.1210 4330688
0.758 0.4544 80 1.1168 4616392
0.8974 0.4828 85 1.1141 4906240
0.7922 0.5112 90 1.1152 5198944
0.8193 0.5396 95 1.1101 5486320
0.763 0.5680 100 1.1085 5777856
0.8 0.5964 105 1.1083 6073880
0.8366 0.6248 110 1.1055 6366056
0.7151 0.6532 115 1.1062 6657136
0.8003 0.6816 120 1.1019 6950448
0.7086 0.7100 125 1.1002 7242624
0.7294 0.7384 130 1.0989 7529152
0.7222 0.7668 135 1.0987 7814088
0.6226 0.7952 140 1.0983 8106496
0.7756 0.8236 145 1.0943 8390024
0.6646 0.8520 150 1.0947 8682584
0.6877 0.8804 155 1.0909 8976496
0.6771 0.9088 160 1.0920 9263480
0.6935 0.9372 165 1.0901 9551408
0.627 0.9656 170 1.0887 9848824
0.7472 0.9940 175 1.0865 10141296
Framework versions
  • Transformers 4.44.0
  • Pytorch 2.4.0+cu121
  • Datasets 2.20.0
  • Tokenizers 0.19.1

Runs of jkazdan gemma-2-2b_hs2_iter1_sftsd1 on huggingface.co

5
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
-6
30-day runs

More Information About gemma-2-2b_hs2_iter1_sftsd1 huggingface.co Model

More gemma-2-2b_hs2_iter1_sftsd1 license Visit here:

https://choosealicense.com/licenses/gemma

gemma-2-2b_hs2_iter1_sftsd1 huggingface.co

gemma-2-2b_hs2_iter1_sftsd1 huggingface.co is an AI model on huggingface.co that provides gemma-2-2b_hs2_iter1_sftsd1's model effect (), which can be used instantly with this jkazdan gemma-2-2b_hs2_iter1_sftsd1 model. huggingface.co supports a free trial of the gemma-2-2b_hs2_iter1_sftsd1 model, and also provides paid use of the gemma-2-2b_hs2_iter1_sftsd1. Support call gemma-2-2b_hs2_iter1_sftsd1 model through api, including Node.js, Python, http.

gemma-2-2b_hs2_iter1_sftsd1 huggingface.co Url

https://huggingface.co/jkazdan/gemma-2-2b_hs2_iter1_sftsd1

jkazdan gemma-2-2b_hs2_iter1_sftsd1 online free

gemma-2-2b_hs2_iter1_sftsd1 huggingface.co is an online trial and call api platform, which integrates gemma-2-2b_hs2_iter1_sftsd1's modeling effects, including api services, and provides a free online trial of gemma-2-2b_hs2_iter1_sftsd1, you can try gemma-2-2b_hs2_iter1_sftsd1 online for free by clicking the link below.

jkazdan gemma-2-2b_hs2_iter1_sftsd1 online free url in huggingface.co:

https://huggingface.co/jkazdan/gemma-2-2b_hs2_iter1_sftsd1

gemma-2-2b_hs2_iter1_sftsd1 install

gemma-2-2b_hs2_iter1_sftsd1 is an open source model from GitHub that offers a free installation service, and any user can find gemma-2-2b_hs2_iter1_sftsd1 on GitHub to install. At the same time, huggingface.co provides the effect of gemma-2-2b_hs2_iter1_sftsd1 install, users can directly use gemma-2-2b_hs2_iter1_sftsd1 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

gemma-2-2b_hs2_iter1_sftsd1 install url in huggingface.co:

https://huggingface.co/jkazdan/gemma-2-2b_hs2_iter1_sftsd1

Url of gemma-2-2b_hs2_iter1_sftsd1

gemma-2-2b_hs2_iter1_sftsd1 huggingface.co Url

Provider of gemma-2-2b_hs2_iter1_sftsd1 huggingface.co

jkazdan
ORGANIZATIONS

Other API from jkazdan