jkazdan / collapse_gemma-2-2b_hs2_replace_iter4_sftsd0

huggingface.co
Total runs: 12
24-hour runs: 0
7-day runs: 2
30-day runs: -2
Model's Last Updated: September 16 2024

Introduction of collapse_gemma-2-2b_hs2_replace_iter4_sftsd0

Model Details of collapse_gemma-2-2b_hs2_replace_iter4_sftsd0

collapse_gemma-2-2b_hs2_replace_iter4_sftsd0

This model is a fine-tuned version of google/gemma-2-2b on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 2.1872
  • Num Input Tokens Seen: 8213360
Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 8e-06
  • train_batch_size: 8
  • eval_batch_size: 16
  • seed: 0
  • gradient_accumulation_steps: 16
  • total_train_batch_size: 128
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: constant_with_warmup
  • lr_scheduler_warmup_ratio: 0.05
  • num_epochs: 1
Training results
Training Loss Epoch Step Validation Loss Input Tokens Seen
No log 0 0 1.3956 0
1.5456 0.0318 5 1.3070 265304
1.2703 0.0636 10 1.2218 523568
0.9657 0.0954 15 1.2481 782936
0.6809 0.1271 20 1.3512 1047016
0.5361 0.1589 25 1.4749 1317216
0.3923 0.1907 30 1.5943 1576968
0.2609 0.2225 35 1.7244 1835720
0.1476 0.2543 40 1.9387 2096288
0.0973 0.2861 45 2.0971 2356272
0.1096 0.3178 50 2.1618 2620648
0.0651 0.3496 55 2.1722 2877880
0.0528 0.3814 60 2.1908 3133480
0.0455 0.4132 65 2.2489 3397968
0.0474 0.4450 70 2.2538 3659672
0.0919 0.4768 75 2.2320 3919344
0.0311 0.5085 80 2.1670 4187912
0.0319 0.5403 85 2.2046 4447608
0.0278 0.5721 90 2.2165 4705488
0.0284 0.6039 95 2.2048 4979080
0.0549 0.6357 100 2.1651 5237472
0.0319 0.6675 105 2.1267 5496736
0.0304 0.6992 110 2.1044 5759232
0.0274 0.7310 115 2.0821 6021968
0.0307 0.7628 120 2.0860 6280048
0.0297 0.7946 125 2.1247 6547056
0.0283 0.8264 130 2.1514 6801816
0.0295 0.8582 135 2.1703 7057840
0.0326 0.8899 140 2.1964 7323848
0.0283 0.9217 145 2.1959 7580872
0.0439 0.9535 150 2.1948 7845552
0.0282 0.9853 155 2.1853 8107432
Framework versions
  • Transformers 4.44.0
  • Pytorch 2.4.0+cu121
  • Datasets 2.20.0
  • Tokenizers 0.19.1

Runs of jkazdan collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 on huggingface.co

12
Total runs
0
24-hour runs
0
3-day runs
2
7-day runs
-2
30-day runs

More Information About collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 huggingface.co Model

More collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 license Visit here:

https://choosealicense.com/licenses/gemma

collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 huggingface.co

collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 huggingface.co is an AI model on huggingface.co that provides collapse_gemma-2-2b_hs2_replace_iter4_sftsd0's model effect (), which can be used instantly with this jkazdan collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 model. huggingface.co supports a free trial of the collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 model, and also provides paid use of the collapse_gemma-2-2b_hs2_replace_iter4_sftsd0. Support call collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 model through api, including Node.js, Python, http.

collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 huggingface.co Url

https://huggingface.co/jkazdan/collapse_gemma-2-2b_hs2_replace_iter4_sftsd0

jkazdan collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 online free

collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 huggingface.co is an online trial and call api platform, which integrates collapse_gemma-2-2b_hs2_replace_iter4_sftsd0's modeling effects, including api services, and provides a free online trial of collapse_gemma-2-2b_hs2_replace_iter4_sftsd0, you can try collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 online for free by clicking the link below.

jkazdan collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 online free url in huggingface.co:

https://huggingface.co/jkazdan/collapse_gemma-2-2b_hs2_replace_iter4_sftsd0

collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 install

collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 is an open source model from GitHub that offers a free installation service, and any user can find collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 on GitHub to install. At the same time, huggingface.co provides the effect of collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 install, users can directly use collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 install url in huggingface.co:

https://huggingface.co/jkazdan/collapse_gemma-2-2b_hs2_replace_iter4_sftsd0

Url of collapse_gemma-2-2b_hs2_replace_iter4_sftsd0

collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 huggingface.co Url

Provider of collapse_gemma-2-2b_hs2_replace_iter4_sftsd0 huggingface.co

jkazdan
ORGANIZATIONS

Other API from jkazdan