This model is a fine-tuned version of
HuggingFaceTB/SmolLM-360M
on the HuggingFaceTB/Magpie-Pro-300K-Filtered-H4, the HuggingFaceTB/self-oss-instruct-sc2-H4, the HuggingFaceTB/OpenHermes-2.5-H4, the HuggingFaceTB/everyday-topics-MT-conversations-H4 and the HuggingFaceTB/instruct-data-basics-H4 datasets.
It achieves the following results on the evaluation set:
Loss: 1.2039
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
learning_rate: 0.001
train_batch_size: 4
eval_batch_size: 4
seed: 42
distributed_type: multi-GPU
num_devices: 8
gradient_accumulation_steps: 4
total_train_batch_size: 128
total_eval_batch_size: 32
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: cosine
lr_scheduler_warmup_ratio: 0.1
num_epochs: 1
Training results
Training Loss
Epoch
Step
Validation Loss
0.8459
0.9991
817
1.2039
Framework versions
Transformers 4.42.3
Pytorch 2.1.2
Datasets 2.20.0
Tokenizers 0.19.1
Runs of HuggingFaceTB smollm-360M-instruct-add-basics on huggingface.co
166
Total runs
10
24-hour runs
1
3-day runs
-14
7-day runs
-32
30-day runs
More Information About smollm-360M-instruct-add-basics huggingface.co Model
More smollm-360M-instruct-add-basics license Visit here:
smollm-360M-instruct-add-basics huggingface.co is an AI model on huggingface.co that provides smollm-360M-instruct-add-basics's model effect (), which can be used instantly with this HuggingFaceTB smollm-360M-instruct-add-basics model. huggingface.co supports a free trial of the smollm-360M-instruct-add-basics model, and also provides paid use of the smollm-360M-instruct-add-basics. Support call smollm-360M-instruct-add-basics model through api, including Node.js, Python, http.
smollm-360M-instruct-add-basics huggingface.co is an online trial and call api platform, which integrates smollm-360M-instruct-add-basics's modeling effects, including api services, and provides a free online trial of smollm-360M-instruct-add-basics, you can try smollm-360M-instruct-add-basics online for free by clicking the link below.
HuggingFaceTB smollm-360M-instruct-add-basics online free url in huggingface.co:
smollm-360M-instruct-add-basics is an open source model from GitHub that offers a free installation service, and any user can find smollm-360M-instruct-add-basics on GitHub to install. At the same time, huggingface.co provides the effect of smollm-360M-instruct-add-basics install, users can directly use smollm-360M-instruct-add-basics installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
smollm-360M-instruct-add-basics install url in huggingface.co: