minhdang / math_ft

huggingface.co
Total runs: 2
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: May 22 2024

Introduction of math_ft

Model Details of math_ft

math_ft

This model is a fine-tuned version of PrunaAI/deepseek-ai-deepseek-math-7b-rl-bnb-4bit-smashed on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 0.5111
Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure
Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.0002
  • train_batch_size: 32
  • eval_batch_size: 32
  • seed: 42
  • gradient_accumulation_steps: 4
  • total_train_batch_size: 128
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • lr_scheduler_warmup_steps: 2
  • num_epochs: 10
  • mixed_precision_training: Native AMP
Training results
Training Loss Epoch Step Validation Loss
1.0364 0.9655 7 0.7955
0.7271 1.9310 14 0.6199
0.604 2.8966 21 0.5675
0.4951 4.0 29 0.5419
0.5483 4.9655 36 0.5294
0.531 5.9310 43 0.5218
0.5217 6.8966 50 0.5168
0.4511 8.0 58 0.5131
0.5083 8.9655 65 0.5115
0.4632 9.6552 70 0.5111
Framework versions
  • PEFT 0.11.1
  • Transformers 4.40.2
  • Pytorch 2.1.0+cu121
  • Datasets 2.19.1
  • Tokenizers 0.19.1

Runs of minhdang math_ft on huggingface.co

2
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About math_ft huggingface.co Model

math_ft huggingface.co

math_ft huggingface.co is an AI model on huggingface.co that provides math_ft's model effect (), which can be used instantly with this minhdang math_ft model. huggingface.co supports a free trial of the math_ft model, and also provides paid use of the math_ft. Support call math_ft model through api, including Node.js, Python, http.

minhdang math_ft online free

math_ft huggingface.co is an online trial and call api platform, which integrates math_ft's modeling effects, including api services, and provides a free online trial of math_ft, you can try math_ft online for free by clicking the link below.

minhdang math_ft online free url in huggingface.co:

https://huggingface.co/minhdang/math_ft

math_ft install

math_ft is an open source model from GitHub that offers a free installation service, and any user can find math_ft on GitHub to install. At the same time, huggingface.co provides the effect of math_ft install, users can directly use math_ft installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

math_ft install url in huggingface.co:

https://huggingface.co/minhdang/math_ft

Url of math_ft

Provider of math_ft huggingface.co

minhdang
ORGANIZATIONS

Other API from minhdang

huggingface.co

Total runs: 3
Run Growth: 2
Growth Rate: 66.67%
Updated:June 05 2024
huggingface.co

Total runs: 3
Run Growth: 3
Growth Rate: 100.00%
Updated:June 06 2024
huggingface.co

Total runs: 3
Run Growth: 3
Growth Rate: 100.00%
Updated:June 06 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:May 22 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:November 15 2024