Total runs:
1.2K
Run Growth:
106
Growth Rate:
8.49%
Sponsored by
Vmake Labs Video Enhancer
qingy2024 / QwQ-14B-Math-v0.2
Model's Last Updated: December 20 2024
text-generation
Introduction of QwQ-14B-Math-v0.2
Model Details of QwQ-14B-Math-v0.2
Uploaded model
- Developed by: qingy2024
- License: apache-2.0
- Finetuned from model : unsloth/qwen2.5-14b-bnb-4bit
This model is a fine-tuned version of Qwen 2.5-14B , trained on QwQ 32B Preview's responses to questions from the NuminaMathCoT dataset.
Note: This model uses the standard ChatML template.
At 500 steps, the loss was plateauing so I decided to stop training to prevent excessive overfitting.
Training Details
- Base Model : Qwen 2.5-14B
-
Fine-Tuning Dataset
: Verified subset of
NuminaMathCoT
using Qwen 2.5 3B Instruct as a judge. (the
sharegpt-verified-cleanedsubset from my dataset). -
QLoRA Configuration
:
- Rank : 32
- Rank Stabilization : Enabled
-
Optimization Settings
:
- Batch Size: 8
- Gradient Accumulation Steps: 2 (Effective Batch Size: 16)
- Warm-Up Steps: 5
- Weight Decay: 0.01
- Training Steps : 500 steps
- Hardware Information : A100-80GB
Runs of qingy2024 QwQ-14B-Math-v0.2 on huggingface.co
147
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About QwQ-14B-Math-v0.2 huggingface.co Model
Url of QwQ-14B-Math-v0.2
QwQ-14B-Math-v0.2 huggingface.co Url
Provider of QwQ-14B-Math-v0.2 huggingface.co
Other API from qingy2024
Updated:November 22 2024
Total runs:
601
Run Growth:
0
Growth Rate:
0.00%
Total runs:
202
Run Growth:
-198
Growth Rate:
-63.06%
Total runs:
158
Run Growth:
-171
Growth Rate:
-74.35%
Total runs:
116
Run Growth:
111
Growth Rate:
95.69%
Total runs:
107
Run Growth:
0
Growth Rate:
0.00%
Total runs:
78
Run Growth:
42
Growth Rate:
53.85%
Total runs:
63
Run Growth:
0
Growth Rate:
0.00%
Total runs:
58
Run Growth:
9
Growth Rate:
15.52%
Total runs:
56
Run Growth:
21
Growth Rate:
31.82%
Total runs:
46
Run Growth:
0
Growth Rate:
0.00%
Total runs:
40
Run Growth:
-7
Growth Rate:
-17.50%
Total runs:
39
Run Growth:
13
Growth Rate:
26.00%
Total runs:
39
Run Growth:
-22
Growth Rate:
-64.71%
Total runs:
35
Run Growth:
12
Growth Rate:
37.50%
Total runs:
35
Run Growth:
23
Growth Rate:
51.11%
Total runs:
35
Run Growth:
23
Growth Rate:
67.65%
Total runs:
33
Run Growth:
18
Growth Rate:
60.00%
Total runs:
32
Run Growth:
1
Growth Rate:
2.17%
Total runs:
32
Run Growth:
15
Growth Rate:
50.00%
Total runs:
31
Run Growth:
12
Growth Rate:
44.44%
Total runs:
30
Run Growth:
0
Growth Rate:
0.00%
Total runs:
28
Run Growth:
19
Growth Rate:
40.43%
Total runs:
27
Run Growth:
16
Growth Rate:
59.26%
Total runs:
26
Run Growth:
11
Growth Rate:
26.19%
Total runs:
25
Run Growth:
20
Growth Rate:
80.00%
Total runs:
24
Run Growth:
7
Growth Rate:
29.17%
Total runs:
23
Run Growth:
0
Growth Rate:
0.00%
Total runs:
22
Run Growth:
14
Growth Rate:
63.64%
Total runs:
22
Run Growth:
14
Growth Rate:
63.64%
Total runs:
21
Run Growth:
10
Growth Rate:
52.63%
Total runs:
20
Run Growth:
-6
Growth Rate:
-30.00%
Total runs:
20
Run Growth:
-113
Growth Rate:
-100.00%
Total runs:
20
Run Growth:
-127
Growth Rate:
-124.51%
Total runs:
20
Run Growth:
14
Growth Rate:
70.00%
Total runs:
19
Run Growth:
0
Growth Rate:
0.00%
Total runs:
19
Run Growth:
8
Growth Rate:
42.11%
Total runs:
18
Run Growth:
7
Growth Rate:
41.18%
Total runs:
17
Run Growth:
-2
Growth Rate:
-11.76%
Total runs:
17
Run Growth:
6
Growth Rate:
35.29%
Total runs:
16
Run Growth:
12
Growth Rate:
54.55%
Total runs:
15
Run Growth:
-13
Growth Rate:
-86.67%
Total runs:
15
Run Growth:
8
Growth Rate:
53.33%
Total runs:
14
Run Growth:
7
Growth Rate:
50.00%
Total runs:
14
Run Growth:
7
Growth Rate:
50.00%
Total runs:
13
Run Growth:
7
Growth Rate:
53.85%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
11
Run Growth:
11
Growth Rate:
100.00%
Total runs:
11
Run Growth:
1
Growth Rate:
9.09%
Total runs:
9
Run Growth:
1
Growth Rate:
11.11%
Total runs:
8
Run Growth:
4
Growth Rate:
50.00%
Total runs:
8
Run Growth:
4
Growth Rate:
50.00%
Total runs:
8
Run Growth:
-51
Growth Rate:
-637.50%
Total runs:
8
Run Growth:
5
Growth Rate:
62.50%
Total runs:
7
Run Growth:
4
Growth Rate:
57.14%
Total runs:
7
Run Growth:
7
Growth Rate:
100.00%
Total runs:
7
Run Growth:
-2
Growth Rate:
-15.38%
Total runs:
6
Run Growth:
3
Growth Rate:
50.00%
Total runs:
6
Run Growth:
-115
Growth Rate:
-1916.67%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
3
Growth Rate:
50.00%
Total runs:
6
Run Growth:
4
Growth Rate:
66.67%
Total runs:
6
Run Growth:
5
Growth Rate:
83.33%
Total runs:
6
Run Growth:
4
Growth Rate:
66.67%
Total runs:
5
Run Growth:
2
Growth Rate:
40.00%