Total runs:
10.5K
Run Growth:
-108
Growth Rate:
-1.03%
Sponsored by
PostMcpAi
artificialguybr / QWEN-2.5-0.5B-Synthia-I
Model's Last Updated: July 21 2026
text-generation
Introduction of QWEN-2.5-0.5B-Synthia-I
Model Details of QWEN-2.5-0.5B-Synthia-I
Qwen2.5-0.5B Fine-tuned on Synthia v1.5-I
This model is a fine-tuned version of Qwen/Qwen2.5-0.5B on the Synthia v1.5-I dataset, which contains over 20.7k instruction-following examples.
Model Description
Qwen2.5-0.5B is part of the latest Qwen2.5 series of large language models. The base model brings significant improvements in:
- Instruction following and generating long texts
- Understanding structured data and generating structured outputs
- Support for over 29 languages
- Long context support up to 32,768 tokens
This fine-tuned version enhances the base model's instruction-following capabilities through training on the Synthia v1.5-I dataset.
Model Architecture
- Type: Causal Language Model
- Parameters: 0.49B (0.36B non-embedding)
- Layers: 24
- Attention Heads: 14 for Q and 2 for KV (GQA)
- Context Length: 32,768 tokens
- Training Framework: Transformers 4.45.0.dev0
Intended Uses & Limitations
This model is intended for:
- Instruction following and task completion
- Text generation and completion
- Conversational AI applications
The model inherits the multilingual capabilities and long context support of the base Qwen2.5-0.5B model, while being specifically tuned for instruction following.
Training Procedure
Training Data
The model was fine-tuned on the Synthia v1.5-I dataset containing 20.7k instruction-following examples.
Training Hyperparameters
The following hyperparameters were used during training:
- Learning rate: 1e-05
- Train batch size: 5
- Eval batch size: 5
- Seed: 42
- Gradient accumulation steps: 8
- Total train batch size: 40
- Optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- LR scheduler type: cosine
- LR scheduler warmup steps: 100
- Number of epochs: 3
- Sequence length: 4096
- Sample packing: enabled
- Pad to sequence length: enabled
Framework Versions
- Transformers 4.45.0.dev0
- Pytorch 2.3.1+cu121
- Datasets 2.21.0
- Tokenizers 0.19.1
See axolotl config
axolotl version:
0.4.1
Runs of artificialguybr QWEN-2.5-0.5B-Synthia-I on huggingface.co
43
Total runs
-1
24-hour runs
0
3-day runs
7
7-day runs
0
30-day runs
More Information About QWEN-2.5-0.5B-Synthia-I huggingface.co Model
Url of QWEN-2.5-0.5B-Synthia-I
QWEN-2.5-0.5B-Synthia-I huggingface.co Url
Provider of QWEN-2.5-0.5B-Synthia-I huggingface.co
Other API from artificialguybr
Updated:July 21 2026
Total runs:
1.7K
Run Growth:
87
Growth Rate:
5.03%
Total runs:
1.5K
Run Growth:
1.1K
Growth Rate:
71.15%
Total runs:
896
Run Growth:
244
Growth Rate:
27.23%
Total runs:
757
Run Growth:
475
Growth Rate:
64.10%
Total runs:
666
Run Growth:
552
Growth Rate:
85.58%
Total runs:
613
Run Growth:
244
Growth Rate:
42.88%
Total runs:
609
Run Growth:
343
Growth Rate:
57.45%
Total runs:
563
Run Growth:
-177
Growth Rate:
-31.78%
Total runs:
479
Run Growth:
106
Growth Rate:
22.13%
Total runs:
469
Run Growth:
234
Growth Rate:
51.32%
Total runs:
442
Run Growth:
236
Growth Rate:
54.00%
Total runs:
371
Run Growth:
-4
Growth Rate:
-1.11%
Total runs:
363
Run Growth:
26
Growth Rate:
7.37%
Total runs:
335
Run Growth:
78
Growth Rate:
23.15%
Total runs:
305
Run Growth:
-107
Growth Rate:
-34.74%
Total runs:
299
Run Growth:
-64
Growth Rate:
-20.92%
Total runs:
289
Run Growth:
229
Growth Rate:
81.79%
Total runs:
273
Run Growth:
26
Growth Rate:
7.41%
Total runs:
272
Run Growth:
116
Growth Rate:
42.65%
Total runs:
242
Run Growth:
50
Growth Rate:
21.65%
Total runs:
236
Run Growth:
-13
Growth Rate:
-5.42%
Total runs:
231
Run Growth:
-68
Growth Rate:
-29.06%
Total runs:
228
Run Growth:
-198
Growth Rate:
-88.39%
Total runs:
227
Run Growth:
43
Growth Rate:
21.50%
Total runs:
219
Run Growth:
17
Growth Rate:
7.76%
Total runs:
196
Run Growth:
-77
Growth Rate:
-41.40%
Total runs:
189
Run Growth:
97
Growth Rate:
51.60%
Total runs:
186
Run Growth:
51
Growth Rate:
28.98%
Total runs:
184
Run Growth:
68
Growth Rate:
44.44%
Total runs:
182
Run Growth:
74
Growth Rate:
38.54%
Total runs:
181
Run Growth:
144
Growth Rate:
79.56%
Total runs:
177
Run Growth:
30
Growth Rate:
17.65%
Total runs:
164
Run Growth:
87
Growth Rate:
53.05%
Total runs:
161
Run Growth:
-62
Growth Rate:
-38.51%
Total runs:
155
Run Growth:
-17
Growth Rate:
-10.97%
Total runs:
154
Run Growth:
32
Growth Rate:
20.78%
Total runs:
140
Run Growth:
58
Growth Rate:
42.34%
Total runs:
137
Run Growth:
104
Growth Rate:
75.91%
Total runs:
134
Run Growth:
108
Growth Rate:
81.20%
Total runs:
134
Run Growth:
-83
Growth Rate:
-60.58%
Total runs:
131
Run Growth:
95
Growth Rate:
73.64%
Total runs:
122
Run Growth:
90
Growth Rate:
75.63%
Total runs:
118
Run Growth:
40
Growth Rate:
34.78%
Total runs:
118
Run Growth:
34
Growth Rate:
28.81%
Total runs:
114
Run Growth:
19
Growth Rate:
16.67%
Total runs:
109
Run Growth:
53
Growth Rate:
50.96%
Total runs:
107
Run Growth:
-14
Growth Rate:
-13.33%
Total runs:
95
Run Growth:
-2
Growth Rate:
-2.25%
Total runs:
95
Run Growth:
82
Growth Rate:
86.32%
Total runs:
94
Run Growth:
20
Growth Rate:
21.98%
Total runs:
90
Run Growth:
-134
Growth Rate:
-152.27%
Total runs:
89
Run Growth:
-1
Growth Rate:
-1.12%
Total runs:
89
Run Growth:
14
Growth Rate:
16.47%
Total runs:
87
Run Growth:
-4
Growth Rate:
-4.71%
Total runs:
83
Run Growth:
19
Growth Rate:
22.89%
Total runs:
83
Run Growth:
17
Growth Rate:
22.08%
Total runs:
80
Run Growth:
-106
Growth Rate:
-137.66%
Total runs:
75
Run Growth:
68
Growth Rate:
90.67%
Total runs:
72
Run Growth:
7
Growth Rate:
9.72%
Total runs:
72
Run Growth:
48
Growth Rate:
67.61%
Total runs:
70
Run Growth:
15
Growth Rate:
21.74%
Total runs:
69
Run Growth:
-241
Growth Rate:
-382.54%
Total runs:
67
Run Growth:
26
Growth Rate:
41.27%
Total runs:
65
Run Growth:
33
Growth Rate:
56.90%
Total runs:
63
Run Growth:
-12
Growth Rate:
-19.05%
Total runs:
62
Run Growth:
27
Growth Rate:
44.26%
Total runs:
61
Run Growth:
2
Growth Rate:
3.28%
Total runs:
60
Run Growth:
4
Growth Rate:
6.67%
Total runs:
60
Run Growth:
7
Growth Rate:
11.67%
Total runs:
59
Run Growth:
6
Growth Rate:
11.11%
Total runs:
59
Run Growth:
-24
Growth Rate:
-37.50%
Total runs:
58
Run Growth:
7
Growth Rate:
12.07%
Total runs:
55
Run Growth:
-20
Growth Rate:
-36.36%
Total runs:
54
Run Growth:
6
Growth Rate:
11.11%
Total runs:
53
Run Growth:
-14
Growth Rate:
-25.93%
Total runs:
53
Run Growth:
23
Growth Rate:
46.94%
Total runs:
52
Run Growth:
16
Growth Rate:
31.37%
Total runs:
52
Run Growth:
15
Growth Rate:
31.25%
Total runs:
51
Run Growth:
42
Growth Rate:
82.35%
Total runs:
51
Run Growth:
18
Growth Rate:
40.00%
Total runs:
51
Run Growth:
31
Growth Rate:
60.78%
Total runs:
50
Run Growth:
23
Growth Rate:
51.11%
Total runs:
50
Run Growth:
7
Growth Rate:
14.00%
Total runs:
48
Run Growth:
5
Growth Rate:
10.42%
Total runs:
48
Run Growth:
32
Growth Rate:
66.67%
Total runs:
47
Run Growth:
0
Growth Rate:
0.00%
Total runs:
43
Run Growth:
-1
Growth Rate:
-2.44%
Total runs:
43
Run Growth:
24
Growth Rate:
54.55%
Total runs:
42
Run Growth:
5
Growth Rate:
11.90%
Total runs:
42
Run Growth:
9
Growth Rate:
21.43%
Total runs:
41
Run Growth:
12
Growth Rate:
29.27%
Total runs:
39
Run Growth:
-9
Growth Rate:
-23.08%
Total runs:
36
Run Growth:
-6
Growth Rate:
-16.67%
Total runs:
35
Run Growth:
32
Growth Rate:
91.43%
Total runs:
34
Run Growth:
12
Growth Rate:
35.29%
Total runs:
34
Run Growth:
10
Growth Rate:
29.41%
Total runs:
34
Run Growth:
5
Growth Rate:
14.71%