Total runs:
10.5K
Run Growth:
-108
Growth Rate:
-1.03%
Sponsored by
YouArt
artificialguybr / QWEN-2.5-0.5B-Synthia-II
Model's Last Updated: July 21 2026
text-generation
Introduction of QWEN-2.5-0.5B-Synthia-II
Model Details of QWEN-2.5-0.5B-Synthia-II
Qwen2.5-0.5B Synthia Fine-tuned Model
This is a fine-tuned version of Qwen/Qwen2.5-0.5B on the Synthia-v1.5-II dataset, optimized for conversational AI and instruction following.
Model Description
This model builds upon the powerful Qwen2.5-0.5B base model, which features:
- 490M parameters (360M non-embedding parameters)
- 24 transformer layers
- 14 attention heads for queries and 2 for key/values (GQA architecture)
- Support for 32,768 context length
- Advanced features like RoPE positional embeddings, SwiGLU activations, and RMSNorm
The model has been fine-tuned on the Synthia-v1.5-II dataset, which is designed to enhance instruction following and conversational abilities. The training process used careful hyperparameter tuning to maintain the base model's capabilities while optimizing for natural dialogue and instruction following.
Intended Uses & Limitations
This model is intended for:
- Conversational AI applications
- Instruction following tasks
- Text generation with strong coherence
- Multi-turn dialogue systems
Limitations:
- The model inherits the 32K token context window from the base model
- As a 0.5B parameter model, it may not match larger models in complex reasoning tasks
- Performance in non-English languages may be limited
- Users should be aware of potential biases present in the training data
Training and Evaluation Data
The model was fine-tuned on the Synthia-v1.5-II dataset, which is specifically designed for instruction-following and conversational AI. The training process used:
- 95% of data for training
- 5% for validation
- Instruction format: "[INST] {instruction} [/INST]"
Training Procedure
Training Hyperparameters
Key hyperparameters:
- Learning rate: 1e-05
- Batch size: 40 (5 micro-batch × 8 gradient accumulation steps)
- Training epochs: 3
- Optimizer: AdamW (β1=0.9, β2=0.999, ε=1e-8)
- Learning rate scheduler: Cosine with 100 warmup steps
- Sequence length: 4096
- Sample packing: Enabled
- Mixed precision: BF16
Training Results
The model was trained for 672 steps over 3 epochs, showing consistent improvement throughout the training process.
Framework Versions
- Transformers 4.46.0
- PyTorch 2.3.1+cu121
- Datasets 3.0.1
- Tokenizers 0.20.1
Citation
If you use this model, please cite both the original Qwen2.5 work and this fine-tuned version:
Runs of artificialguybr QWEN-2.5-0.5B-Synthia-II on huggingface.co
55
Total runs
1
24-hour runs
1
3-day runs
-1
7-day runs
-20
30-day runs
More Information About QWEN-2.5-0.5B-Synthia-II huggingface.co Model
Url of QWEN-2.5-0.5B-Synthia-II
QWEN-2.5-0.5B-Synthia-II huggingface.co Url
Provider of QWEN-2.5-0.5B-Synthia-II huggingface.co
Other API from artificialguybr
Updated:July 21 2026
Total runs:
1.7K
Run Growth:
87
Growth Rate:
5.03%
Total runs:
1.5K
Run Growth:
1.1K
Growth Rate:
71.15%
Total runs:
896
Run Growth:
244
Growth Rate:
27.23%
Total runs:
757
Run Growth:
475
Growth Rate:
64.10%
Total runs:
645
Run Growth:
552
Growth Rate:
85.58%
Total runs:
613
Run Growth:
244
Growth Rate:
42.88%
Total runs:
609
Run Growth:
343
Growth Rate:
57.45%
Total runs:
563
Run Growth:
-177
Growth Rate:
-31.78%
Total runs:
479
Run Growth:
106
Growth Rate:
22.13%
Total runs:
469
Run Growth:
234
Growth Rate:
51.32%
Total runs:
442
Run Growth:
236
Growth Rate:
54.00%
Total runs:
371
Run Growth:
-4
Growth Rate:
-1.11%
Total runs:
363
Run Growth:
26
Growth Rate:
7.37%
Total runs:
335
Run Growth:
78
Growth Rate:
23.15%
Total runs:
305
Run Growth:
-107
Growth Rate:
-34.74%
Total runs:
299
Run Growth:
-64
Growth Rate:
-20.92%
Total runs:
289
Run Growth:
229
Growth Rate:
81.79%
Total runs:
273
Run Growth:
26
Growth Rate:
7.41%
Total runs:
272
Run Growth:
116
Growth Rate:
42.65%
Total runs:
242
Run Growth:
50
Growth Rate:
21.65%
Total runs:
236
Run Growth:
-13
Growth Rate:
-5.42%
Total runs:
231
Run Growth:
-68
Growth Rate:
-29.06%
Total runs:
228
Run Growth:
-198
Growth Rate:
-88.39%
Total runs:
227
Run Growth:
43
Growth Rate:
21.50%
Total runs:
219
Run Growth:
17
Growth Rate:
7.76%
Total runs:
196
Run Growth:
-77
Growth Rate:
-41.40%
Total runs:
189
Run Growth:
97
Growth Rate:
51.60%
Total runs:
186
Run Growth:
51
Growth Rate:
28.98%
Total runs:
184
Run Growth:
68
Growth Rate:
44.44%
Total runs:
182
Run Growth:
74
Growth Rate:
38.54%
Total runs:
181
Run Growth:
144
Growth Rate:
79.56%
Total runs:
177
Run Growth:
30
Growth Rate:
17.65%
Total runs:
164
Run Growth:
87
Growth Rate:
53.05%
Total runs:
161
Run Growth:
-62
Growth Rate:
-38.51%
Total runs:
155
Run Growth:
-17
Growth Rate:
-10.97%
Total runs:
154
Run Growth:
32
Growth Rate:
20.78%
Total runs:
140
Run Growth:
58
Growth Rate:
42.34%
Total runs:
137
Run Growth:
104
Growth Rate:
75.91%
Total runs:
134
Run Growth:
108
Growth Rate:
81.20%
Total runs:
134
Run Growth:
-83
Growth Rate:
-60.58%
Total runs:
131
Run Growth:
95
Growth Rate:
73.64%
Total runs:
122
Run Growth:
90
Growth Rate:
75.63%
Total runs:
118
Run Growth:
40
Growth Rate:
34.78%
Total runs:
118
Run Growth:
34
Growth Rate:
28.81%
Total runs:
114
Run Growth:
19
Growth Rate:
16.67%
Total runs:
109
Run Growth:
53
Growth Rate:
50.96%
Total runs:
107
Run Growth:
-14
Growth Rate:
-13.33%
Total runs:
95
Run Growth:
-2
Growth Rate:
-2.25%
Total runs:
95
Run Growth:
82
Growth Rate:
86.32%
Total runs:
94
Run Growth:
20
Growth Rate:
21.98%
Total runs:
90
Run Growth:
-134
Growth Rate:
-152.27%
Total runs:
89
Run Growth:
-1
Growth Rate:
-1.12%
Total runs:
89
Run Growth:
14
Growth Rate:
16.47%
Total runs:
87
Run Growth:
-4
Growth Rate:
-4.71%
Total runs:
83
Run Growth:
19
Growth Rate:
22.89%
Total runs:
83
Run Growth:
17
Growth Rate:
22.08%
Total runs:
80
Run Growth:
-106
Growth Rate:
-137.66%
Total runs:
75
Run Growth:
68
Growth Rate:
90.67%
Total runs:
72
Run Growth:
7
Growth Rate:
9.72%
Total runs:
72
Run Growth:
48
Growth Rate:
67.61%
Total runs:
70
Run Growth:
15
Growth Rate:
21.74%
Total runs:
67
Run Growth:
26
Growth Rate:
41.27%
Total runs:
65
Run Growth:
33
Growth Rate:
56.90%
Total runs:
63
Run Growth:
-12
Growth Rate:
-19.05%
Total runs:
63
Run Growth:
-241
Growth Rate:
-382.54%
Total runs:
61
Run Growth:
27
Growth Rate:
44.26%
Total runs:
61
Run Growth:
2
Growth Rate:
3.28%
Total runs:
60
Run Growth:
4
Growth Rate:
6.67%
Total runs:
60
Run Growth:
7
Growth Rate:
11.67%
Total runs:
59
Run Growth:
6
Growth Rate:
11.11%
Total runs:
59
Run Growth:
-24
Growth Rate:
-37.50%
Total runs:
58
Run Growth:
7
Growth Rate:
12.07%
Total runs:
54
Run Growth:
6
Growth Rate:
11.11%
Total runs:
53
Run Growth:
-14
Growth Rate:
-25.93%
Total runs:
53
Run Growth:
23
Growth Rate:
46.94%
Total runs:
52
Run Growth:
16
Growth Rate:
31.37%
Total runs:
52
Run Growth:
15
Growth Rate:
31.25%
Total runs:
51
Run Growth:
42
Growth Rate:
82.35%
Total runs:
51
Run Growth:
18
Growth Rate:
40.00%
Total runs:
51
Run Growth:
31
Growth Rate:
60.78%
Total runs:
50
Run Growth:
23
Growth Rate:
51.11%
Total runs:
50
Run Growth:
7
Growth Rate:
14.00%
Total runs:
48
Run Growth:
5
Growth Rate:
10.42%
Total runs:
48
Run Growth:
32
Growth Rate:
66.67%
Total runs:
47
Run Growth:
0
Growth Rate:
0.00%
Total runs:
43
Run Growth:
-1
Growth Rate:
-2.44%
Total runs:
43
Run Growth:
24
Growth Rate:
54.55%
Total runs:
43
Run Growth:
0
Growth Rate:
0.00%
Total runs:
42
Run Growth:
5
Growth Rate:
11.90%
Total runs:
42
Run Growth:
9
Growth Rate:
21.43%
Total runs:
41
Run Growth:
12
Growth Rate:
29.27%
Total runs:
39
Run Growth:
-9
Growth Rate:
-23.08%
Total runs:
36
Run Growth:
-6
Growth Rate:
-16.67%
Total runs:
35
Run Growth:
32
Growth Rate:
91.43%
Total runs:
34
Run Growth:
12
Growth Rate:
35.29%
Total runs:
34
Run Growth:
10
Growth Rate:
29.41%