Sponsored by
APIMart
AngelSlim / Hy3-DFly-Block8-Think-High
Model's Last Updated: July 29 2026
Introduction of Hy3-DFly-Block8-Think-High
Model Details of Hy3-DFly-Block8-Think-High
A more accessible, comprehensive, and efficient toolkit for large model compression.
✒️
TechnicalReport
| 📖
Documentation
| 🤗
Hugging Face
| 🤖
ModelScope
Hy3-A21B DFly High-Thinking Drafter
Model Summary
This repository contains a DFly drafter model trained for speculative decoding with Hy3-A21B under the high-thinking inference setting. The model is trained with AngelSpec and is designed to propose candidate tokens that are verified by the Hy3-A21B target model.
This drafter is not a standalone chat model. It should be deployed with the matching Hy3-A21B target model and the corresponding high-thinking target-side inference mode.
- Target model: Hy3-A21B
- Drafter type: DFly
- Inference mode: High-thinking
- Training framework: AngelSpec
- Recommended serving backend: vLLM speculative decoding
- Recommended speculative tokens: 8
Training and Thinking-Mode Specialization
High-thinking and no-thinking decoding induce different hidden-state and acceptance distributions. As a result, a drafter trained for one thinking mode should not be assumed to transfer optimally to the other.
This checkpoint is the high-thinking DFly drafter : it is trained with high-thinking target-side data and should be evaluated and deployed with high-thinking prompts / target-side generation behavior. The matched high-thinking configuration is important for preserving acceptance length and speculative-decoding efficiency.
Evaluation: Accepted Length
The following table reports this model's mean accepted length on Hy3-A21B under the high-thinking setting at temperature 1 . The average is computed over the six displayed benchmarks.
| Target Model | Drafter | Train Data | Test Data | Math500 | GSM8K | HumanEval | MBPP | LiveCodeBench | MT-Bench | Avg. |
|---|---|---|---|---|---|---|---|---|---|---|
| Hy3-A21B | DFly | High-think | High-think | 4.29 | 4.47 | 4.76 | 4.74 | 3.92 | 3.42 | 4.27 |
The high-thinking drafter is specialized for high-thinking inference. It is especially important for reasoning- and chat-oriented workloads where the target-side thinking mode changes the acceptance distribution.
Deployment
Set
TARGET
to the Hy3-A21B target model path or repository and
DRAFT
to the corresponding drafter checkpoint. The relevant inference code can be found in PR
https://github.com/vllm-project/vllm/pull/50246
.
export TARGET="<path-or-hf-repo-to-hy3-a21b-target>"
export DRAFT="<path-or-hf-repo-to-hy3-dfly-high-thinking-drafter>"
vllm serve "$TARGET" \
--tensor-parallel-size 8 \
--speculative-config "{"method":"dspark", "model":"$DRAFT", "num_speculative_tokens":7}"
Technical Report
For more details, see the technical report:
AngelSpec: Towards Real-World High Performance Inference with Speculative Decoding
arXiv: https://arxiv.org/abs/2607.25852
Runs of AngelSlim Hy3-DFly-Block8-Think-High on huggingface.co
23
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
-1
30-day runs
More Information About Hy3-DFly-Block8-Think-High huggingface.co Model
Url of Hy3-DFly-Block8-Think-High
Hy3-DFly-Block8-Think-High huggingface.co Url
Provider of Hy3-DFly-Block8-Think-High huggingface.co
Other API from AngelSlim
Total runs:
123.2K
Run Growth:
-204.0K
Growth Rate:
-165.73%
Total runs:
94.6K
Run Growth:
42.4K
Growth Rate:
44.18%
Total runs:
3.1K
Run Growth:
-1.2K
Growth Rate:
-38.52%
Total runs:
2.4K
Run Growth:
-673
Growth Rate:
-27.97%
Total runs:
1.6K
Run Growth:
211
Growth Rate:
14.06%
Total runs:
823
Run Growth:
130
Growth Rate:
15.82%
Total runs:
692
Run Growth:
-786
Growth Rate:
-123.20%
Total runs:
632
Run Growth:
524
Growth Rate:
82.91%
Total runs:
605
Run Growth:
232
Growth Rate:
47.44%
Total runs:
339
Run Growth:
-399
Growth Rate:
-126.27%
Total runs:
320
Run Growth:
-378
Growth Rate:
-124.75%
Total runs:
287
Run Growth:
186
Growth Rate:
64.58%
Total runs:
255
Run Growth:
-65
Growth Rate:
-25.39%
Total runs:
225
Run Growth:
-558
Growth Rate:
-253.64%
Total runs:
212
Run Growth:
92
Growth Rate:
43.40%
Total runs:
162
Run Growth:
-942
Growth Rate:
-581.48%
Total runs:
151
Run Growth:
-1.3K
Growth Rate:
-842.76%
Total runs:
137
Run Growth:
-289
Growth Rate:
-202.10%
Total runs:
130
Run Growth:
-263
Growth Rate:
-202.31%
Total runs:
96
Run Growth:
-11
Growth Rate:
-9.32%
Total runs:
91
Run Growth:
-25
Growth Rate:
-26.60%
Total runs:
86
Run Growth:
45
Growth Rate:
51.14%
Total runs:
84
Run Growth:
-18
Growth Rate:
-20.69%
Total runs:
82
Run Growth:
-2
Growth Rate:
-2.44%
Total runs:
77
Run Growth:
-99
Growth Rate:
-128.57%
Total runs:
75
Run Growth:
18
Growth Rate:
22.50%
Total runs:
71
Run Growth:
52
Growth Rate:
73.24%
Total runs:
61
Run Growth:
-81
Growth Rate:
-126.56%
Total runs:
58
Run Growth:
51
Growth Rate:
66.23%
Total runs:
56
Run Growth:
10
Growth Rate:
16.67%
Total runs:
40
Run Growth:
39
Growth Rate:
68.42%
Total runs:
37
Run Growth:
16
Growth Rate:
43.24%
Total runs:
36
Run Growth:
26
Growth Rate:
70.27%
Total runs:
35
Run Growth:
-10
Growth Rate:
-30.30%
Total runs:
35
Run Growth:
-4
Growth Rate:
-10.81%
Total runs:
35
Run Growth:
19
Growth Rate:
52.78%
Total runs:
34
Run Growth:
18
Growth Rate:
52.94%
Total runs:
34
Run Growth:
15
Growth Rate:
42.86%
Total runs:
33
Run Growth:
8
Growth Rate:
24.24%
Total runs:
33
Run Growth:
20
Growth Rate:
51.28%
Total runs:
31
Run Growth:
18
Growth Rate:
56.25%
Total runs:
31
Run Growth:
13
Growth Rate:
41.94%
Total runs:
30
Run Growth:
1
Growth Rate:
3.23%
Total runs:
30
Run Growth:
4
Growth Rate:
13.33%
Total runs:
29
Run Growth:
0
Growth Rate:
0.00%
Total runs:
29
Run Growth:
0
Growth Rate:
0.00%
Total runs:
29
Run Growth:
-2
Growth Rate:
-7.14%
Total runs:
28
Run Growth:
21
Growth Rate:
70.00%
Total runs:
28
Run Growth:
-253
Growth Rate:
-903.57%
Total runs:
27
Run Growth:
4
Growth Rate:
13.79%
Total runs:
27
Run Growth:
17
Growth Rate:
62.96%
Total runs:
26
Run Growth:
10
Growth Rate:
38.46%
Total runs:
26
Run Growth:
9
Growth Rate:
36.00%
Total runs:
26
Run Growth:
-1
Growth Rate:
-3.85%
Total runs:
25
Run Growth:
-21
Growth Rate:
-84.00%
Total runs:
25
Run Growth:
16
Growth Rate:
64.00%
Total runs:
25
Run Growth:
14
Growth Rate:
58.33%
Total runs:
25
Run Growth:
10
Growth Rate:
38.46%
Total runs:
25
Run Growth:
0
Growth Rate:
0.00%
Total runs:
25
Run Growth:
-29
Growth Rate:
-116.00%
Total runs:
24
Run Growth:
7
Growth Rate:
28.00%
Total runs:
24
Run Growth:
14
Growth Rate:
56.00%
Total runs:
24
Run Growth:
7
Growth Rate:
26.92%
Total runs:
23
Run Growth:
-1
Growth Rate:
-4.17%
Total runs:
22
Run Growth:
3
Growth Rate:
10.00%
Total runs:
22
Run Growth:
0
Growth Rate:
0.00%
Total runs:
21
Run Growth:
10
Growth Rate:
47.62%
Total runs:
21
Run Growth:
7
Growth Rate:
35.00%
Total runs:
20
Run Growth:
-15
Growth Rate:
-78.95%
Total runs:
19
Run Growth:
0
Growth Rate:
0.00%
Total runs:
19
Run Growth:
-5
Growth Rate:
-27.78%
Total runs:
19
Run Growth:
6
Growth Rate:
30.00%
Total runs:
19
Run Growth:
9
Growth Rate:
42.86%
Total runs:
19
Run Growth:
1
Growth Rate:
4.76%
Total runs:
18
Run Growth:
8
Growth Rate:
44.44%
Total runs:
18
Run Growth:
4
Growth Rate:
23.53%
Total runs:
18
Run Growth:
-7
Growth Rate:
-41.18%
Total runs:
18
Run Growth:
2
Growth Rate:
15.38%
Total runs:
18
Run Growth:
3
Growth Rate:
16.67%
Total runs:
17
Run Growth:
-8
Growth Rate:
-44.44%
Total runs:
17
Run Growth:
3
Growth Rate:
18.75%
Total runs:
17
Run Growth:
7
Growth Rate:
41.18%
Total runs:
17
Run Growth:
0
Growth Rate:
0.00%
Total runs:
17
Run Growth:
-27
Growth Rate:
-122.73%
Total runs:
17
Run Growth:
0
Growth Rate:
0.00%