Test checkpoint — not a production release.
Trained to validate the FP8-quantized
hidden-states transfer backend added in
vllm-project/speculators#1028
(draft, reviving
#491
).
Training data: 5K magpie + 5K ultrachat samples from
inference-optimization/Dataset-Qwen3-235B-Instruct
This is one of a matched pair (
...-fp8ablation-bf16
/
...-fp8ablation-fp8
) trained
identically except for the hidden-states transfer precision, to isolate the effect of
FP8 quantization on speculator quality. See the sibling repo for the other precision.
Validation metrics (final epoch)
loss_0_epoch
: 1.059357
full_acc_0_epoch
: 0.694162
cond_acc_0_epoch
: 0.694162
loss_1_epoch
: 1.374979
full_acc_1_epoch
: 0.470217
cond_acc_1_epoch
: 0.677388
loss_2_epoch
: 1.575933
full_acc_2_epoch
: 0.315562
cond_acc_2_epoch
: 0.671088
loss_epoch
: 4.010267
guidellm serving eval
See
acceptance.csv
in this repo for the full per-subset guidellm breakdown (9 subset rows).
Full ablation writeup, all 6 checkpoints' results, exact commands, and code:
see the results package referenced from PR #1028.
Runs of inference-optimization ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 on huggingface.co
30
Total runs
-2
24-hour runs
0
3-day runs
2
7-day runs
10
30-day runs
More Information About ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 huggingface.co Model
ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 huggingface.co is an AI model on huggingface.co that provides ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16's model effect (), which can be used instantly with this inference-optimization ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 model. huggingface.co supports a free trial of the ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 model, and also provides paid use of the ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16. Support call ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 model through api, including Node.js, Python, http.
ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 huggingface.co is an online trial and call api platform, which integrates ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16's modeling effects, including api services, and provides a free online trial of ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16, you can try ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 online for free by clicking the link below.
inference-optimization ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 online free url in huggingface.co:
ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 is an open source model from GitHub that offers a free installation service, and any user can find ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 on GitHub to install. At the same time, huggingface.co provides the effect of ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 install, users can directly use ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 install url in huggingface.co: