inference-optimization / ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16

huggingface.co
Total runs: 30
24-hour runs: -2
7-day runs: 2
30-day runs: 10
Model's Last Updated: August 22 2026

Introduction of ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16

Model Details of ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16

ctest: Qwen3-8B EAGLE-3 speculator — FP8 hidden-states ablation (bf16)

Test checkpoint — not a production release. Trained to validate the FP8-quantized hidden-states transfer backend added in vllm-project/speculators#1028 (draft, reviving #491 ).

  • Verifier: Qwen/Qwen3-8B
  • Algorithm: eagle3
  • Hidden-states precision during training: bf16 ( existing bf16 file backend )
  • Training data: 5K magpie + 5K ultrachat samples from inference-optimization/Dataset-Qwen3-235B-Instruct

This is one of a matched pair ( ...-fp8ablation-bf16 / ...-fp8ablation-fp8 ) trained identically except for the hidden-states transfer precision, to isolate the effect of FP8 quantization on speculator quality. See the sibling repo for the other precision.

Validation metrics (final epoch)
  • loss_0_epoch : 1.059357
  • full_acc_0_epoch : 0.694162
  • cond_acc_0_epoch : 0.694162
  • loss_1_epoch : 1.374979
  • full_acc_1_epoch : 0.470217
  • cond_acc_1_epoch : 0.677388
  • loss_2_epoch : 1.575933
  • full_acc_2_epoch : 0.315562
  • cond_acc_2_epoch : 0.671088
  • loss_epoch : 4.010267
guidellm serving eval

See acceptance.csv in this repo for the full per-subset guidellm breakdown (9 subset rows).

Full ablation writeup, all 6 checkpoints' results, exact commands, and code: see the results package referenced from PR #1028.

Runs of inference-optimization ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 on huggingface.co

30
Total runs
-2
24-hour runs
0
3-day runs
2
7-day runs
10
30-day runs

More Information About ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 huggingface.co Model

ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 huggingface.co

ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 huggingface.co is an AI model on huggingface.co that provides ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16's model effect (), which can be used instantly with this inference-optimization ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 model. huggingface.co supports a free trial of the ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 model, and also provides paid use of the ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16. Support call ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 model through api, including Node.js, Python, http.

ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 huggingface.co Url

https://huggingface.co/inference-optimization/ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16

inference-optimization ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 online free

ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 huggingface.co is an online trial and call api platform, which integrates ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16's modeling effects, including api services, and provides a free online trial of ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16, you can try ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 online for free by clicking the link below.

inference-optimization ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 online free url in huggingface.co:

https://huggingface.co/inference-optimization/ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16

ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 install

ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 is an open source model from GitHub that offers a free installation service, and any user can find ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 on GitHub to install. At the same time, huggingface.co provides the effect of ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 install, users can directly use ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 install url in huggingface.co:

https://huggingface.co/inference-optimization/ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16

Url of ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16

ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 huggingface.co Url

Provider of ctest-Qwen3-8B-speculator.eagle3-fp8ablation-bf16 huggingface.co

inference-optimization
ORGANIZATIONS

Other API from inference-optimization