Laguna-XS.2-speculator.dflash huggingface.co api & poolside Laguna-XS.2-speculator.dflash github AI Model

Introduction of Laguna-XS.2-speculator.dflash

Model Details of Laguna-XS.2-speculator.dflash

poolside/Laguna-XS.2-speculator.dflash

This is a DFlash speculator model for poolside/Laguna-XS.2 .

Training Details

This model was trained using the Speculators library on a combination of Magpie-Align/Magpie-Llama-3.1-Pro-300K-Filtered and the train_sft split of HuggingFaceH4/ultrachat_200k . Responses were regenerated by Laguna-XS.2 (with reasoning).

Model Specifications


Base Model	poolside/Laguna-XS.2
Chat Template	poolside/Laguna-XS.2 (use `/chat/completions` endpoint)
Format	Safetensors
License	Apache 2.0
Validation Hardware	Nvidia A100

Deployment

# Install vLLM from the required PR
pip install git+https://github.com/vllm-project/vllm.git@refs/pull/41880/head

# Deploy with speculative decoding
VLLM_USE_DEEP_GEMM=0 vllm serve poolside/Laguna-XS.2 \
    --tensor-parallel-size 1 \
    --max-model-len 16384 \
    --tool-call-parser poolside_v1 \
    --reasoning-parser poolside_v1 \
    --enable-auto-tool-choice \
    --default-chat-template-kwargs '{"enable_thinking": true}' \
    --speculative-config '{
        "model": "poolside/Laguna-XS.2-speculator.dflash",
        "num_speculative_tokens": 7,
        "method": "dflash"
    }'

Preliminary Evaluations

Per-position token acceptance rates across datasets: (with reasoning enabled)

Dataset	Pos 1	Pos 2	Pos 3	Pos 4	Pos 5	Pos 6	Pos 7	Avg Length
HumanEval	74.0%	48.6%	29.9%	17.7%	9.9%	5.1%	2.4%	2.876
math_reasoning	76.9%	53.2%	34.6%	21.2%	12.1%	6.0%	2.6%	3.066
qa	68.5%	41.8%	24.8%	14.7%	8.4%	4.6%	2.2%	2.650
question	70.6%	44.1%	26.2%	15.0%	8.4%	4.5%	2.3%	2.711
rag	71.7%	45.7%	27.6%	16.0%	8.9%	4.8%	2.3%	2.770
summarization	68.8%	40.8%	22.7%	12.3%	6.5%	3.3%	1.5%	2.559
translation	70.8%	44.3%	25.0%	13.0%	6.5%	3.1%	1.2%	2.639
writing	70.9%	44.6%	26.8%	15.8%	9.4%	5.4%	2.3%	2.752

References

Paper : DFlash: Block Diffusion for Flash Speculative Decoding

Runs of poolside Laguna-XS.2-speculator.dflash on huggingface.co

215

Total runs

24-hour runs

3-day runs

7-day runs

30-day runs

More Information About Laguna-XS.2-speculator.dflash huggingface.co Model

More Laguna-XS.2-speculator.dflash license Visit here:

https://choosealicense.com/licenses/apache-2.0

Laguna-XS.2-speculator.dflash huggingface.co

Laguna-XS.2-speculator.dflash huggingface.co is an AI model on huggingface.co that provides Laguna-XS.2-speculator.dflash's model effect (), which can be used instantly with this poolside Laguna-XS.2-speculator.dflash model. huggingface.co supports a free trial of the Laguna-XS.2-speculator.dflash model, and also provides paid use of the Laguna-XS.2-speculator.dflash. Support call Laguna-XS.2-speculator.dflash model through api, including Node.js, Python, http.

Laguna-XS.2-speculator.dflash huggingface.co Url

https://huggingface.co/poolside/Laguna-XS.2-speculator.dflash

poolside Laguna-XS.2-speculator.dflash online free

Laguna-XS.2-speculator.dflash huggingface.co is an online trial and call api platform, which integrates Laguna-XS.2-speculator.dflash's modeling effects, including api services, and provides a free online trial of Laguna-XS.2-speculator.dflash, you can try Laguna-XS.2-speculator.dflash online for free by clicking the link below.

poolside Laguna-XS.2-speculator.dflash online free url in huggingface.co:

https://huggingface.co/poolside/Laguna-XS.2-speculator.dflash

Laguna-XS.2-speculator.dflash install

Laguna-XS.2-speculator.dflash is an open source model from GitHub that offers a free installation service, and any user can find Laguna-XS.2-speculator.dflash on GitHub to install. At the same time, huggingface.co provides the effect of Laguna-XS.2-speculator.dflash install, users can directly use Laguna-XS.2-speculator.dflash installed effect in huggingface.co for debugging and trial. It also supports api for free installation.