Anbeeld / LFM2.5-1.2B-Instruct-DSpark-GGUF

huggingface.co
Total runs: 200
24-hour runs: 0
7-day runs: -16
30-day runs: 10
Model's Last Updated: September 07 2026
text-generation

Introduction of LFM2.5-1.2B-Instruct-DSpark-GGUF

Model Details of LFM2.5-1.2B-Instruct-DSpark-GGUF

LFM2.5-1.2B-Instruct DSpark GGUF

GGUF quantizations of LiquidAI DSpark draft model for LFM2.5-1.2B-Instruct .

Use with BeeLlama.cpp , a llama.cpp fork with advanced quantization features.


LFM2.5-1.2B-Instruct-DSpark

LFM2.5-DSpark is a family of speculative-decoding draft models that adapt DSpark for the LFM2.5 architecture. They allow LFM2.5 models to run faster without degrading quality.

This is a drafter for LiquidAI/LFM2.5-1.2B-Instruct . In SGLang, decoding runs about 2× faster. It also runs on-device on Apple silicon through the Metal backend.

Find more information about LFM2.5-DSpark in our blog post .

🗒️ Model Details

LFM2.5-1.2B-Instruct-DSpark is a DSpark speculative-decoding draft model with the following features:

  • Target model : LiquidAI/LFM2.5-1.2B-Instruct
  • Draft parameters : 295.7M (BF16)
  • Backbone : 5 full attention layers, hidden_size=2048 , intermediate_size=6144 with SiLU/SwiGLU, GQA with num_attention_heads=32 / num_key_value_heads=8 , head_dim=64
  • Extra heads : Markov head (rank 256) + confidence head
  • Block size : 9
  • Vocabulary : 65,536

Other models in the LFM2.5-DSpark family:

📊 Performance
Benchmarks

Speculative decoding is exact : the target verifies every proposed token, so the generated text is what the target would have produced on its own. See LiquidAI/LFM2.5-1.2B-Instruct for performance benchmarks.

Acceptance

Mean accepted tokens per decoding step, by benchmark (1×H100, batch size 1, greedy decoding). Higher means more of the draft's proposed block is accepted per target forward pass, so decoding is faster (at block size 9, the ceiling is 10).

Benchmark Accepted tokens / step
MATH-500 5.78
GSM8K 4.25
HumanEval 5.51
MBPP 5.41
MT-Bench 3.11
Mean 4.81
On-device and GPU Inference
Dataset Acceptance (of 10) Speedup on H100 Speedup on M4 Max
MATH500 6.02 2.56x
668 → 1712 tok/s
2.62x
140 → 366 tok/s
HumanEval 5.31 2.26x
664 → 1499 tok/s
2.87x
136 → 389 tok/s
MBPP 5.52 2.37x
667 → 1578 tok/s
2.74x
137 → 375 tok/s
GSM8K 4.34 1.67x
624 → 1041 tok/s
2.73x
140 → 381 tok/s
MT-Bench 3.90 1.66x
657 → 1091 tok/s
1.72x
137 → 237 tok/s
Mean 5.02 2.10x
656 → 1384 tok/s
2.54x
138 → 350 tok/s
🏃 How to run (SGLang)

Requires a build of SGLang with DSpark support for LFM2 targets ( PR #31041 ). Launch the target with the drafter attached:

python -m sglang.launch_server \
  --model-path LiquidAI/LFM2.5-1.2B-Instruct \
  --speculative-algorithm DSPARK \
  --speculative-draft-model-path LiquidAI/LFM2.5-1.2B-Instruct-DSpark \
  --speculative-draft-attention-backend flashinfer \
  --disable-radix-cache --mem-fraction-static 0.75 --port 30000

Then query the OpenAI-compatible endpoint at http://localhost:30000/v1 . The block size is read from the draft's config.json ; the baseline is the same command without the three --speculative-* flags.

📬 Contact
Citation
@article{liquidAI202626B,
  author  = {Liquid AI},
  title   = {LFM2.5-2.6B: Agents Everywhere},
  journal = {Liquid AI Blog},
  year    = {2026},
  note    = {www.liquid.ai/blog/lfm2-5-2-6b},
}
@article{liquidAI2026dspark,
  author = {Liquid AI},
  title = {LFM2.5-DSpark: Up to 3.2x Faster Inference from H100 to MacBook},
  journal = {Liquid AI Blog},
  year = {2026},
  note = {www.liquid.ai/blog/lfm2.5-dspark},
}

Runs of Anbeeld LFM2.5-1.2B-Instruct-DSpark-GGUF on huggingface.co

200
Total runs
0
24-hour runs
-18
3-day runs
-16
7-day runs
10
30-day runs

More Information About LFM2.5-1.2B-Instruct-DSpark-GGUF huggingface.co Model

More LFM2.5-1.2B-Instruct-DSpark-GGUF license Visit here:

https://choosealicense.com/licenses/other

LFM2.5-1.2B-Instruct-DSpark-GGUF huggingface.co

LFM2.5-1.2B-Instruct-DSpark-GGUF huggingface.co is an AI model on huggingface.co that provides LFM2.5-1.2B-Instruct-DSpark-GGUF's model effect (), which can be used instantly with this Anbeeld LFM2.5-1.2B-Instruct-DSpark-GGUF model. huggingface.co supports a free trial of the LFM2.5-1.2B-Instruct-DSpark-GGUF model, and also provides paid use of the LFM2.5-1.2B-Instruct-DSpark-GGUF. Support call LFM2.5-1.2B-Instruct-DSpark-GGUF model through api, including Node.js, Python, http.

LFM2.5-1.2B-Instruct-DSpark-GGUF huggingface.co Url

https://huggingface.co/Anbeeld/LFM2.5-1.2B-Instruct-DSpark-GGUF

Anbeeld LFM2.5-1.2B-Instruct-DSpark-GGUF online free

LFM2.5-1.2B-Instruct-DSpark-GGUF huggingface.co is an online trial and call api platform, which integrates LFM2.5-1.2B-Instruct-DSpark-GGUF's modeling effects, including api services, and provides a free online trial of LFM2.5-1.2B-Instruct-DSpark-GGUF, you can try LFM2.5-1.2B-Instruct-DSpark-GGUF online for free by clicking the link below.

Anbeeld LFM2.5-1.2B-Instruct-DSpark-GGUF online free url in huggingface.co:

https://huggingface.co/Anbeeld/LFM2.5-1.2B-Instruct-DSpark-GGUF

LFM2.5-1.2B-Instruct-DSpark-GGUF install

LFM2.5-1.2B-Instruct-DSpark-GGUF is an open source model from GitHub that offers a free installation service, and any user can find LFM2.5-1.2B-Instruct-DSpark-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of LFM2.5-1.2B-Instruct-DSpark-GGUF install, users can directly use LFM2.5-1.2B-Instruct-DSpark-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

LFM2.5-1.2B-Instruct-DSpark-GGUF install url in huggingface.co:

https://huggingface.co/Anbeeld/LFM2.5-1.2B-Instruct-DSpark-GGUF

Url of LFM2.5-1.2B-Instruct-DSpark-GGUF

LFM2.5-1.2B-Instruct-DSpark-GGUF huggingface.co Url

Provider of LFM2.5-1.2B-Instruct-DSpark-GGUF huggingface.co

Anbeeld
ORGANIZATIONS

Other API from Anbeeld