Sponsored by iMean AI Trip Planner
Toolify Toolify logo
AI Models
MOASpec-Llama-3-8B-Instruct

huawei-noah / MOASpec-Llama-3-8B-Instruct

Run on huggingface.co
huggingface.co
Total runs: 2
24-hour runs: 0
7-day runs: -2
30-day runs: -3
Model's Last Updated: January 08 2025

Introduction of MOASpec-Llama-3-8B-Instruct

Model Details of MOASpec-Llama-3-8B-Instruct

Mixture of Attentions for Speculative Decoding

This checkpoint was obtained from " Mixture of Attentions For Speculative Decoding " by Matthieu Zimmer*, Milan Gritta*, Gerasimos Lampouras, Haitham Bou Ammar, and Jun Wang. The paper introduces a novel architecture for speculative decoding that enhances the speed of large language model (LLM) inference.

It is supported in vLLM see our Github repository .

Checkpoints
Base Model MOA Spec on Hugging Face Base Model Parameters MOA Spec Parameters
meta-llama/Meta-Llama-3-8B-Instruct huawei-noah/MOASpec-Llama-3-8B-Instruct 8B 0.25B
Citation

If you use this code or this checkpoint in your research, please cite our paper: 

@misc{zimmer2024mixtureattentionsspeculativedecoding,
      title={Mixture of Attentions For Speculative Decoding}, 
      author={Matthieu Zimmer and Milan Gritta and Gerasimos Lampouras and Haitham Bou Ammar and Jun Wang},
      year={2024},
      eprint={2410.03804},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2410.03804}, 
}
License

This project is licensed under the MIT License. See the LICENSE file for more details.

Disclaimer: This open source project is not an official Huawei product, Huawei is not expected to provide support for this project.

Runs of huawei-noah MOASpec-Llama-3-8B-Instruct on huggingface.co

2
Total runs
0
24-hour runs
0
3-day runs
-2
7-day runs
-3
30-day runs

More Information About MOASpec-Llama-3-8B-Instruct huggingface.co Model

MOASpec-Llama-3-8B-Instruct huggingface.co

MOASpec-Llama-3-8B-Instruct huggingface.co is an AI model on huggingface.co that provides MOASpec-Llama-3-8B-Instruct's model effect (), which can be used instantly with this huawei-noah MOASpec-Llama-3-8B-Instruct model. huggingface.co supports a free trial of the MOASpec-Llama-3-8B-Instruct model, and also provides paid use of the MOASpec-Llama-3-8B-Instruct. Support call MOASpec-Llama-3-8B-Instruct model through api, including Node.js, Python, http.

MOASpec-Llama-3-8B-Instruct huggingface.co Url

https://huggingface.co/huawei-noah/MOASpec-Llama-3-8B-Instruct

huawei-noah MOASpec-Llama-3-8B-Instruct online free

MOASpec-Llama-3-8B-Instruct huggingface.co is an online trial and call api platform, which integrates MOASpec-Llama-3-8B-Instruct's modeling effects, including api services, and provides a free online trial of MOASpec-Llama-3-8B-Instruct, you can try MOASpec-Llama-3-8B-Instruct online for free by clicking the link below.

huawei-noah MOASpec-Llama-3-8B-Instruct online free url in huggingface.co:

https://huggingface.co/huawei-noah/MOASpec-Llama-3-8B-Instruct

MOASpec-Llama-3-8B-Instruct install

MOASpec-Llama-3-8B-Instruct is an open source model from GitHub that offers a free installation service, and any user can find MOASpec-Llama-3-8B-Instruct on GitHub to install. At the same time, huggingface.co provides the effect of MOASpec-Llama-3-8B-Instruct install, users can directly use MOASpec-Llama-3-8B-Instruct installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

MOASpec-Llama-3-8B-Instruct install url in huggingface.co:

https://huggingface.co/huawei-noah/MOASpec-Llama-3-8B-Instruct

Url of MOASpec-Llama-3-8B-Instruct

MOASpec-Llama-3-8B-Instruct huggingface.co Url

Provider of MOASpec-Llama-3-8B-Instruct huggingface.co

huawei-noah
ORGANIZATIONS
huggingface.co

Other API from huawei-noah

 huggingface.co
huawei-noah/JABERv2

Total runs: 35
Run Growth: 24
Growth Rate: 66.67%
Updated:January 18 2024
huggingface.co
huawei-noah/AT5S

Total runs: 17
Run Growth: 6
Growth Rate: 35.29%
Updated:December 22 2022
huggingface.co
huawei-noah/AT5Bv2

Total runs: 17
Run Growth: 9
Growth Rate: 52.94%
Updated:January 18 2024
huggingface.co
huawei-noah/AT5B

Total runs: 13
Run Growth: 3
Growth Rate: 23.08%
Updated:December 22 2022
huggingface.co
huawei-noah/AT5Sv2

Total runs: 10
Run Growth: 2
Growth Rate: 20.00%
Updated:January 18 2024
huggingface.co
huawei-noah/JABER

Total runs: 1
Run Growth: 1
Growth Rate: 100.00%
Updated:January 05 2022
huggingface.co
huawei-noah/aipq

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:September 27 2023