This model is the downstream distribution of
SparseLLM/ProSparse-LLaMA-2-13B
in PowerInfer GGUF format consisting of the LLM model weights and predictor weights.
Citation
Please kindly cite using the following BibTeX:
@article{song2024prosparse,
title={{ProSparse}: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models},
author={Song, Chenyang and Han, Xu and Zhang, Zhengyan and Hu, Shengding and Shi, Xiyu and Li, Kuai and Chen, Chen and Liu, Zhiyuan and Li, Guangli and Yang, Tao and Sun, Maosong},
year={2024},
journal={arXiv preprint arXiv:2402.13516},
url={https://arxiv.org/pdf/2402.13516.pdf}
}
Runs of SparseLLM prosparse-llama-2-13b-gguf on huggingface.co
42
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About prosparse-llama-2-13b-gguf huggingface.co Model
More prosparse-llama-2-13b-gguf license Visit here:
prosparse-llama-2-13b-gguf huggingface.co is an AI model on huggingface.co that provides prosparse-llama-2-13b-gguf's model effect (), which can be used instantly with this SparseLLM prosparse-llama-2-13b-gguf model. huggingface.co supports a free trial of the prosparse-llama-2-13b-gguf model, and also provides paid use of the prosparse-llama-2-13b-gguf. Support call prosparse-llama-2-13b-gguf model through api, including Node.js, Python, http.
prosparse-llama-2-13b-gguf huggingface.co is an online trial and call api platform, which integrates prosparse-llama-2-13b-gguf's modeling effects, including api services, and provides a free online trial of prosparse-llama-2-13b-gguf, you can try prosparse-llama-2-13b-gguf online for free by clicking the link below.
SparseLLM prosparse-llama-2-13b-gguf online free url in huggingface.co:
prosparse-llama-2-13b-gguf is an open source model from GitHub that offers a free installation service, and any user can find prosparse-llama-2-13b-gguf on GitHub to install. At the same time, huggingface.co provides the effect of prosparse-llama-2-13b-gguf install, users can directly use prosparse-llama-2-13b-gguf installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
prosparse-llama-2-13b-gguf install url in huggingface.co: