Note: The folder
predictors_clip15
contains the activation predictors trained with data only reserving top 15% activation values.
Citation
Please kindly cite using the following BibTeX:
@article{song2024prosparse,
title={{ProSparse}: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models},
author={Song, Chenyang and Han, Xu and Zhang, Zhengyan and Hu, Shengding and Shi, Xiyu and Li, Kuai and Chen, Chen and Liu, Zhiyuan and Li, Guangli and Yang, Tao and Sun, Maosong},
year={2024},
journal={arXiv preprint arXiv:2402.13516},
url={https://arxiv.org/pdf/2402.13516.pdf}
}
Runs of SparseLLM prosparse-llama-2-7b-predictor on huggingface.co
3
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About prosparse-llama-2-7b-predictor huggingface.co Model
More prosparse-llama-2-7b-predictor license Visit here:
prosparse-llama-2-7b-predictor huggingface.co is an AI model on huggingface.co that provides prosparse-llama-2-7b-predictor's model effect (), which can be used instantly with this SparseLLM prosparse-llama-2-7b-predictor model. huggingface.co supports a free trial of the prosparse-llama-2-7b-predictor model, and also provides paid use of the prosparse-llama-2-7b-predictor. Support call prosparse-llama-2-7b-predictor model through api, including Node.js, Python, http.
prosparse-llama-2-7b-predictor huggingface.co is an online trial and call api platform, which integrates prosparse-llama-2-7b-predictor's modeling effects, including api services, and provides a free online trial of prosparse-llama-2-7b-predictor, you can try prosparse-llama-2-7b-predictor online for free by clicking the link below.
SparseLLM prosparse-llama-2-7b-predictor online free url in huggingface.co:
prosparse-llama-2-7b-predictor is an open source model from GitHub that offers a free installation service, and any user can find prosparse-llama-2-7b-predictor on GitHub to install. At the same time, huggingface.co provides the effect of prosparse-llama-2-7b-predictor install, users can directly use prosparse-llama-2-7b-predictor installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
prosparse-llama-2-7b-predictor install url in huggingface.co: