ISTA-DASLab / AQLM-executorch

huggingface.co
Total runs: 106
24-hour runs: 0
7-day runs: -3
30-day runs: 70
Model's Last Updated: August 13 2024

Introduction of AQLM-executorch

Model Details of AQLM-executorch

Bringing SOTA quantization to mobile LLM deployment: A practical Executorch integration guide

Article: https://blacksamorez.substack.com/p/aqlm-executorch-android

Usage
  • Download and install the .apk file on your Android phone.
  • Download the .pte and .model files and put them into the /data/local/tmp/llama folder on your Android phone.
  • Running the app you will see the option to load the .pte and .model files. After loading them, you'll be able to chat with the model.
Requirements

This app was tested on Samsung S24 Ultra running Android 14 .

Limitations
  • Although the app looks like chat, generation requests are independent.
  • Llama-3 chat template is hard-coded into the app.

Runs of ISTA-DASLab AQLM-executorch on huggingface.co

106
Total runs
0
24-hour runs
-10
3-day runs
-3
7-day runs
70
30-day runs

More Information About AQLM-executorch huggingface.co Model

AQLM-executorch huggingface.co

AQLM-executorch huggingface.co is an AI model on huggingface.co that provides AQLM-executorch's model effect (), which can be used instantly with this ISTA-DASLab AQLM-executorch model. huggingface.co supports a free trial of the AQLM-executorch model, and also provides paid use of the AQLM-executorch. Support call AQLM-executorch model through api, including Node.js, Python, http.

ISTA-DASLab AQLM-executorch online free

AQLM-executorch huggingface.co is an online trial and call api platform, which integrates AQLM-executorch's modeling effects, including api services, and provides a free online trial of AQLM-executorch, you can try AQLM-executorch online for free by clicking the link below.

ISTA-DASLab AQLM-executorch online free url in huggingface.co:

https://huggingface.co/ISTA-DASLab/AQLM-executorch

AQLM-executorch install

AQLM-executorch is an open source model from GitHub that offers a free installation service, and any user can find AQLM-executorch on GitHub to install. At the same time, huggingface.co provides the effect of AQLM-executorch install, users can directly use AQLM-executorch installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

AQLM-executorch install url in huggingface.co:

https://huggingface.co/ISTA-DASLab/AQLM-executorch

Url of AQLM-executorch

AQLM-executorch huggingface.co Url

Provider of AQLM-executorch huggingface.co

ISTA-DASLab
ORGANIZATIONS

Other API from ISTA-DASLab