ISTA-DASLab / gemma-2b-AQLM-2Bit-1x16-hf

huggingface.co
Total runs: 37
24-hour runs: 0
7-day runs: -5
30-day runs: 9
Model's Last Updated: March 10 2024
text-generation

Introduction of gemma-2b-AQLM-2Bit-1x16-hf

Model Details of gemma-2b-AQLM-2Bit-1x16-hf

Official AQLM quantization of google/gemma-2b .

For this quantization, we used 1 codebook of 16 bits.

Results (0-shot acc ):

Model Quantization WinoGrande PiQA HellaSwag ArcE ArcC Model size, Gb
gemma-2b None 0.6472 0.7715 0.5279 0.7403 0.4053 5.0
1x16 0.6275 0.7318 0.4582 0.6923 0.3259 1.7

To learn more about the inference, as well as the information on how to quantize models yourself, please refer to the official GitHub repo .

Runs of ISTA-DASLab gemma-2b-AQLM-2Bit-1x16-hf on huggingface.co

37
Total runs
0
24-hour runs
-1
3-day runs
-5
7-day runs
9
30-day runs

More Information About gemma-2b-AQLM-2Bit-1x16-hf huggingface.co Model

gemma-2b-AQLM-2Bit-1x16-hf huggingface.co

gemma-2b-AQLM-2Bit-1x16-hf huggingface.co is an AI model on huggingface.co that provides gemma-2b-AQLM-2Bit-1x16-hf's model effect (), which can be used instantly with this ISTA-DASLab gemma-2b-AQLM-2Bit-1x16-hf model. huggingface.co supports a free trial of the gemma-2b-AQLM-2Bit-1x16-hf model, and also provides paid use of the gemma-2b-AQLM-2Bit-1x16-hf. Support call gemma-2b-AQLM-2Bit-1x16-hf model through api, including Node.js, Python, http.

gemma-2b-AQLM-2Bit-1x16-hf huggingface.co Url

https://huggingface.co/ISTA-DASLab/gemma-2b-AQLM-2Bit-1x16-hf

ISTA-DASLab gemma-2b-AQLM-2Bit-1x16-hf online free

gemma-2b-AQLM-2Bit-1x16-hf huggingface.co is an online trial and call api platform, which integrates gemma-2b-AQLM-2Bit-1x16-hf's modeling effects, including api services, and provides a free online trial of gemma-2b-AQLM-2Bit-1x16-hf, you can try gemma-2b-AQLM-2Bit-1x16-hf online for free by clicking the link below.

ISTA-DASLab gemma-2b-AQLM-2Bit-1x16-hf online free url in huggingface.co:

https://huggingface.co/ISTA-DASLab/gemma-2b-AQLM-2Bit-1x16-hf

gemma-2b-AQLM-2Bit-1x16-hf install

gemma-2b-AQLM-2Bit-1x16-hf is an open source model from GitHub that offers a free installation service, and any user can find gemma-2b-AQLM-2Bit-1x16-hf on GitHub to install. At the same time, huggingface.co provides the effect of gemma-2b-AQLM-2Bit-1x16-hf install, users can directly use gemma-2b-AQLM-2Bit-1x16-hf installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

gemma-2b-AQLM-2Bit-1x16-hf install url in huggingface.co:

https://huggingface.co/ISTA-DASLab/gemma-2b-AQLM-2Bit-1x16-hf

Url of gemma-2b-AQLM-2Bit-1x16-hf

gemma-2b-AQLM-2Bit-1x16-hf huggingface.co Url

Provider of gemma-2b-AQLM-2Bit-1x16-hf huggingface.co

ISTA-DASLab
ORGANIZATIONS

Other API from ISTA-DASLab