Sponsored by Vmake Labs Video Enhancer
Toolify Toolify logo
AI Models
quant-evo

monsoon-nlp / quant-evo

Run on huggingface.co
huggingface.co
Total runs: 6
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: August 19 2024
text-generation

Introduction of quant-evo

Model Details of quant-evo

int8 quantization of evo-1-8k-base , 1.1 revision 

# using T4 GPU on CoLab
! pip install optimum-quanto==0.2.1 transformers accelerate flash_attn evo-model --upgrade

from transformers import AutoConfig, AutoModelForCausalLM
from optimum.quanto import quantize, freeze, qint8

hf_model_name = 'togethercomputer/evo-1-8k-base'
model_config = AutoConfig.from_pretrained(
        hf_model_name,
        trust_remote_code=True,
        revision='1.1_fix',
)
model_config.use_cache = True

model = AutoModelForCausalLM.from_pretrained(
    hf_model_name,
    config=model_config,
    trust_remote_code=True,
    device_map='auto',
    revision='1.1_fix',
)

quantize(model, weights=qint8)
freeze(model)
model.save_pretrained("./quant-evo", safe_serialization=False)

Runs of monsoon-nlp quant-evo on huggingface.co

6
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About quant-evo huggingface.co Model

quant-evo huggingface.co

quant-evo huggingface.co is an AI model on huggingface.co that provides quant-evo's model effect (), which can be used instantly with this monsoon-nlp quant-evo model. huggingface.co supports a free trial of the quant-evo model, and also provides paid use of the quant-evo. Support call quant-evo model through api, including Node.js, Python, http.

quant-evo huggingface.co Url

https://huggingface.co/monsoon-nlp/quant-evo

monsoon-nlp quant-evo online free

quant-evo huggingface.co is an online trial and call api platform, which integrates quant-evo's modeling effects, including api services, and provides a free online trial of quant-evo, you can try quant-evo online for free by clicking the link below.

monsoon-nlp quant-evo online free url in huggingface.co:

https://huggingface.co/monsoon-nlp/quant-evo

quant-evo install

quant-evo is an open source model from GitHub that offers a free installation service, and any user can find quant-evo on GitHub to install. At the same time, huggingface.co provides the effect of quant-evo install, users can directly use quant-evo installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

quant-evo install url in huggingface.co:

https://huggingface.co/monsoon-nlp/quant-evo

Url of quant-evo

Provider of quant-evo huggingface.co

monsoon-nlp
ORGANIZATIONS
huggingface.co

Other API from monsoon-nlp

 huggingface.co
monsoon-nlp/gpt-nyc

Total runs: 66
Run Growth: 27
Growth Rate: 40.91%
Updated:September 03 2023
huggingface.co
monsoon-nlp/dv-wave

Total runs: 23
Run Growth: 6
Growth Rate: 24.00%
Updated:February 03 2025
huggingface.co
monsoon-nlp/byt5-dv

Total runs: 18
Run Growth: 2
Growth Rate: 11.11%
Updated:February 25 2025
huggingface.co
monsoon-nlp/sanaa

Total runs: 7
Run Growth: -8
Growth Rate: -114.29%
Updated:May 23 2021