Sponsored by iMean AI Trip Planner
Toolify Toolify logo
AI Models
Idefics3-8B-Llama3-bnb_nf4

leon-se / Idefics3-8B-Llama3-bnb_nf4

Run on huggingface.co
huggingface.co
Total runs: 15
24-hour runs: 0
7-day runs: 0
30-day runs: 5
Model's Last Updated: November 18 2024
image-text-to-text

Introduction of Idefics3-8B-Llama3-bnb_nf4

Model Details of Idefics3-8B-Llama3-bnb_nf4

Idefics3-8B-Llama3-bnb_nf4

BitsAndBytes NF4 quantization.

Quantization

Quantization created with: 

from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig

model_id = "HuggingFaceM4/Idefics3-8B-Llama3"

nf4_config = BitsAndBytesConfig(
    load_in_4bit=True,
    bnb_4bit_quant_type="nf4",
    bnb_4bit_compute_dtype=torch.bfloat16,
    bnb_4bit_use_double_quant=True,
    llm_int8_enable_fp32_cpu_offload=True,
    llm_int8_skip_modules=["lm_head", "model.vision_model", "model.connector"],
    )

model_nf4 = AutoModelForVision2Seq.from_pretrained(model_id, quantization_config=nf4_config)

Runs of leon-se Idefics3-8B-Llama3-bnb_nf4 on huggingface.co

15
Total runs
0
24-hour runs
-1
3-day runs
0
7-day runs
5
30-day runs

More Information About Idefics3-8B-Llama3-bnb_nf4 huggingface.co Model

Idefics3-8B-Llama3-bnb_nf4 huggingface.co

Idefics3-8B-Llama3-bnb_nf4 huggingface.co is an AI model on huggingface.co that provides Idefics3-8B-Llama3-bnb_nf4's model effect (), which can be used instantly with this leon-se Idefics3-8B-Llama3-bnb_nf4 model. huggingface.co supports a free trial of the Idefics3-8B-Llama3-bnb_nf4 model, and also provides paid use of the Idefics3-8B-Llama3-bnb_nf4. Support call Idefics3-8B-Llama3-bnb_nf4 model through api, including Node.js, Python, http.

Idefics3-8B-Llama3-bnb_nf4 huggingface.co Url

https://huggingface.co/leon-se/Idefics3-8B-Llama3-bnb_nf4

leon-se Idefics3-8B-Llama3-bnb_nf4 online free

Idefics3-8B-Llama3-bnb_nf4 huggingface.co is an online trial and call api platform, which integrates Idefics3-8B-Llama3-bnb_nf4's modeling effects, including api services, and provides a free online trial of Idefics3-8B-Llama3-bnb_nf4, you can try Idefics3-8B-Llama3-bnb_nf4 online for free by clicking the link below.

leon-se Idefics3-8B-Llama3-bnb_nf4 online free url in huggingface.co:

https://huggingface.co/leon-se/Idefics3-8B-Llama3-bnb_nf4

Idefics3-8B-Llama3-bnb_nf4 install

Idefics3-8B-Llama3-bnb_nf4 is an open source model from GitHub that offers a free installation service, and any user can find Idefics3-8B-Llama3-bnb_nf4 on GitHub to install. At the same time, huggingface.co provides the effect of Idefics3-8B-Llama3-bnb_nf4 install, users can directly use Idefics3-8B-Llama3-bnb_nf4 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Idefics3-8B-Llama3-bnb_nf4 install url in huggingface.co:

https://huggingface.co/leon-se/Idefics3-8B-Llama3-bnb_nf4

Url of Idefics3-8B-Llama3-bnb_nf4

Idefics3-8B-Llama3-bnb_nf4 huggingface.co Url

Provider of Idefics3-8B-Llama3-bnb_nf4 huggingface.co

leon-se
ORGANIZATIONS
huggingface.co

Other API from leon-se