cnfusion / Llama-3.3-70B-Instruct-mlx-2bit

huggingface.co
Total runs: 8
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: December 16 2024
text-generation

Introduction of Llama-3.3-70B-Instruct-mlx-2bit

Model Details of Llama-3.3-70B-Instruct-mlx-2bit

cnfusion/Llama-3.3-70B-Instruct-mlx-2bit

The Model cnfusion/Llama-3.3-70B-Instruct-mlx-2bit was converted to MLX format from mlx-community/Llama-3.3-70B-Instruct-bf16 using mlx-lm version 0.19.2 .

Use with mlx
pip install mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("cnfusion/Llama-3.3-70B-Instruct-mlx-2bit")

prompt="hello"

if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, tokenize=False, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)

Runs of cnfusion Llama-3.3-70B-Instruct-mlx-2bit on huggingface.co

8
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About Llama-3.3-70B-Instruct-mlx-2bit huggingface.co Model

More Llama-3.3-70B-Instruct-mlx-2bit license Visit here:

https://choosealicense.com/licenses/llama3.3

Llama-3.3-70B-Instruct-mlx-2bit huggingface.co

Llama-3.3-70B-Instruct-mlx-2bit huggingface.co is an AI model on huggingface.co that provides Llama-3.3-70B-Instruct-mlx-2bit's model effect (), which can be used instantly with this cnfusion Llama-3.3-70B-Instruct-mlx-2bit model. huggingface.co supports a free trial of the Llama-3.3-70B-Instruct-mlx-2bit model, and also provides paid use of the Llama-3.3-70B-Instruct-mlx-2bit. Support call Llama-3.3-70B-Instruct-mlx-2bit model through api, including Node.js, Python, http.

Llama-3.3-70B-Instruct-mlx-2bit huggingface.co Url

https://huggingface.co/cnfusion/Llama-3.3-70B-Instruct-mlx-2bit

cnfusion Llama-3.3-70B-Instruct-mlx-2bit online free

Llama-3.3-70B-Instruct-mlx-2bit huggingface.co is an online trial and call api platform, which integrates Llama-3.3-70B-Instruct-mlx-2bit's modeling effects, including api services, and provides a free online trial of Llama-3.3-70B-Instruct-mlx-2bit, you can try Llama-3.3-70B-Instruct-mlx-2bit online for free by clicking the link below.

cnfusion Llama-3.3-70B-Instruct-mlx-2bit online free url in huggingface.co:

https://huggingface.co/cnfusion/Llama-3.3-70B-Instruct-mlx-2bit

Llama-3.3-70B-Instruct-mlx-2bit install

Llama-3.3-70B-Instruct-mlx-2bit is an open source model from GitHub that offers a free installation service, and any user can find Llama-3.3-70B-Instruct-mlx-2bit on GitHub to install. At the same time, huggingface.co provides the effect of Llama-3.3-70B-Instruct-mlx-2bit install, users can directly use Llama-3.3-70B-Instruct-mlx-2bit installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Llama-3.3-70B-Instruct-mlx-2bit install url in huggingface.co:

https://huggingface.co/cnfusion/Llama-3.3-70B-Instruct-mlx-2bit

Url of Llama-3.3-70B-Instruct-mlx-2bit

Llama-3.3-70B-Instruct-mlx-2bit huggingface.co Url

Provider of Llama-3.3-70B-Instruct-mlx-2bit huggingface.co

cnfusion
ORGANIZATIONS

Other API from cnfusion