cnfusion / Llama-3.3-70B-Instruct-Q2-mlx

huggingface.co
Total runs: 70
24-hour runs: 6
7-day runs: 7
30-day runs: -7
Model's Last Updated: December 19 2024
text-generation

Introduction of Llama-3.3-70B-Instruct-Q2-mlx

Model Details of Llama-3.3-70B-Instruct-Q2-mlx

cnfusion/Llama-3.3-70B-Instruct-Q2-mlx

The Model cnfusion/Llama-3.3-70B-Instruct-Q2-mlx was converted to MLX format from unsloth/Llama-3.3-70B-Instruct using mlx-lm version 0.19.2 .

Use with mlx
pip install mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("cnfusion/Llama-3.3-70B-Instruct-Q2-mlx")

prompt="hello"

if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, tokenize=False, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)

Runs of cnfusion Llama-3.3-70B-Instruct-Q2-mlx on huggingface.co

70
Total runs
6
24-hour runs
7
3-day runs
7
7-day runs
-7
30-day runs

More Information About Llama-3.3-70B-Instruct-Q2-mlx huggingface.co Model

More Llama-3.3-70B-Instruct-Q2-mlx license Visit here:

https://choosealicense.com/licenses/llama3.3

Llama-3.3-70B-Instruct-Q2-mlx huggingface.co

Llama-3.3-70B-Instruct-Q2-mlx huggingface.co is an AI model on huggingface.co that provides Llama-3.3-70B-Instruct-Q2-mlx's model effect (), which can be used instantly with this cnfusion Llama-3.3-70B-Instruct-Q2-mlx model. huggingface.co supports a free trial of the Llama-3.3-70B-Instruct-Q2-mlx model, and also provides paid use of the Llama-3.3-70B-Instruct-Q2-mlx. Support call Llama-3.3-70B-Instruct-Q2-mlx model through api, including Node.js, Python, http.

Llama-3.3-70B-Instruct-Q2-mlx huggingface.co Url

https://huggingface.co/cnfusion/Llama-3.3-70B-Instruct-Q2-mlx

cnfusion Llama-3.3-70B-Instruct-Q2-mlx online free

Llama-3.3-70B-Instruct-Q2-mlx huggingface.co is an online trial and call api platform, which integrates Llama-3.3-70B-Instruct-Q2-mlx's modeling effects, including api services, and provides a free online trial of Llama-3.3-70B-Instruct-Q2-mlx, you can try Llama-3.3-70B-Instruct-Q2-mlx online for free by clicking the link below.

cnfusion Llama-3.3-70B-Instruct-Q2-mlx online free url in huggingface.co:

https://huggingface.co/cnfusion/Llama-3.3-70B-Instruct-Q2-mlx

Llama-3.3-70B-Instruct-Q2-mlx install

Llama-3.3-70B-Instruct-Q2-mlx is an open source model from GitHub that offers a free installation service, and any user can find Llama-3.3-70B-Instruct-Q2-mlx on GitHub to install. At the same time, huggingface.co provides the effect of Llama-3.3-70B-Instruct-Q2-mlx install, users can directly use Llama-3.3-70B-Instruct-Q2-mlx installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Llama-3.3-70B-Instruct-Q2-mlx install url in huggingface.co:

https://huggingface.co/cnfusion/Llama-3.3-70B-Instruct-Q2-mlx

Url of Llama-3.3-70B-Instruct-Q2-mlx

Llama-3.3-70B-Instruct-Q2-mlx huggingface.co Url

Provider of Llama-3.3-70B-Instruct-Q2-mlx huggingface.co

cnfusion
ORGANIZATIONS

Other API from cnfusion