cnfusion / QwQ-0.5B-Draft-mlx-4Bit

huggingface.co
Total runs: 31
24-hour runs: 1
7-day runs: -8
30-day runs: 7
Model's Last Updated: March 12 2025
text-generation

Introduction of QwQ-0.5B-Draft-mlx-4Bit

Model Details of QwQ-0.5B-Draft-mlx-4Bit

cnfusion/QwQ-0.5B-Draft-mlx-4Bit

The Model cnfusion/QwQ-0.5B-Draft-mlx-4Bit was converted to MLX format from qingy2024/QwQ-0.5B-Draft using mlx-lm version 0.21.5 .

Use with mlx
pip install mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("cnfusion/QwQ-0.5B-Draft-mlx-4Bit")

prompt="hello"

if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, tokenize=False, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)

Runs of cnfusion QwQ-0.5B-Draft-mlx-4Bit on huggingface.co

31
Total runs
1
24-hour runs
-7
3-day runs
-8
7-day runs
7
30-day runs

More Information About QwQ-0.5B-Draft-mlx-4Bit huggingface.co Model

QwQ-0.5B-Draft-mlx-4Bit huggingface.co

QwQ-0.5B-Draft-mlx-4Bit huggingface.co is an AI model on huggingface.co that provides QwQ-0.5B-Draft-mlx-4Bit's model effect (), which can be used instantly with this cnfusion QwQ-0.5B-Draft-mlx-4Bit model. huggingface.co supports a free trial of the QwQ-0.5B-Draft-mlx-4Bit model, and also provides paid use of the QwQ-0.5B-Draft-mlx-4Bit. Support call QwQ-0.5B-Draft-mlx-4Bit model through api, including Node.js, Python, http.

QwQ-0.5B-Draft-mlx-4Bit huggingface.co Url

https://huggingface.co/cnfusion/QwQ-0.5B-Draft-mlx-4Bit

cnfusion QwQ-0.5B-Draft-mlx-4Bit online free

QwQ-0.5B-Draft-mlx-4Bit huggingface.co is an online trial and call api platform, which integrates QwQ-0.5B-Draft-mlx-4Bit's modeling effects, including api services, and provides a free online trial of QwQ-0.5B-Draft-mlx-4Bit, you can try QwQ-0.5B-Draft-mlx-4Bit online for free by clicking the link below.

cnfusion QwQ-0.5B-Draft-mlx-4Bit online free url in huggingface.co:

https://huggingface.co/cnfusion/QwQ-0.5B-Draft-mlx-4Bit

QwQ-0.5B-Draft-mlx-4Bit install

QwQ-0.5B-Draft-mlx-4Bit is an open source model from GitHub that offers a free installation service, and any user can find QwQ-0.5B-Draft-mlx-4Bit on GitHub to install. At the same time, huggingface.co provides the effect of QwQ-0.5B-Draft-mlx-4Bit install, users can directly use QwQ-0.5B-Draft-mlx-4Bit installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

QwQ-0.5B-Draft-mlx-4Bit install url in huggingface.co:

https://huggingface.co/cnfusion/QwQ-0.5B-Draft-mlx-4Bit

Url of QwQ-0.5B-Draft-mlx-4Bit

QwQ-0.5B-Draft-mlx-4Bit huggingface.co Url

Provider of QwQ-0.5B-Draft-mlx-4Bit huggingface.co

cnfusion
ORGANIZATIONS

Other API from cnfusion