mlx-community / Devstral-Small-2505-4bit-DWQ

huggingface.co
Total runs: 204
24-hour runs: 8
7-day runs: 41
30-day runs: 141
Model's Last Updated: May 22 2025
text-generation

Introduction of Devstral-Small-2505-4bit-DWQ

Model Details of Devstral-Small-2505-4bit-DWQ

mlx-community/Devstral-Small-2505-4bit-DWQ

This model mlx-community/Devstral-Small-2505-4bit-DWQ was converted to MLX format from mlx-community/Devstral-Small-2505-bf16 using mlx-lm version 0.24.0 .

Use with mlx
pip install mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("mlx-community/Devstral-Small-2505-4bit-DWQ")

prompt = "hello"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)

Runs of mlx-community Devstral-Small-2505-4bit-DWQ on huggingface.co

204
Total runs
8
24-hour runs
25
3-day runs
41
7-day runs
141
30-day runs

More Information About Devstral-Small-2505-4bit-DWQ huggingface.co Model

More Devstral-Small-2505-4bit-DWQ license Visit here:

https://choosealicense.com/licenses/apache-2.0

Devstral-Small-2505-4bit-DWQ huggingface.co

Devstral-Small-2505-4bit-DWQ huggingface.co is an AI model on huggingface.co that provides Devstral-Small-2505-4bit-DWQ's model effect (), which can be used instantly with this mlx-community Devstral-Small-2505-4bit-DWQ model. huggingface.co supports a free trial of the Devstral-Small-2505-4bit-DWQ model, and also provides paid use of the Devstral-Small-2505-4bit-DWQ. Support call Devstral-Small-2505-4bit-DWQ model through api, including Node.js, Python, http.

Devstral-Small-2505-4bit-DWQ huggingface.co Url

https://huggingface.co/mlx-community/Devstral-Small-2505-4bit-DWQ

mlx-community Devstral-Small-2505-4bit-DWQ online free

Devstral-Small-2505-4bit-DWQ huggingface.co is an online trial and call api platform, which integrates Devstral-Small-2505-4bit-DWQ's modeling effects, including api services, and provides a free online trial of Devstral-Small-2505-4bit-DWQ, you can try Devstral-Small-2505-4bit-DWQ online for free by clicking the link below.

mlx-community Devstral-Small-2505-4bit-DWQ online free url in huggingface.co:

https://huggingface.co/mlx-community/Devstral-Small-2505-4bit-DWQ

Devstral-Small-2505-4bit-DWQ install

Devstral-Small-2505-4bit-DWQ is an open source model from GitHub that offers a free installation service, and any user can find Devstral-Small-2505-4bit-DWQ on GitHub to install. At the same time, huggingface.co provides the effect of Devstral-Small-2505-4bit-DWQ install, users can directly use Devstral-Small-2505-4bit-DWQ installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Devstral-Small-2505-4bit-DWQ install url in huggingface.co:

https://huggingface.co/mlx-community/Devstral-Small-2505-4bit-DWQ

Url of Devstral-Small-2505-4bit-DWQ

Devstral-Small-2505-4bit-DWQ huggingface.co Url

Provider of Devstral-Small-2505-4bit-DWQ huggingface.co

mlx-community
ORGANIZATIONS

Other API from mlx-community