lahey / My-Qwen2.5-Coder-7B-Instruct-4bit

huggingface.co
Total runs: 16
24-hour runs: 0
7-day runs: -3
30-day runs: 3
Model's Last Updated: November 14 2024
text-generation

Introduction of My-Qwen2.5-Coder-7B-Instruct-4bit

Model Details of My-Qwen2.5-Coder-7B-Instruct-4bit

lahey/My-Qwen2.5-Coder-7B-Instruct-4bit

The Model lahey/My-Qwen2.5-Coder-7B-Instruct-4bit was converted to MLX format from Qwen/Qwen2.5-Coder-7B-Instruct using mlx-lm version 0.19.3 .

Use with mlx
pip install mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("lahey/My-Qwen2.5-Coder-7B-Instruct-4bit")

prompt="hello"

if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, tokenize=False, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)

Runs of lahey My-Qwen2.5-Coder-7B-Instruct-4bit on huggingface.co

16
Total runs
0
24-hour runs
0
3-day runs
-3
7-day runs
3
30-day runs

More Information About My-Qwen2.5-Coder-7B-Instruct-4bit huggingface.co Model

More My-Qwen2.5-Coder-7B-Instruct-4bit license Visit here:

https://choosealicense.com/licenses/apache-2.0

My-Qwen2.5-Coder-7B-Instruct-4bit huggingface.co

My-Qwen2.5-Coder-7B-Instruct-4bit huggingface.co is an AI model on huggingface.co that provides My-Qwen2.5-Coder-7B-Instruct-4bit's model effect (), which can be used instantly with this lahey My-Qwen2.5-Coder-7B-Instruct-4bit model. huggingface.co supports a free trial of the My-Qwen2.5-Coder-7B-Instruct-4bit model, and also provides paid use of the My-Qwen2.5-Coder-7B-Instruct-4bit. Support call My-Qwen2.5-Coder-7B-Instruct-4bit model through api, including Node.js, Python, http.

My-Qwen2.5-Coder-7B-Instruct-4bit huggingface.co Url

https://huggingface.co/lahey/My-Qwen2.5-Coder-7B-Instruct-4bit

lahey My-Qwen2.5-Coder-7B-Instruct-4bit online free

My-Qwen2.5-Coder-7B-Instruct-4bit huggingface.co is an online trial and call api platform, which integrates My-Qwen2.5-Coder-7B-Instruct-4bit's modeling effects, including api services, and provides a free online trial of My-Qwen2.5-Coder-7B-Instruct-4bit, you can try My-Qwen2.5-Coder-7B-Instruct-4bit online for free by clicking the link below.

lahey My-Qwen2.5-Coder-7B-Instruct-4bit online free url in huggingface.co:

https://huggingface.co/lahey/My-Qwen2.5-Coder-7B-Instruct-4bit

My-Qwen2.5-Coder-7B-Instruct-4bit install

My-Qwen2.5-Coder-7B-Instruct-4bit is an open source model from GitHub that offers a free installation service, and any user can find My-Qwen2.5-Coder-7B-Instruct-4bit on GitHub to install. At the same time, huggingface.co provides the effect of My-Qwen2.5-Coder-7B-Instruct-4bit install, users can directly use My-Qwen2.5-Coder-7B-Instruct-4bit installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

My-Qwen2.5-Coder-7B-Instruct-4bit install url in huggingface.co:

https://huggingface.co/lahey/My-Qwen2.5-Coder-7B-Instruct-4bit

Url of My-Qwen2.5-Coder-7B-Instruct-4bit

My-Qwen2.5-Coder-7B-Instruct-4bit huggingface.co Url

Provider of My-Qwen2.5-Coder-7B-Instruct-4bit huggingface.co

lahey
ORGANIZATIONS

Other API from lahey