duyntnet / deepseek-coder-1.3b-instruct-imatrix-GGUF

huggingface.co
Total runs: 1.7K
24-hour runs: 0
7-day runs: 40
30-day runs: 189
Model's Last Updated: April 26 2024
text-generation

Introduction of deepseek-coder-1.3b-instruct-imatrix-GGUF

Model Details of deepseek-coder-1.3b-instruct-imatrix-GGUF

Quantizations of https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-instruct

From original readme

3. How to Use

Here give some examples of how to use our model.

Chat Model Inference
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("deepseek-ai/deepseek-coder-1.3b-instruct", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("deepseek-ai/deepseek-coder-1.3b-instruct", trust_remote_code=True, torch_dtype=torch.bfloat16).cuda()
messages=[
    { 'role': 'user', 'content': "write a quick sort algorithm in python."}
]
inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to(model.device)
# tokenizer.eos_token_id is the id of <|EOT|> token
outputs = model.generate(inputs, max_new_tokens=512, do_sample=False, top_k=50, top_p=0.95, num_return_sequences=1, eos_token_id=tokenizer.eos_token_id)
print(tokenizer.decode(outputs[0][len(inputs[0]):], skip_special_tokens=True))

Runs of duyntnet deepseek-coder-1.3b-instruct-imatrix-GGUF on huggingface.co

1.7K
Total runs
0
24-hour runs
5
3-day runs
40
7-day runs
189
30-day runs

More Information About deepseek-coder-1.3b-instruct-imatrix-GGUF huggingface.co Model

More deepseek-coder-1.3b-instruct-imatrix-GGUF license Visit here:

https://choosealicense.com/licenses/other

deepseek-coder-1.3b-instruct-imatrix-GGUF huggingface.co

deepseek-coder-1.3b-instruct-imatrix-GGUF huggingface.co is an AI model on huggingface.co that provides deepseek-coder-1.3b-instruct-imatrix-GGUF's model effect (), which can be used instantly with this duyntnet deepseek-coder-1.3b-instruct-imatrix-GGUF model. huggingface.co supports a free trial of the deepseek-coder-1.3b-instruct-imatrix-GGUF model, and also provides paid use of the deepseek-coder-1.3b-instruct-imatrix-GGUF. Support call deepseek-coder-1.3b-instruct-imatrix-GGUF model through api, including Node.js, Python, http.

deepseek-coder-1.3b-instruct-imatrix-GGUF huggingface.co Url

https://huggingface.co/duyntnet/deepseek-coder-1.3b-instruct-imatrix-GGUF

duyntnet deepseek-coder-1.3b-instruct-imatrix-GGUF online free

deepseek-coder-1.3b-instruct-imatrix-GGUF huggingface.co is an online trial and call api platform, which integrates deepseek-coder-1.3b-instruct-imatrix-GGUF's modeling effects, including api services, and provides a free online trial of deepseek-coder-1.3b-instruct-imatrix-GGUF, you can try deepseek-coder-1.3b-instruct-imatrix-GGUF online for free by clicking the link below.

duyntnet deepseek-coder-1.3b-instruct-imatrix-GGUF online free url in huggingface.co:

https://huggingface.co/duyntnet/deepseek-coder-1.3b-instruct-imatrix-GGUF

deepseek-coder-1.3b-instruct-imatrix-GGUF install

deepseek-coder-1.3b-instruct-imatrix-GGUF is an open source model from GitHub that offers a free installation service, and any user can find deepseek-coder-1.3b-instruct-imatrix-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of deepseek-coder-1.3b-instruct-imatrix-GGUF install, users can directly use deepseek-coder-1.3b-instruct-imatrix-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

deepseek-coder-1.3b-instruct-imatrix-GGUF install url in huggingface.co:

https://huggingface.co/duyntnet/deepseek-coder-1.3b-instruct-imatrix-GGUF

Url of deepseek-coder-1.3b-instruct-imatrix-GGUF

deepseek-coder-1.3b-instruct-imatrix-GGUF huggingface.co Url

Provider of deepseek-coder-1.3b-instruct-imatrix-GGUF huggingface.co

duyntnet
ORGANIZATIONS

Other API from duyntnet