deepseek-ai / deepseek-moe-16b-chat

huggingface.co
Total runs: 22.1K
24-hour runs: 2.1K
7-day runs: -3.0K
30-day runs: -8.7K
Model's Last Updated: February 05 2024
text-generation

Introduction of deepseek-moe-16b-chat

Model Details of deepseek-moe-16b-chat

DeepSeek Chat

[🏠Homepage] | [🤖 Chat with DeepSeek LLM] | [Discord] | [Wechat(微信)]

Paper Link 👁️


1. Introduction to DeepSeekMoE

See the Introduction for more details.

2. How to Use

Here give some examples of how to use our model.

Chat Completion

import torch
from transformers import AutoTokenizer, AutoModelForCausalLM, GenerationConfig

model_name = "deepseek-ai/deepseek-moe-16b-chat"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name, torch_dtype=torch.bfloat16, device_map="auto")
model.generation_config = GenerationConfig.from_pretrained(model_name)
model.generation_config.pad_token_id = model.generation_config.eos_token_id

messages = [
    {"role": "user", "content": "Who are you?"}
]
input_tensor = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt")
outputs = model.generate(input_tensor.to(model.device), max_new_tokens=100)

result = tokenizer.decode(outputs[0][input_tensor.shape[1]:], skip_special_tokens=True)
print(result)

Avoiding the use of the provided function apply_chat_template , you can also interact with our model following the sample template. Note that messages should be replaced by your input.

User: {messages[0]['content']}

Assistant: {messages[1]['content']}<|end▁of▁sentence|>User: {messages[2]['content']}

Assistant:

Note: By default ( add_special_tokens=True ), our tokenizer automatically adds a bos_token ( <|begin▁of▁sentence|> ) before the input text. Additionally, since the system prompt is not compatible with this version of our models, we DO NOT RECOMMEND including the system prompt in your input.

3. License

This code repository is licensed under the MIT License. The use of DeepSeekMoE models is subject to the Model License. DeepSeekMoE supports commercial use.

See the LICENSE-MODEL for more details.

4. Contact

If you have any questions, please raise an issue or contact us at [email protected] .

Runs of deepseek-ai deepseek-moe-16b-chat on huggingface.co

22.1K
Total runs
2.1K
24-hour runs
-1.1K
3-day runs
-3.0K
7-day runs
-8.7K
30-day runs

More Information About deepseek-moe-16b-chat huggingface.co Model

More deepseek-moe-16b-chat license Visit here:

https://choosealicense.com/licenses/deepseek

deepseek-moe-16b-chat huggingface.co

deepseek-moe-16b-chat huggingface.co is an AI model on huggingface.co that provides deepseek-moe-16b-chat's model effect (), which can be used instantly with this deepseek-ai deepseek-moe-16b-chat model. huggingface.co supports a free trial of the deepseek-moe-16b-chat model, and also provides paid use of the deepseek-moe-16b-chat. Support call deepseek-moe-16b-chat model through api, including Node.js, Python, http.

deepseek-moe-16b-chat huggingface.co Url

https://huggingface.co/deepseek-ai/deepseek-moe-16b-chat

deepseek-ai deepseek-moe-16b-chat online free

deepseek-moe-16b-chat huggingface.co is an online trial and call api platform, which integrates deepseek-moe-16b-chat's modeling effects, including api services, and provides a free online trial of deepseek-moe-16b-chat, you can try deepseek-moe-16b-chat online for free by clicking the link below.

deepseek-ai deepseek-moe-16b-chat online free url in huggingface.co:

https://huggingface.co/deepseek-ai/deepseek-moe-16b-chat

deepseek-moe-16b-chat install

deepseek-moe-16b-chat is an open source model from GitHub that offers a free installation service, and any user can find deepseek-moe-16b-chat on GitHub to install. At the same time, huggingface.co provides the effect of deepseek-moe-16b-chat install, users can directly use deepseek-moe-16b-chat installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

deepseek-moe-16b-chat install url in huggingface.co:

https://huggingface.co/deepseek-ai/deepseek-moe-16b-chat

Url of deepseek-moe-16b-chat

deepseek-moe-16b-chat huggingface.co Url

Provider of deepseek-moe-16b-chat huggingface.co

deepseek-ai
ORGANIZATIONS

Other API from deepseek-ai

huggingface.co

Total runs: 1.5K
Run Growth: -2.8K
Growth Rate: -184.81%
Updated:January 27 2025