unsloth / DeepSeek-V4-Pro-0813-GGUF

In progress will take a while

See below for instructions on the Flash model for now:

Read our How to Run DeepSeek-V4 Guide!

Unsloth Dynamic 2.0 achieves superior accuracy & outperforms other leading quants.

• See our DeepSeek-V4 guide for quantization analysis and run instructions.
• DeepSeek-V4-Pro-0813 is a 1.57T parameter model with 48B active parameters per token, so it needs substantially more memory than DeepSeek-V4-Flash-0731.
• For DeepSeek-V4-Flash-0731 GGUFs, see unsloth/DeepSeek-V4-Flash-0731-GGUF .

Quants are uploaded to this repository as they finish converting.

DeepSeek-V4-Pro-0813

Technical Report 👁️

Introduction

DeepSeek-V4-Pro-0813 is the official release of DeepSeek-V4-Pro , superseding the preview version, with greatly enhanced agentic capabilities and performance improvements that are especially pronounced in production environments. It is built on the DeepSeek-V4-Pro (Preview) model structure, with a DSpark speculative decoding module attached.

DeepSeek-V4-Pro-0813 outperforms DeepSeek-V4-Pro (Preview) on the benchmarks listed below, and is broadly competitive with the strongest proprietary models available.

Notes:

1. For the code-agent tasks among the public benchmarks above, DeepSeek-V4-Pro-0813 is evaluated with the minimal mode of DeepSeek Harness as the agent framework, using the max reasoning effort level with temperature = 1.0, top_p = 0.95 .
2. † DSBench-FullStack is an internal full-stack development test set; DSBench-Hard is an internal test set of difficult coding-agent problems.

Chat Template

This release does not include a Jinja-format chat template. Instead, we provide a dedicated encoding folder with Python scripts and test cases demonstrating how to encode messages in OpenAI-compatible format into input strings for the model, and how to parse the model's text output. Please refer to the encoding folder for full documentation.

The reasoning_effort parameter now supports three levels — low , high , and max — which control how much deliberation the model spends before answering.

A brief example:

from encoding_dsv4 import encode_messages, parse_message_from_completion_text

messages = [
    {"role": "user", "content": "hello"},
    {"role": "assistant", "content": "Hello! I am DeepSeek.", "reasoning_content": "thinking..."},
    {"role": "user", "content": "1+1=?"}
]

# messages -> string
prompt = encode_messages(messages, thinking_mode="thinking", reasoning_effort="max")

# string -> tokens
import transformers
tokenizer = transformers.AutoTokenizer.from_pretrained("deepseek-ai/DeepSeek-V4-Pro-0813")
tokens = tokenizer.encode(prompt)

License

This repository and the model weights are licensed under the MIT License .

Citation

@misc{deepseekai2026deepseekv4,
      title={DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence},
      author={DeepSeek-AI},
      year={2026},
}

Contact

If you have any questions, please raise an issue or contact us at [email protected] .