tencent / DeepSeek-V3.1-Terminus-W4AFP8

huggingface.co
Total runs: 277
24-hour runs: 0
7-day runs: -69
30-day runs: -69
Model's Last Updated: November 04 2025
text-generation

Introduction of DeepSeek-V3.1-Terminus-W4AFP8

Model Details of DeepSeek-V3.1-Terminus-W4AFP8

DeepSeek-V3.1-Terminus-W4AFP8

This model is a mixed-precision quantized version of DeepSeek-V3.1-Terminus, with dense layer keep the FP8 quantization of the original model, while MoE layers uses INT4 weights and FP8 activation, also called W4AFP8.

Benchmark

The accuracy below was obtained with SGLang V0.5.3 in non-thinking mode.

Model math_500 gpqa aime2024 mmlu-pro
DeepSeek-V3.1-Terminus-W4AFP8 89.83 78.28 0.8 83.66
Inference with SGLang

We have already supported deploying this model using tensor parallel in sglang for better performance. The releated PR https://github.com/sgl-project/sglang/pull/8118 has been merged in SGLang V0.5.2, so you can deploy this model using SGLang version 0.5.2 or later with tensor parallel.

python3 -m sglang.launch_server --model-path /path/to/DeepSeek-V3.1-Terminus-W4AFP8 --tp 8 --trust-remote-code --host 0.0.0.0 --port 8000

Runs of tencent DeepSeek-V3.1-Terminus-W4AFP8 on huggingface.co

277
Total runs
0
24-hour runs
-38
3-day runs
-69
7-day runs
-69
30-day runs

More Information About DeepSeek-V3.1-Terminus-W4AFP8 huggingface.co Model

More DeepSeek-V3.1-Terminus-W4AFP8 license Visit here:

https://choosealicense.com/licenses/mit

DeepSeek-V3.1-Terminus-W4AFP8 huggingface.co

DeepSeek-V3.1-Terminus-W4AFP8 huggingface.co is an AI model on huggingface.co that provides DeepSeek-V3.1-Terminus-W4AFP8's model effect (), which can be used instantly with this tencent DeepSeek-V3.1-Terminus-W4AFP8 model. huggingface.co supports a free trial of the DeepSeek-V3.1-Terminus-W4AFP8 model, and also provides paid use of the DeepSeek-V3.1-Terminus-W4AFP8. Support call DeepSeek-V3.1-Terminus-W4AFP8 model through api, including Node.js, Python, http.

DeepSeek-V3.1-Terminus-W4AFP8 huggingface.co Url

https://huggingface.co/tencent/DeepSeek-V3.1-Terminus-W4AFP8

tencent DeepSeek-V3.1-Terminus-W4AFP8 online free

DeepSeek-V3.1-Terminus-W4AFP8 huggingface.co is an online trial and call api platform, which integrates DeepSeek-V3.1-Terminus-W4AFP8's modeling effects, including api services, and provides a free online trial of DeepSeek-V3.1-Terminus-W4AFP8, you can try DeepSeek-V3.1-Terminus-W4AFP8 online for free by clicking the link below.

tencent DeepSeek-V3.1-Terminus-W4AFP8 online free url in huggingface.co:

https://huggingface.co/tencent/DeepSeek-V3.1-Terminus-W4AFP8

DeepSeek-V3.1-Terminus-W4AFP8 install

DeepSeek-V3.1-Terminus-W4AFP8 is an open source model from GitHub that offers a free installation service, and any user can find DeepSeek-V3.1-Terminus-W4AFP8 on GitHub to install. At the same time, huggingface.co provides the effect of DeepSeek-V3.1-Terminus-W4AFP8 install, users can directly use DeepSeek-V3.1-Terminus-W4AFP8 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

DeepSeek-V3.1-Terminus-W4AFP8 install url in huggingface.co:

https://huggingface.co/tencent/DeepSeek-V3.1-Terminus-W4AFP8

Url of DeepSeek-V3.1-Terminus-W4AFP8

DeepSeek-V3.1-Terminus-W4AFP8 huggingface.co Url

Provider of DeepSeek-V3.1-Terminus-W4AFP8 huggingface.co

tencent
ORGANIZATIONS

Other API from tencent

huggingface.co

Total runs: 766.2K
Run Growth: 124.4K
Growth Rate: 16.23%
Updated:August 29 2026
huggingface.co

Total runs: 113.2K
Run Growth: 19.2K
Growth Rate: 16.99%
Updated:October 17 2025
huggingface.co

Total runs: 90.7K
Run Growth: -582.4K
Growth Rate: -642.43%
Updated:September 12 2025
huggingface.co

Total runs: 56.3K
Run Growth: -993
Growth Rate: -1.76%
Updated:October 17 2025
huggingface.co

Total runs: 29.3K
Run Growth: 4.8K
Growth Rate: 16.39%
Updated:May 26 2026
huggingface.co

Total runs: 14.8K
Run Growth: 2.8K
Growth Rate: 18.68%
Updated:May 26 2026
huggingface.co

Total runs: 11.4K
Run Growth: 3.8K
Growth Rate: 33.09%
Updated:October 17 2025
huggingface.co

Total runs: 9.5K
Run Growth: -3.8K
Growth Rate: -39.56%
Updated:July 30 2025
huggingface.co

Total runs: 5.9K
Run Growth: -625
Growth Rate: -10.63%
Updated:January 01 2026
huggingface.co

Total runs: 4.7K
Run Growth: 4.6K
Growth Rate: 99.36%
Updated:September 10 2026
huggingface.co

Total runs: 3.7K
Run Growth: 863
Growth Rate: 23.62%
Updated:May 21 2026
huggingface.co

Total runs: 3.2K
Run Growth: 3.1K
Growth Rate: 99.06%
Updated:September 09 2026
huggingface.co

Total runs: 2.9K
Run Growth: 115
Growth Rate: 3.95%
Updated:February 24 2026
huggingface.co

Total runs: 2.4K
Run Growth: -1.6K
Growth Rate: -69.11%
Updated:December 30 2025
huggingface.co

Total runs: 2.1K
Run Growth: 2.1K
Growth Rate: 100.00%
Updated:September 22 2026
huggingface.co

Total runs: 1.6K
Run Growth: 799
Growth Rate: 50.41%
Updated:March 06 2025
huggingface.co

Total runs: 1.2K
Run Growth: -309
Growth Rate: -25.71%
Updated:October 17 2025
huggingface.co

Total runs: 1.1K
Run Growth: -3.3K
Growth Rate: -302.28%
Updated:June 01 2026
huggingface.co

Total runs: 1.0K
Run Growth: 1.0K
Growth Rate: 100.00%
Updated:September 22 2026
huggingface.co

Total runs: 372
Run Growth: -3.0K
Growth Rate: -804.03%
Updated:September 15 2025
huggingface.co

Total runs: 371
Run Growth: 73
Growth Rate: 19.68%
Updated:March 06 2026
huggingface.co

Total runs: 322
Run Growth: 115
Growth Rate: 35.71%
Updated:December 31 2025
huggingface.co

Total runs: 309
Run Growth: -48
Growth Rate: -16.67%
Updated:March 11 2026
huggingface.co

Total runs: 239
Run Growth: 191
Growth Rate: 79.92%
Updated:February 04 2026