RedHatAI / Kimi-K3-FP8-BLOCK

huggingface.co
Total runs: 2.6K
24-hour runs: 0
7-day runs: 15
30-day runs: 2.0K
Model's Last Updated: July 29 2026

Introduction of Kimi-K3-FP8-BLOCK

Model Details of Kimi-K3-FP8-BLOCK

RedHatAI/Kimi-K3-FP8-BLOCK

This is a variant of moonshotai/Kimi-K3 quantized with FP8_BLOCK quantization applied to MLP and experts layers. Attention layers were not quantized due to shape mismatches, namely with self_attn.b_proj.weight

Creation Process

Quantized using llm-compressor :

from compressed_tensors.entrypoints.convert import CompressedTensorsDequantizer

from llmcompressor import model_free_ptq

MODEL_ID = "moonshotai/Kimi-K3"
SAVE_DIR = MODEL_ID.rstrip("/").split("/")[-1] + "-FP8-BLOCK"

ignore = [
    "re:.*embed_tokens.*",
    "re:.*self_attn.*",  # no attention because (q_proj|k_proj|v_proj|b_proj|f_a_proj) are all fused, and `b_proj` has a weight non-divisible by 128
    "re:.*block_sparse_moe\.gate.*",
    "re:.*self_attention_res_proj.*",
    "re:.*mlp_res_proj.*",
    "re:.*output_attn_res_proj.*",
    "re:.*lm_head.*",
    "re:.*vision_tower.*",
    "re:.*mm_projector.*",
]

model_free_ptq(
    model_stub=MODEL_ID,
    save_directory=SAVE_DIR,
    scheme="FP8_BLOCK",
    ignore=ignore,
    converter=CompressedTensorsDequantizer(
        MODEL_ID,
        ignore=ignore,
    ),
    max_workers=7,
    device=[
        f"cuda:{i}"
        for i in range(7)
    ],
)

Runs of RedHatAI Kimi-K3-FP8-BLOCK on huggingface.co

2.6K
Total runs
0
24-hour runs
26
3-day runs
15
7-day runs
2.0K
30-day runs

More Information About Kimi-K3-FP8-BLOCK huggingface.co Model

More Kimi-K3-FP8-BLOCK license Visit here:

https://choosealicense.com/licenses/mit

Kimi-K3-FP8-BLOCK huggingface.co

Kimi-K3-FP8-BLOCK huggingface.co is an AI model on huggingface.co that provides Kimi-K3-FP8-BLOCK's model effect (), which can be used instantly with this RedHatAI Kimi-K3-FP8-BLOCK model. huggingface.co supports a free trial of the Kimi-K3-FP8-BLOCK model, and also provides paid use of the Kimi-K3-FP8-BLOCK. Support call Kimi-K3-FP8-BLOCK model through api, including Node.js, Python, http.

Kimi-K3-FP8-BLOCK huggingface.co Url

https://huggingface.co/RedHatAI/Kimi-K3-FP8-BLOCK

RedHatAI Kimi-K3-FP8-BLOCK online free

Kimi-K3-FP8-BLOCK huggingface.co is an online trial and call api platform, which integrates Kimi-K3-FP8-BLOCK's modeling effects, including api services, and provides a free online trial of Kimi-K3-FP8-BLOCK, you can try Kimi-K3-FP8-BLOCK online for free by clicking the link below.

RedHatAI Kimi-K3-FP8-BLOCK online free url in huggingface.co:

https://huggingface.co/RedHatAI/Kimi-K3-FP8-BLOCK

Kimi-K3-FP8-BLOCK install

Kimi-K3-FP8-BLOCK is an open source model from GitHub that offers a free installation service, and any user can find Kimi-K3-FP8-BLOCK on GitHub to install. At the same time, huggingface.co provides the effect of Kimi-K3-FP8-BLOCK install, users can directly use Kimi-K3-FP8-BLOCK installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Kimi-K3-FP8-BLOCK install url in huggingface.co:

https://huggingface.co/RedHatAI/Kimi-K3-FP8-BLOCK

Url of Kimi-K3-FP8-BLOCK

Kimi-K3-FP8-BLOCK huggingface.co Url

Provider of Kimi-K3-FP8-BLOCK huggingface.co

RedHatAI
ORGANIZATIONS

Other API from RedHatAI

huggingface.co

Total runs: 26.2K
Run Growth: -15.7K
Growth Rate: -59.90%
Updated:May 18 2026
huggingface.co

Total runs: 20.9K
Run Growth: -11.8K
Growth Rate: -56.48%
Updated:April 29 2026