amd / Kimi-K2.5-MXFP4-AttnFP8

huggingface.co
Total runs: 70
24-hour runs: 0
7-day runs: -16
30-day runs: -323
Model's Last Updated: April 24 2026

Introduction of Kimi-K2.5-MXFP4-AttnFP8

Model Details of Kimi-K2.5-MXFP4-AttnFP8

Model Overview

  • Model Architecture: Kimi-K2.5
    • Input: Text
    • Output: Text
  • Supported Hardware Microarchitecture: AMD MI350/MI355
  • ROCm: 7.1.0
  • Transformers: 4.57.6
  • Operating System(s): Linux
  • Inference Engine: vLLM
  • Model Optimizer: AMD-Quark (V0.11.2)
    • Quantized layers: layers.0.mlp , experts , shared_experts , self_attn
    • Weight quantization: OCP MXFP4, Static; self_attn Perchannel, FP8E4M3, Static
    • Activation quantization: OCP MXFP4, Dynamic; self_attn Pertoken, FP8E4M3, Dynamic
  • Calibration Dataset: Pile

This model was built with Kimi-K2.5 model by applying AMD-Quark for MXFP4 quantization and PTPC-FP8 quantization.

Model Quantization

The model was quantized from moonshotai/Kimi-K2.5 using AMD-Quark . The weights and activations are quantized to MXFP4, and self_attn layers are quantized to PTPC-FP8.

Quantization scripts:

cd Quark/examples/torch/language_modeling/llm_ptq/
exclude_layers="*mlp.gate *lm_head *mm_projector* *vision_tower*"

python3 quantize_quark.py \
  --model_dir moonshotai/Kimi-K2.5 \
  --quant_scheme mxfp4 \
  --layer_quant_scheme '*self_attn*' ptpc_fp8 \
  --exclude_layers $exclude_layers \
  --output_dir amd/Kimi-K2.5-MXFP4-AttnFP8 \
  --file2file_quantization

Deployment

Use with vLLM

This model can be deployed efficiently using the vLLM backend.

Evaluation

The model was evaluated on GSM8K benchmarks.

Accuracy
Benchmark Kimi-K2.5 Kimi-K2.5-MXFP4-AttnFP8(this model) Recovery
GSM8K (flexible-extract) 94.09 93.56 99.44%
Reproduction

The GSM8K results were obtained using the lm-evaluation-harness framework, based on the Docker image vllm/vllm-openai-rocm:v0.17.0 .

Install the lm-eval (Version: 0.4.11) in container first.

pip install lm-eval
pip install lm-eval[api]
Launching server
export VLLM_ROCM_USE_AITER=1

vllm serve amd/Kimi-K2.5-MXFP4-AttnFP8 -tp 4 \
  --mm-encoder-tp-mode data \
  --tool-call-parser kimi_k2 \
  --reasoning-parser kimi_k2 \
  --enforce-eager \
  --trust-remote-code
Evaluating model in a new terminal
lm_eval \
  --model local-completions \
  --model_args "model=amd/Kimi-K2.5-MXFP4-AttnFP8,base_url=http://0.0.0.0:8000/v1/completions,tokenized_requests=False,tokenizer_backend=None,num_concurrent=32" \
  --tasks gsm8k \
  --num_fewshot 5 \
  --batch_size 1

License

Modifications Copyright(c) 2025 Advanced Micro Devices, Inc. All rights reserved.

Runs of amd Kimi-K2.5-MXFP4-AttnFP8 on huggingface.co

70
Total runs
0
24-hour runs
-5
3-day runs
-16
7-day runs
-323
30-day runs

More Information About Kimi-K2.5-MXFP4-AttnFP8 huggingface.co Model

More Kimi-K2.5-MXFP4-AttnFP8 license Visit here:

https://choosealicense.com/licenses/modified-mit

Kimi-K2.5-MXFP4-AttnFP8 huggingface.co

Kimi-K2.5-MXFP4-AttnFP8 huggingface.co is an AI model on huggingface.co that provides Kimi-K2.5-MXFP4-AttnFP8's model effect (), which can be used instantly with this amd Kimi-K2.5-MXFP4-AttnFP8 model. huggingface.co supports a free trial of the Kimi-K2.5-MXFP4-AttnFP8 model, and also provides paid use of the Kimi-K2.5-MXFP4-AttnFP8. Support call Kimi-K2.5-MXFP4-AttnFP8 model through api, including Node.js, Python, http.

Kimi-K2.5-MXFP4-AttnFP8 huggingface.co Url

https://huggingface.co/amd/Kimi-K2.5-MXFP4-AttnFP8

amd Kimi-K2.5-MXFP4-AttnFP8 online free

Kimi-K2.5-MXFP4-AttnFP8 huggingface.co is an online trial and call api platform, which integrates Kimi-K2.5-MXFP4-AttnFP8's modeling effects, including api services, and provides a free online trial of Kimi-K2.5-MXFP4-AttnFP8, you can try Kimi-K2.5-MXFP4-AttnFP8 online for free by clicking the link below.

amd Kimi-K2.5-MXFP4-AttnFP8 online free url in huggingface.co:

https://huggingface.co/amd/Kimi-K2.5-MXFP4-AttnFP8

Kimi-K2.5-MXFP4-AttnFP8 install

Kimi-K2.5-MXFP4-AttnFP8 is an open source model from GitHub that offers a free installation service, and any user can find Kimi-K2.5-MXFP4-AttnFP8 on GitHub to install. At the same time, huggingface.co provides the effect of Kimi-K2.5-MXFP4-AttnFP8 install, users can directly use Kimi-K2.5-MXFP4-AttnFP8 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Kimi-K2.5-MXFP4-AttnFP8 install url in huggingface.co:

https://huggingface.co/amd/Kimi-K2.5-MXFP4-AttnFP8

Url of Kimi-K2.5-MXFP4-AttnFP8

Kimi-K2.5-MXFP4-AttnFP8 huggingface.co Url

Provider of Kimi-K2.5-MXFP4-AttnFP8 huggingface.co

amd
ORGANIZATIONS

Other API from amd

huggingface.co

Total runs: 156.6K
Run Growth: -98.7K
Growth Rate: -63.02%
Updated:April 14 2026
huggingface.co

Total runs: 57.7K
Run Growth: -53.3K
Growth Rate: -92.35%
Updated:July 17 2026
huggingface.co

Total runs: 45.9K
Run Growth: -9.5K
Growth Rate: -20.67%
Updated:July 01 2026
huggingface.co

Total runs: 39.7K
Run Growth: -40.2K
Growth Rate: -101.26%
Updated:June 19 2026
huggingface.co

Total runs: 9.2K
Run Growth: 2.3K
Growth Rate: 24.66%
Updated:October 09 2024
huggingface.co

Total runs: 5.4K
Run Growth: -5.2K
Growth Rate: -90.75%
Updated:August 12 2025
huggingface.co

Total runs: 5.1K
Run Growth: -14.7K
Growth Rate: -286.63%
Updated:July 27 2026
huggingface.co

Total runs: 2.4K
Run Growth: 2.2K
Growth Rate: 93.93%
Updated:June 15 2026
huggingface.co

Total runs: 1.5K
Run Growth: 958
Growth Rate: 62.66%
Updated:June 19 2026
huggingface.co

Total runs: 1.1K
Run Growth: -1.5K
Growth Rate: -142.74%
Updated:June 19 2026
huggingface.co

Total runs: 1.1K
Run Growth: 507
Growth Rate: 47.12%
Updated:June 26 2025
huggingface.co

Total runs: 985
Run Growth: -378
Growth Rate: -40.43%
Updated:May 27 2026
huggingface.co

Total runs: 624
Run Growth: -96
Growth Rate: -15.38%
Updated:November 03 2025
huggingface.co

Total runs: 600
Run Growth: 471
Growth Rate: 78.50%
Updated:July 22 2026
huggingface.co

Total runs: 523
Run Growth: -11
Growth Rate: -2.10%
Updated:November 15 2025
huggingface.co

Total runs: 508
Run Growth: 173
Growth Rate: 34.06%
Updated:November 18 2025
huggingface.co

Total runs: 504
Run Growth: 201
Growth Rate: 39.88%
Updated:November 18 2025
huggingface.co

Total runs: 494
Run Growth: 300
Growth Rate: 60.73%
Updated:June 06 2025
huggingface.co

Total runs: 430
Run Growth: -1
Growth Rate: -0.23%
Updated:January 22 2026