amd / Kimi-K2-Instruct-0905-MXFP4

huggingface.co
Total runs: 2.2K
24-hour runs: -20
7-day runs: 422
30-day runs: 714
Model's Last Updated: April 20 2026

Introduction of Kimi-K2-Instruct-0905-MXFP4

Model Details of Kimi-K2-Instruct-0905-MXFP4

Model Overview

  • Model Architecture: Kimi-K2-Instruct
    • Input: Text
    • Output: Text
  • Supported Hardware Microarchitecture: AMD MI350/MI355
  • ROCm: 7.0
  • Operating System(s): Linux
  • Inference Engine: vLLM
  • Model Optimizer: AMD-Quark
    • Weight quantization: MOE-only, OCP MXFP4, Static
    • Activation quantization: MOE-only, OCP MXFP4, Dynamic
  • Calibration Dataset: Pile

This model was built with Kimi-K2-Instruct model by applying AMD-Quark for MXFP4 quantization.

Model Quantization

The model was quantized from unsloth/Kimi-K2-Instruct-0905-BF16 using AMD-Quark . The weights and activations are quantized to MXFP4.

Deployment

Use with vLLM

This model can be deployed efficiently using the vLLM backend.

Evaluation

The model was evaluated on GSM8K benchmarks.

Accuracy
Benchmark Kimi-K2-Instruct-0905 Kimi-K2-Instruct-0905-MXFP4(this model) Recovery
GSM8K (strict-match) 95.53 94.47 98.89%
Reproduction

The GSM8K results were obtained using the lm-evaluation-harness framework, based on the Docker image rocm/vllm-private:vllm_dev_base_mxfp4_20260122 , with vLLM and lm-eval compiled and installed from source inside the image.

Launching server
export VLLM_ATTENTION_BACKEND="TRITON_MLA"
export VLLM_ROCM_USE_AITER=1
export VLLM_ROCM_USE_AITER_FUSION_SHARED_EXPERTS=0

vllm serve amd/Kimi-K2-Instruct-0905-MXFP4 \
  --port 8000 \
  --served-model-name kimi-k2-mxfp4 \
  --trust-remote-code \
  --tensor-parallel-size 8 \
  --enable-auto-tool-choice \
  --tool-call-parser kimi_k2
Evaluating model in a new terminal
lm_eval \
  --model local-completions \
  --model_args "model=kimi-k2-mxfp4,base_url=http://0.0.0.0:8000/v1/completions,tokenized_requests=False,tokenizer_backend=None,num_concurrent=32" \
  --tasks gsm8k \
  --num_fewshot 5 \
  --batch_size 1

License

Modifications Copyright(c) 2025 Advanced Micro Devices, Inc. All rights reserved.

Runs of amd Kimi-K2-Instruct-0905-MXFP4 on huggingface.co

2.2K
Total runs
-20
24-hour runs
-179
3-day runs
422
7-day runs
714
30-day runs

More Information About Kimi-K2-Instruct-0905-MXFP4 huggingface.co Model

More Kimi-K2-Instruct-0905-MXFP4 license Visit here:

https://choosealicense.com/licenses/modified-mit

Kimi-K2-Instruct-0905-MXFP4 huggingface.co

Kimi-K2-Instruct-0905-MXFP4 huggingface.co is an AI model on huggingface.co that provides Kimi-K2-Instruct-0905-MXFP4's model effect (), which can be used instantly with this amd Kimi-K2-Instruct-0905-MXFP4 model. huggingface.co supports a free trial of the Kimi-K2-Instruct-0905-MXFP4 model, and also provides paid use of the Kimi-K2-Instruct-0905-MXFP4. Support call Kimi-K2-Instruct-0905-MXFP4 model through api, including Node.js, Python, http.

Kimi-K2-Instruct-0905-MXFP4 huggingface.co Url

https://huggingface.co/amd/Kimi-K2-Instruct-0905-MXFP4

amd Kimi-K2-Instruct-0905-MXFP4 online free

Kimi-K2-Instruct-0905-MXFP4 huggingface.co is an online trial and call api platform, which integrates Kimi-K2-Instruct-0905-MXFP4's modeling effects, including api services, and provides a free online trial of Kimi-K2-Instruct-0905-MXFP4, you can try Kimi-K2-Instruct-0905-MXFP4 online for free by clicking the link below.

amd Kimi-K2-Instruct-0905-MXFP4 online free url in huggingface.co:

https://huggingface.co/amd/Kimi-K2-Instruct-0905-MXFP4

Kimi-K2-Instruct-0905-MXFP4 install

Kimi-K2-Instruct-0905-MXFP4 is an open source model from GitHub that offers a free installation service, and any user can find Kimi-K2-Instruct-0905-MXFP4 on GitHub to install. At the same time, huggingface.co provides the effect of Kimi-K2-Instruct-0905-MXFP4 install, users can directly use Kimi-K2-Instruct-0905-MXFP4 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Kimi-K2-Instruct-0905-MXFP4 install url in huggingface.co:

https://huggingface.co/amd/Kimi-K2-Instruct-0905-MXFP4

Url of Kimi-K2-Instruct-0905-MXFP4

Kimi-K2-Instruct-0905-MXFP4 huggingface.co Url

Provider of Kimi-K2-Instruct-0905-MXFP4 huggingface.co

amd
ORGANIZATIONS

Other API from amd

huggingface.co

Total runs: 191.0K
Run Growth: 105.2K
Growth Rate: 55.10%
Updated:April 14 2026
huggingface.co

Total runs: 111.9K
Run Growth: -9.9K
Growth Rate: -8.83%
Updated:July 17 2026
huggingface.co

Total runs: 101.2K
Run Growth: 10.7K
Growth Rate: 10.58%
Updated:June 19 2026
huggingface.co

Total runs: 49.2K
Run Growth: -16.9K
Growth Rate: -34.40%
Updated:July 01 2026
huggingface.co

Total runs: 24.1K
Run Growth: 12.9K
Growth Rate: 53.69%
Updated:July 27 2026
huggingface.co

Total runs: 12.4K
Run Growth: 4.2K
Growth Rate: 33.45%
Updated:October 09 2024
huggingface.co

Total runs: 11.0K
Run Growth: 515
Growth Rate: 4.64%
Updated:August 12 2025
huggingface.co

Total runs: 2.6K
Run Growth: 546
Growth Rate: 21.37%
Updated:June 19 2026
huggingface.co

Total runs: 1.2K
Run Growth: -34.0K
Growth Rate: -2838.37%
Updated:June 19 2026
huggingface.co

Total runs: 1000
Run Growth: -2.8K
Growth Rate: -282.37%
Updated:May 27 2026
huggingface.co

Total runs: 546
Run Growth: -3.9K
Growth Rate: -717.58%
Updated:June 19 2026
huggingface.co

Total runs: 517
Run Growth: -409
Growth Rate: -79.11%
Updated:November 15 2025