amd / grok-1-W4A8KV8

huggingface.co
Total runs: 11.2K
24-hour runs: -104
7-day runs: -874
30-day runs: 1.3K
Model's Last Updated: August 12 2025

Introduction of grok-1-W4A8KV8

Model Details of grok-1-W4A8KV8

Grok-1-W4A8KV8

Introduction

This model was created by applying Quark with calibration samples from Pile dataset.

Quantization Stragegy
  • Quantized Layers : All linear layers excluding "lm_head", "*.gate"
  • Weight : FP8 symmetric per-tensor, additionally, INT4 symmetric per-channel for MoE linear
  • Activation : FP8 symmetric per-tensor
  • KV Cache : FP8 symmetric per-tensor
INT4 Packing

Every eight int4 values are packed into a single int32 integeter following the sequence defined by order_map = [0, 2, 4, 6, 1, 3, 5, 7] .

Quick Start

Follow Quantizing Sharded Grok-1 with Quark for SGLang to produced the quantized model using Quark.

Deployment

Quark has its own export format and allows FP8 quantized models to be efficiently deployed using the SGLang backend.

Evaluation
Evaluation scores
Benchmark grok-1 grok-1-W4A8KV8(this model)
gsm8k 0.821 0.817
License

Modifications copyright(c) 2024 Advanced Micro Devices,Inc. All rights reserved.

Runs of amd grok-1-W4A8KV8 on huggingface.co

11.2K
Total runs
-104
24-hour runs
-382
3-day runs
-874
7-day runs
1.3K
30-day runs

More Information About grok-1-W4A8KV8 huggingface.co Model

More grok-1-W4A8KV8 license Visit here:

https://choosealicense.com/licenses/apache-2.0

grok-1-W4A8KV8 huggingface.co

grok-1-W4A8KV8 huggingface.co is an AI model on huggingface.co that provides grok-1-W4A8KV8's model effect (), which can be used instantly with this amd grok-1-W4A8KV8 model. huggingface.co supports a free trial of the grok-1-W4A8KV8 model, and also provides paid use of the grok-1-W4A8KV8. Support call grok-1-W4A8KV8 model through api, including Node.js, Python, http.

grok-1-W4A8KV8 huggingface.co Url

https://huggingface.co/amd/grok-1-W4A8KV8

amd grok-1-W4A8KV8 online free

grok-1-W4A8KV8 huggingface.co is an online trial and call api platform, which integrates grok-1-W4A8KV8's modeling effects, including api services, and provides a free online trial of grok-1-W4A8KV8, you can try grok-1-W4A8KV8 online for free by clicking the link below.

amd grok-1-W4A8KV8 online free url in huggingface.co:

https://huggingface.co/amd/grok-1-W4A8KV8

grok-1-W4A8KV8 install

grok-1-W4A8KV8 is an open source model from GitHub that offers a free installation service, and any user can find grok-1-W4A8KV8 on GitHub to install. At the same time, huggingface.co provides the effect of grok-1-W4A8KV8 install, users can directly use grok-1-W4A8KV8 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

grok-1-W4A8KV8 install url in huggingface.co:

https://huggingface.co/amd/grok-1-W4A8KV8

Url of grok-1-W4A8KV8

grok-1-W4A8KV8 huggingface.co Url

Provider of grok-1-W4A8KV8 huggingface.co

amd
ORGANIZATIONS

Other API from amd

huggingface.co

Total runs: 179.1K
Run Growth: 87.8K
Growth Rate: 49.05%
Updated:April 14 2026
huggingface.co

Total runs: 117.5K
Run Growth: 12.1K
Growth Rate: 10.28%
Updated:July 17 2026
huggingface.co

Total runs: 105.8K
Run Growth: 16.2K
Growth Rate: 15.28%
Updated:June 19 2026
huggingface.co

Total runs: 52.2K
Run Growth: 71
Growth Rate: 0.14%
Updated:July 01 2026
huggingface.co

Total runs: 25.8K
Run Growth: 12.3K
Growth Rate: 47.76%
Updated:July 27 2026
huggingface.co

Total runs: 12.3K
Run Growth: 5.9K
Growth Rate: 47.68%
Updated:October 09 2024
huggingface.co

Total runs: 2.5K
Run Growth: -533
Growth Rate: -19.83%
Updated:June 19 2026
huggingface.co

Total runs: 1.4K
Run Growth: -38.8K
Growth Rate: -2876.00%
Updated:June 19 2026
huggingface.co

Total runs: 948
Run Growth: -2.7K
Growth Rate: -290.47%
Updated:May 27 2026
huggingface.co

Total runs: 542
Run Growth: -4.8K
Growth Rate: -880.26%
Updated:June 19 2026
huggingface.co

Total runs: 517
Run Growth: -350
Growth Rate: -67.70%
Updated:November 15 2025