RedHatAI / gemma-4-31B-it-FP8-dynamic

huggingface.co
Total runs: 258.4K
24-hour runs: 4.0K
7-day runs: -37.4K
30-day runs: -19.8K
Model's Last Updated: August 13 2026
image-text-to-text

Introduction of gemma-4-31B-it-FP8-dynamic

Model Details of gemma-4-31B-it-FP8-dynamic

This is a preliminary version (and subject to change) of the FP8 quantized google/gemma-4-31B-it model. The model has both weights and activations quantized to FP8 with vllm-project/llm-compressor.

This model requires a nightly vllm wheel, see install instructions at https://docs.vllm.ai/projects/recipes/en/latest/Google/Gemma4.html#installing-vllm

On a single B200:

lm_eval  --model local-chat-completions   --tasks gsm8k_platinum_cot_llama   --model_args "model=RedHatAI/gemma-4-31B-it-FP8-Dynamic,max_length=96000,base_url=http://0.0.0.0:8000/v1/chat/completions,num_concurrent=128,max_retries=3,tokenized_requests=False,tokenizer_backend=None,timeout=2400"   --num_fewshot 5   --apply_chat_template   --fewshot_as_multiturn   --output_path results_gsm8k_platinum.json   --seed 1234   --gen_kwargs "do_sample=True,temperature=1.0,top_p=0.95,top_k=64,max_gen_toks=64000,seed=1234"

Original:

|         Tasks          |Version|     Filter     |n-shot|  Metric   |   |Value|   |Stderr|
|------------------------|------:|----------------|-----:|-----------|---|----:|---|-----:|
|gsm8k_platinum_cot_llama|      3|flexible-extract|     5|exact_match|↑  |0.976|±  |0.0044|
|                        |       |strict-match    |     5|exact_match|↑  |0.976|±  |0.0044|

FP8:

|         Tasks          |Version|     Filter     |n-shot|  Metric   |   |Value |   |Stderr|
|------------------------|------:|----------------|-----:|-----------|---|-----:|---|-----:|
|gsm8k_platinum_cot_llama|      3|flexible-extract|     5|exact_match|↑  |0.9768|±  |0.0043|
|                        |       |strict-match    |     5|exact_match|↑  |0.9777|±  |0.0043|

Runs of RedHatAI gemma-4-31B-it-FP8-dynamic on huggingface.co

258.4K
Total runs
4.0K
24-hour runs
11.0K
3-day runs
-37.4K
7-day runs
-19.8K
30-day runs

More Information About gemma-4-31B-it-FP8-dynamic huggingface.co Model

More gemma-4-31B-it-FP8-dynamic license Visit here:

https://choosealicense.com/licenses/apache-2.0

gemma-4-31B-it-FP8-dynamic huggingface.co

gemma-4-31B-it-FP8-dynamic huggingface.co is an AI model on huggingface.co that provides gemma-4-31B-it-FP8-dynamic's model effect (), which can be used instantly with this RedHatAI gemma-4-31B-it-FP8-dynamic model. huggingface.co supports a free trial of the gemma-4-31B-it-FP8-dynamic model, and also provides paid use of the gemma-4-31B-it-FP8-dynamic. Support call gemma-4-31B-it-FP8-dynamic model through api, including Node.js, Python, http.

gemma-4-31B-it-FP8-dynamic huggingface.co Url

https://huggingface.co/RedHatAI/gemma-4-31B-it-FP8-dynamic

RedHatAI gemma-4-31B-it-FP8-dynamic online free

gemma-4-31B-it-FP8-dynamic huggingface.co is an online trial and call api platform, which integrates gemma-4-31B-it-FP8-dynamic's modeling effects, including api services, and provides a free online trial of gemma-4-31B-it-FP8-dynamic, you can try gemma-4-31B-it-FP8-dynamic online for free by clicking the link below.

RedHatAI gemma-4-31B-it-FP8-dynamic online free url in huggingface.co:

https://huggingface.co/RedHatAI/gemma-4-31B-it-FP8-dynamic

gemma-4-31B-it-FP8-dynamic install

gemma-4-31B-it-FP8-dynamic is an open source model from GitHub that offers a free installation service, and any user can find gemma-4-31B-it-FP8-dynamic on GitHub to install. At the same time, huggingface.co provides the effect of gemma-4-31B-it-FP8-dynamic install, users can directly use gemma-4-31B-it-FP8-dynamic installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

gemma-4-31B-it-FP8-dynamic install url in huggingface.co:

https://huggingface.co/RedHatAI/gemma-4-31B-it-FP8-dynamic

Url of gemma-4-31B-it-FP8-dynamic

gemma-4-31B-it-FP8-dynamic huggingface.co Url

Provider of gemma-4-31B-it-FP8-dynamic huggingface.co

RedHatAI
ORGANIZATIONS

Other API from RedHatAI

huggingface.co

Total runs: 26.2K
Run Growth: -15.7K
Growth Rate: -59.90%
Updated:May 18 2026
huggingface.co

Total runs: 20.9K
Run Growth: -11.8K
Growth Rate: -56.48%
Updated:April 29 2026