Total runs:
342.1K
Run Growth:
260.0K
Growth Rate:
78.00%
Sponsored by
APIMart
AtomicChat / gemma-4-12B-it-NVFP4
Model's Last Updated: July 23 2026
text-generation
Introduction of gemma-4-12B-it-NVFP4
Model Details of gemma-4-12B-it-NVFP4
Gemma 4 12B , self-quantized to NVFP4 by Atomic Chat . Built straight from Google's original weights with a per-tensor importance matrix, so this is not a repack of somebody else's files. Runs fully offline.
Highlights
- 11.95B parameters : the weights this repo quantizes.
- Context length : 256K tokens, as published by Google.
- 48 layers : Dense decoder, hybrid sliding-window (1024) and global attention.
- Modalities : Text, Image, Audio.
- Full imatrix ladder : every quant is calibrated with an importance matrix.
- Reasoning : All models in the family are designed as highly capable reasoners, with configurable thinking modes.
- Diverse & Efficient Architectures : Offers Dense and Mixture-of-Experts (MoE) variants of different sizes for scalable deployment.
These NVFP4s are self-quantized from the original weights , not a repack. The importance matrix keeps low-bit quants closer to the full-precision model.
Model Overview
| Property | Value |
|---|---|
| Base model |
google/gemma-4-12B-it
|
| Parameters | 11.95B |
| Layers | 48 |
| Sliding window | 1024 tokens |
| Context length | 256K tokens |
| Vocabulary | 262K |
| Modalities | Text, Image, Audio |
| Architecture |
Dense decoder, hybrid sliding-window (1024) and global attention, 16 attention heads over 8 KV heads,
Gemma4UnifiedForConditionalGeneration
|
| This repo | NVFP4 weights |
Benchmarks
| Benchmark | Score |
|---|---|
| MMLU Pro | 77.2% |
| AIME 2026 no tools | 77.5% |
| LiveCodeBench v6 | 72.0% |
| Codeforces ELO | 1659 |
| GPQA Diamond | 78.8% |
| Tau2 (average over 3) | 69.0% |
| HLE no tools | 5.2% |
| BigBench Extra Hard | 53.0% |
| MMMLU | 83.4% |
| MMMU Pro | 69.1% |
| OmniDocBench 1.5 (average edit distance, lower is better) | 0.164 |
| MATH-Vision | 79.7% |
| MedXPertQA MM | 48.7% |
| CoVoST | 38.5 |
| FLEURS (lower is better) | 0.069 |
| MRCR v2 8 needle 128k (average) | 43.4% |
Scores are Google's published results for the base
google/gemma-4-12B-it
, not our own measurements. Quantization preserves the large majority of this;
Q4_K_M
and up stay close to full precision.
Get started
-
Atomic Chat
:
search
AtomicChat/gemma-4-12B-it-NVFP4and hit Use this model . -
vLLM:
vllm serve AtomicChat/gemma-4-12B-it-NVFP4 --max-model-len 8192
Best practices
| Parameter | Value |
|---|---|
| temperature | 1.0 |
| top_p | 0.95 |
| top_k | 64 |
Google's recommended sampling configuration for
google/gemma-4-12B-it
.
How these were made
-
Download
google/gemma-4-12B-it(original weights). -
Quantize to NVFP4 with
llm-compressorover a calibration corpus.
License
Original model by Google, released under the Apache 2.0 license. Full terms: Apache 2.0 . Quantized by Atomic Chat.
Runs of AtomicChat gemma-4-12B-it-NVFP4 on huggingface.co
65
Total runs
0
24-hour runs
-10
3-day runs
-8
7-day runs
-5
30-day runs
More Information About gemma-4-12B-it-NVFP4 huggingface.co Model
Url of gemma-4-12B-it-NVFP4
gemma-4-12B-it-NVFP4 huggingface.co Url
Provider of gemma-4-12B-it-NVFP4 huggingface.co
Other API from AtomicChat
Updated:August 09 2026
Total runs:
246.6K
Run Growth:
224.7K
Growth Rate:
86.33%
Total runs:
170.7K
Run Growth:
142.2K
Growth Rate:
100.00%
Total runs:
95.1K
Run Growth:
83.1K
Growth Rate:
90.10%
Total runs:
73.6K
Run Growth:
47.9K
Growth Rate:
65.57%
Total runs:
73.4K
Run Growth:
46.9K
Growth Rate:
64.40%
Total runs:
73.2K
Run Growth:
45.9K
Growth Rate:
63.30%
Total runs:
63.0K
Run Growth:
57.9K
Growth Rate:
94.97%
Total runs:
6.5K
Run Growth:
1.1K
Growth Rate:
17.87%
Total runs:
5.2K
Run Growth:
14
Growth Rate:
0.28%
Total runs:
4.4K
Run Growth:
-2.8K
Growth Rate:
-64.34%
Total runs:
4.2K
Run Growth:
-13.4K
Growth Rate:
-309.09%
Total runs:
4.1K
Run Growth:
-8.2K
Growth Rate:
-196.28%
Total runs:
3.7K
Run Growth:
-10.0K
Growth Rate:
-232.45%
Total runs:
3.7K
Run Growth:
-15.7K
Growth Rate:
-378.44%
Total runs:
3.6K
Run Growth:
-2.2K
Growth Rate:
-58.47%
Total runs:
3.0K
Run Growth:
-2.4K
Growth Rate:
-88.22%
Total runs:
2.9K
Run Growth:
588
Growth Rate:
20.52%
Total runs:
2.8K
Run Growth:
-730
Growth Rate:
-26.74%
Total runs:
2.4K
Run Growth:
-1.4K
Growth Rate:
-57.21%
Total runs:
2.2K
Run Growth:
-8.9K
Growth Rate:
-432.04%
Total runs:
2.1K
Run Growth:
369
Growth Rate:
18.16%
Total runs:
2.1K
Run Growth:
-13.6K
Growth Rate:
-623.58%
Total runs:
1.9K
Run Growth:
827
Growth Rate:
45.64%
Total runs:
1.9K
Run Growth:
-14.8K
Growth Rate:
-808.50%
Total runs:
1.7K
Run Growth:
657
Growth Rate:
37.65%
Total runs:
1.6K
Run Growth:
1.5K
Growth Rate:
100.00%
Total runs:
1.6K
Run Growth:
1.6K
Growth Rate:
100.00%
Total runs:
1.6K
Run Growth:
-556
Growth Rate:
-35.85%
Total runs:
1.6K
Run Growth:
708
Growth Rate:
44.84%
Total runs:
1.2K
Run Growth:
1.2K
Growth Rate:
100.00%
Total runs:
1.2K
Run Growth:
-1.9K
Growth Rate:
-158.26%
Total runs:
1.2K
Run Growth:
-175
Growth Rate:
-15.71%
Total runs:
1.0K
Run Growth:
-1.0K
Growth Rate:
-97.48%
Total runs:
1.0K
Run Growth:
1.0K
Growth Rate:
100.00%
Total runs:
1.0K
Run Growth:
1.0K
Growth Rate:
100.00%
Total runs:
1.0K
Run Growth:
1.0K
Growth Rate:
100.00%
Total runs:
735
Run Growth:
-102
Growth Rate:
-13.65%
Total runs:
631
Run Growth:
-3.6K
Growth Rate:
-554.97%
Total runs:
623
Run Growth:
-7.6K
Growth Rate:
-1226.13%
Total runs:
602
Run Growth:
602
Growth Rate:
100.00%
Total runs:
602
Run Growth:
-75
Growth Rate:
-12.91%
Total runs:
599
Run Growth:
-3.3K
Growth Rate:
-556.97%
Total runs:
585
Run Growth:
577
Growth Rate:
100.00%
Total runs:
565
Run Growth:
495
Growth Rate:
100.00%
Total runs:
554
Run Growth:
27
Growth Rate:
5.05%
Total runs:
534
Run Growth:
-290
Growth Rate:
-54.21%
Total runs:
502
Run Growth:
-1.3K
Growth Rate:
-299.32%
Total runs:
499
Run Growth:
135
Growth Rate:
28.30%
Total runs:
465
Run Growth:
-530
Growth Rate:
-113.98%
Total runs:
429
Run Growth:
-426
Growth Rate:
-99.30%
Total runs:
411
Run Growth:
408
Growth Rate:
100.00%
Total runs:
407
Run Growth:
-1.3K
Growth Rate:
-323.08%
Total runs:
405
Run Growth:
-1.4K
Growth Rate:
-339.80%
Total runs:
391
Run Growth:
-306
Growth Rate:
-78.87%
Total runs:
384
Run Growth:
353
Growth Rate:
90.98%
Total runs:
305
Run Growth:
240
Growth Rate:
78.69%
Total runs:
297
Run Growth:
294
Growth Rate:
100.00%
Total runs:
293
Run Growth:
290
Growth Rate:
100.00%
Total runs:
293
Run Growth:
-610
Growth Rate:
-206.08%
Total runs:
286
Run Growth:
281
Growth Rate:
100.00%
Total runs:
282
Run Growth:
-137
Growth Rate:
-47.57%
Total runs:
269
Run Growth:
-340
Growth Rate:
-126.39%
Total runs:
251
Run Growth:
-1.5K
Growth Rate:
-558.94%
Total runs:
245
Run Growth:
-561
Growth Rate:
-225.30%
Total runs:
233
Run Growth:
232
Growth Rate:
100.00%
Total runs:
225
Run Growth:
-1.6K
Growth Rate:
-766.18%
Total runs:
223
Run Growth:
-832
Growth Rate:
-364.91%
Total runs:
222
Run Growth:
-94
Growth Rate:
-48.45%
Total runs:
218
Run Growth:
-6.4K
Growth Rate:
-2937.33%
Total runs:
204
Run Growth:
201
Growth Rate:
100.00%
Total runs:
192
Run Growth:
-265
Growth Rate:
-156.80%
Total runs:
192
Run Growth:
-173
Growth Rate:
-91.05%
Total runs:
168
Run Growth:
-592
Growth Rate:
-293.07%
Total runs:
161
Run Growth:
-907
Growth Rate:
-546.39%
Total runs:
137
Run Growth:
-732
Growth Rate:
-534.31%
Total runs:
137
Run Growth:
-164
Growth Rate:
-116.31%
Total runs:
135
Run Growth:
-380
Growth Rate:
-271.43%
Total runs:
135
Run Growth:
-284
Growth Rate:
-218.46%
Total runs:
126
Run Growth:
-857
Growth Rate:
-649.24%
Total runs:
120
Run Growth:
-500
Growth Rate:
-393.70%
Total runs:
117
Run Growth:
117
Growth Rate:
100.00%
Total runs:
117
Run Growth:
104
Growth Rate:
88.89%
Total runs:
110
Run Growth:
-733
Growth Rate:
-621.19%
Total runs:
107
Run Growth:
-219
Growth Rate:
-200.92%
Total runs:
106
Run Growth:
-780
Growth Rate:
-690.27%
Total runs:
106
Run Growth:
-885
Growth Rate:
-790.18%
Total runs:
104
Run Growth:
-1.0K
Growth Rate:
-922.73%
Total runs:
102
Run Growth:
-390
Growth Rate:
-375.00%
Total runs:
96
Run Growth:
-1.2K
Growth Rate:
-1189.90%
Total runs:
94
Run Growth:
82
Growth Rate:
87.23%
Total runs:
84
Run Growth:
-417
Growth Rate:
-479.31%
Total runs:
79
Run Growth:
-932
Growth Rate:
-991.49%
Total runs:
64
Run Growth:
-31
Growth Rate:
-51.67%
Total runs:
57
Run Growth:
-35
Growth Rate:
-66.04%
Total runs:
47
Run Growth:
-1
Growth Rate:
-2.13%
Total runs:
45
Run Growth:
-11
Growth Rate:
-23.91%