Total runs:
318.4K
Run Growth:
237.2K
Growth Rate:
77.24%
Sponsored by
YouArt
AtomicChat / gemma-4-31B-it-GGUF
Model's Last Updated: July 24 2026
image-text-to-text
Introduction of gemma-4-31B-it-GGUF
Model Details of gemma-4-31B-it-GGUF
Gemma 4 31B , self-quantized to GGUF by Atomic Chat . Built straight from Google's original weights with a per-tensor importance matrix. Runs fully offline.
Highlights
- Multimodal — natively handles text and image input and generates text output.
- Built-in reasoning — designed as a capable reasoner with a configurable thinking mode set via the system prompt.
- 256K context window for long documents and codebases.
- Multilingual — out-of-the-box support for 35+ languages, pre-trained on 140+ languages.
- Coding & agentic — native function-calling support and notable coding-benchmark improvements.
-
Native system prompt
— native support for the
systemrole for more structured conversations.
These GGUFs are self-quantized from the original weights , not a repack. The importance matrix keeps low-bit quants closer to the full-precision model.
Always pass
--jinjaso the Gemma 4 31B chat template is applied. Without it the model can emit malformed turns.
Model Overview
| Property | Value |
|---|---|
| Base model |
google/gemma-4-31B-it
|
| Total parameters | 30.7B (Dense) |
| Layers | 60 |
| Context length | 256K tokens |
| Vocabulary | 262K |
| Architecture | Dense decoder, hybrid local/global attention with Proportional RoPE |
| This repo | GGUF quants (imatrix) + vision mmproj |
Gemma 4 31B is multimodal. This repo ships the
mmproj-gemma4-31b-it-f16.ggufvision projector. With-hfit is pulled automatically; otherwise pass--mmproj. Usellama-mtmd-cliorllama-serverto feed images.
Scores are Google's published results for the base
google/gemma-4-31B-it
. Quantization preserves the large majority of this;
Q4_K_M
and up sit within a point or two of full precision.
Choosing a quant
| Quant | Size | Notes |
|---|---|---|
Q2_K
|
11.9 GB | Smallest. Minimal RAM, clear quality drop. |
IQ3_M
|
14.2 GB | Beats Q3 at similar size thanks to imatrix. Best low-RAM pick. |
Q3_K_M
|
15.3 GB | Low quality but usable. |
Q3_K_L
|
16.6 GB | A step above Q3_K_M. |
IQ4_XS
|
16.7 GB | Excellent quality for size. Recommended low-bit. |
Q4_K_S
|
17.8 GB | Compact Q4, fast. |
Q4_K_M
|
18.7 GB | Recommended default. Best balance of size, speed and quality. |
UD-Q4_K_XL
|
19.0 GB | Dynamic. Embeddings and output kept at Q8_0 for higher quality at a Q4 footprint. |
Q5_K_S
|
19.6 GB | Higher quality. |
Q5_K_M
|
17.4 GB | Higher quality, low loss. |
Q6_K
|
7.6 GB | Near lossless. |
Q8_0
|
18.4 GB | Effectively lossless, reference quality. |
Pick the largest file that fits your (V)RAM with room for context.
Q4_K_MorUD-Q4_K_XLis the sweet spot for most setups;Q6_KorQ8_0for maximum fidelity.
Get started
Run Gemma 4 31B locally with:
-
Atomic Chat
:
the easiest path. Open the app, search
AtomicChat/gemma4-31b-it-GGUF, pick a quant, hit Use this model . -
llama.cpp:
llama-server -hf AtomicChat/gemma4-31b-it-GGUF:Q4_K_M --jinja -c 8192 -
Ollama:
ollama run hf.co/AtomicChat/gemma4-31b-it-GGUF:Q4_K_M - LM Studio / Jan: search the repo id, download any quant.
Best practices
| Parameter | Value |
|---|---|
| temperature | 1.0 |
| top_p | 0.95 |
| top_k | 64 |
Google's standardized sampling configuration recommended across all use cases.
Run in llama.cpp
git clone https://github.com/ggerganov/llama.cpp
cmake llama.cpp -B llama.cpp/build -DBUILD_SHARED_LIBS=OFF -DGGML_CUDA=ON
cmake --build llama.cpp/build --config Release -j --target llama-cli llama-server
./llama.cpp/build/bin/llama-server \
-hf AtomicChat/gemma4-31b-it-GGUF:UD-Q4_K_XL \
--jinja -ngl 99 -c 8192 -fa on
How these were made
-
Download
google/gemma-4-31B-it(original weights). - Convert to f16 GGUF with llama.cpp .
-
Build an importance matrix over
calibration_datav3(100 chunks). -
Quantize the full ladder with
--imatrix. -
UD-Q4_K_XLadditionally pins the token-embedding and output tensors toQ8_0.
License
Original model by Google DeepMind, released under the Apache 2.0 license. Quantized by Atomic Chat.
Runs of AtomicChat gemma-4-31B-it-GGUF on huggingface.co
2.7K
Total runs
41
24-hour runs
469
3-day runs
477
7-day runs
-1.3K
30-day runs
More Information About gemma-4-31B-it-GGUF huggingface.co Model
Url of gemma-4-31B-it-GGUF
gemma-4-31B-it-GGUF huggingface.co Url
Provider of gemma-4-31B-it-GGUF huggingface.co
Other API from AtomicChat
Updated:August 09 2026
Total runs:
307.4K
Run Growth:
277.1K
Growth Rate:
88.62%
Total runs:
89.5K
Run Growth:
79.8K
Growth Rate:
89.74%
Total runs:
89.2K
Run Growth:
59.8K
Growth Rate:
100.00%
Total runs:
72.9K
Run Growth:
56.8K
Growth Rate:
78.00%
Total runs:
72.7K
Run Growth:
53.1K
Growth Rate:
72.78%
Total runs:
72.4K
Run Growth:
54.3K
Growth Rate:
74.94%
Total runs:
60.1K
Run Growth:
56.4K
Growth Rate:
94.84%
Total runs:
7.5K
Run Growth:
-1.3K
Growth Rate:
-16.64%
Total runs:
5.9K
Run Growth:
113
Growth Rate:
2.03%
Total runs:
5.3K
Run Growth:
5.4K
Growth Rate:
71.79%
Total runs:
4.6K
Run Growth:
-1.9K
Growth Rate:
-41.02%
Total runs:
4.6K
Run Growth:
-14.0K
Growth Rate:
-280.59%
Total runs:
4.5K
Run Growth:
-12.8K
Growth Rate:
-279.45%
Total runs:
4.4K
Run Growth:
-9.7K
Growth Rate:
-219.28%
Total runs:
3.6K
Run Growth:
-2.8K
Growth Rate:
-83.75%
Total runs:
2.7K
Run Growth:
436
Growth Rate:
17.07%
Total runs:
2.5K
Run Growth:
-2.8K
Growth Rate:
-126.64%
Total runs:
2.3K
Run Growth:
-1.4K
Growth Rate:
-61.26%
Total runs:
2.3K
Run Growth:
-11.8K
Growth Rate:
-511.13%
Total runs:
2.0K
Run Growth:
-9.4K
Growth Rate:
-478.02%
Total runs:
2.0K
Run Growth:
295
Growth Rate:
14.55%
Total runs:
1.9K
Run Growth:
960
Growth Rate:
55.81%
Total runs:
1.9K
Run Growth:
-15.0K
Growth Rate:
-850.62%
Total runs:
1.7K
Run Growth:
657
Growth Rate:
37.65%
Total runs:
1.6K
Run Growth:
616
Growth Rate:
38.02%
Total runs:
1.6K
Run Growth:
1.6K
Growth Rate:
100.00%
Total runs:
1.6K
Run Growth:
-594
Growth Rate:
-39.49%
Total runs:
1.3K
Run Growth:
-2.1K
Growth Rate:
-163.80%
Total runs:
1.3K
Run Growth:
1.1K
Growth Rate:
100.00%
Total runs:
1.2K
Run Growth:
1.2K
Growth Rate:
100.00%
Total runs:
1.0K
Run Growth:
1.0K
Growth Rate:
100.00%
Total runs:
988
Run Growth:
976
Growth Rate:
100.00%
Total runs:
982
Run Growth:
964
Growth Rate:
100.00%
Total runs:
952
Run Growth:
-324
Growth Rate:
-34.69%
Total runs:
770
Run Growth:
-288
Growth Rate:
-37.02%
Total runs:
715
Run Growth:
-945
Growth Rate:
-109.00%
Total runs:
680
Run Growth:
-3.6K
Growth Rate:
-547.71%
Total runs:
606
Run Growth:
-7.7K
Growth Rate:
-1249.03%
Total runs:
602
Run Growth:
602
Growth Rate:
100.00%
Total runs:
569
Run Growth:
-45
Growth Rate:
-7.99%
Total runs:
562
Run Growth:
555
Growth Rate:
100.00%
Total runs:
530
Run Growth:
24
Growth Rate:
4.59%
Total runs:
529
Run Growth:
-623
Growth Rate:
-119.12%
Total runs:
526
Run Growth:
-3.3K
Growth Rate:
-619.07%
Total runs:
476
Run Growth:
-467
Growth Rate:
-97.29%
Total runs:
457
Run Growth:
-1.3K
Growth Rate:
-271.61%
Total runs:
429
Run Growth:
-426
Growth Rate:
-99.30%
Total runs:
420
Run Growth:
410
Growth Rate:
96.24%
Total runs:
414
Run Growth:
-1.4K
Growth Rate:
-320.70%
Total runs:
397
Run Growth:
-542
Growth Rate:
-137.56%
Total runs:
390
Run Growth:
379
Growth Rate:
100.00%
Total runs:
378
Run Growth:
-1.4K
Growth Rate:
-405.88%
Total runs:
372
Run Growth:
-1.3K
Growth Rate:
-329.41%
Total runs:
365
Run Growth:
336
Growth Rate:
100.00%
Total runs:
363
Run Growth:
-37
Growth Rate:
-11.82%
Total runs:
291
Run Growth:
-568
Growth Rate:
-191.89%
Total runs:
283
Run Growth:
281
Growth Rate:
100.00%
Total runs:
282
Run Growth:
-1.4K
Growth Rate:
-496.11%
Total runs:
277
Run Growth:
273
Growth Rate:
100.00%
Total runs:
271
Run Growth:
269
Growth Rate:
100.00%
Total runs:
259
Run Growth:
-843
Growth Rate:
-328.02%
Total runs:
256
Run Growth:
-141
Growth Rate:
-51.84%
Total runs:
251
Run Growth:
170
Growth Rate:
72.34%
Total runs:
235
Run Growth:
-5.6K
Growth Rate:
-2350.63%
Total runs:
224
Run Growth:
-794
Growth Rate:
-343.72%
Total runs:
221
Run Growth:
218
Growth Rate:
100.00%
Total runs:
211
Run Growth:
-656
Growth Rate:
-310.90%
Total runs:
206
Run Growth:
-1.1K
Growth Rate:
-433.88%
Total runs:
198
Run Growth:
-305
Growth Rate:
-151.74%
Total runs:
194
Run Growth:
-20
Growth Rate:
-10.05%
Total runs:
193
Run Growth:
189
Growth Rate:
100.00%
Total runs:
172
Run Growth:
-223
Growth Rate:
-131.95%
Total runs:
161
Run Growth:
-957
Growth Rate:
-540.68%
Total runs:
140
Run Growth:
-419
Growth Rate:
-297.16%
Total runs:
137
Run Growth:
-818
Growth Rate:
-601.47%
Total runs:
132
Run Growth:
-313
Growth Rate:
-228.47%
Total runs:
131
Run Growth:
-707
Growth Rate:
-508.63%
Total runs:
128
Run Growth:
-283
Growth Rate:
-196.53%
Total runs:
128
Run Growth:
-774
Growth Rate:
-486.79%
Total runs:
124
Run Growth:
-228
Growth Rate:
-166.42%
Total runs:
117
Run Growth:
117
Growth Rate:
100.00%
Total runs:
117
Run Growth:
-831
Growth Rate:
-654.33%
Total runs:
117
Run Growth:
104
Growth Rate:
88.89%
Total runs:
116
Run Growth:
-700
Growth Rate:
-573.77%
Total runs:
112
Run Growth:
-744
Growth Rate:
-625.21%
Total runs:
112
Run Growth:
-894
Growth Rate:
-784.21%
Total runs:
111
Run Growth:
-975
Growth Rate:
-833.33%
Total runs:
108
Run Growth:
-423
Growth Rate:
-399.06%
Total runs:
106
Run Growth:
-253
Growth Rate:
-236.45%
Total runs:
105
Run Growth:
-1.1K
Growth Rate:
-964.66%
Total runs:
94
Run Growth:
82
Growth Rate:
87.23%
Total runs:
92
Run Growth:
-440
Growth Rate:
-483.52%
Total runs:
75
Run Growth:
22
Growth Rate:
28.21%
Total runs:
58
Run Growth:
-19
Growth Rate:
-30.65%
Total runs:
51
Run Growth:
-26
Growth Rate:
-47.27%
Total runs:
45
Run Growth:
-6
Growth Rate:
-12.50%
Total runs:
45
Run Growth:
4
Growth Rate:
8.33%