Total runs:
312.7K
Run Growth:
277.1K
Growth Rate:
88.62%
Sponsored by
YouArt
AtomicChat / gemma-4-31B-it-MLX-8bit
Model's Last Updated: July 23 2026
text-generation
Introduction of gemma-4-31B-it-MLX-8bit
Model Details of gemma-4-31B-it-MLX-8bit
Gemma 4 31B , self-quantized to MLX by Atomic Chat . Built straight from Google's original weights with a per-tensor importance matrix, so this is not a repack of somebody else's files. Runs fully offline.
Highlights
- 30.7B parameters : the weights this repo quantizes.
- Context length : 256K tokens, as published by Google.
- 60 layers : Dense decoder, hybrid sliding-window (1024) and global attention.
- Modalities : Text, Image.
- Full imatrix ladder : every quant is calibrated with an importance matrix.
- Reasoning : All models in the family are designed as highly capable reasoners, with configurable thinking modes.
- Diverse & Efficient Architectures : Offers Dense and Mixture-of-Experts (MoE) variants of different sizes for scalable deployment.
These MLXs are self-quantized from the original weights , not a repack. The importance matrix keeps low-bit quants closer to the full-precision model.
Model Overview
| Property | Value |
|---|---|
| Base model |
google/gemma-4-31B-it
|
| Parameters | 30.7B |
| Layers | 60 |
| Sliding window | 1024 tokens |
| Context length | 256K tokens |
| Vocabulary | 262K |
| Modalities | Text, Image |
| Architecture |
Dense decoder, hybrid sliding-window (1024) and global attention, 32 attention heads over 16 KV heads,
Gemma4ForConditionalGeneration
|
| This repo | MLX weights |
Benchmarks
| Benchmark | Score |
|---|---|
| MMLU Pro | 85.2% |
| AIME 2026 no tools | 89.2% |
| LiveCodeBench v6 | 80.0% |
| Codeforces ELO | 2150 |
| GPQA Diamond | 84.3% |
| Tau2 (average over 3) | 76.9% |
| HLE no tools | 19.5% |
| HLE with search | 26.5% |
| BigBench Extra Hard | 74.4% |
| MMMLU | 88.4% |
| MMMU Pro | 76.9% |
| OmniDocBench 1.5 (average edit distance, lower is better) | 0.131 |
| MATH-Vision | 85.6% |
| MedXPertQA MM | 61.3% |
| MRCR v2 8 needle 128k (average) | 66.4% |
Scores are Google's published results for the base
google/gemma-4-31B-it
, not our own measurements. Quantization preserves the large majority of this;
Q4_K_M
and up stay close to full precision.
Get started
-
Atomic Chat
:
search
AtomicChat/gemma-4-31B-it-MLX-8bitand hit Use this model . -
mlx-lm:
mlx_lm.generate --model AtomicChat/gemma-4-31B-it-MLX-8bit --prompt "Hello" --max-tokens 512 -
Server:
mlx_lm.server --model AtomicChat/gemma-4-31B-it-MLX-8bit --port 8080
Best practices
| Parameter | Value |
|---|---|
| temperature | 1.0 |
| top_p | 0.95 |
| top_k | 64 |
Google's recommended sampling configuration for
google/gemma-4-31B-it
.
How these were made
-
Download
google/gemma-4-31B-it(original weights). -
Convert and quantize with
mlx_lm.converton our pipeline.
License
Original model by Google, released under the Apache 2.0 license. Full terms: Apache 2.0 . Quantized by Atomic Chat.
Runs of AtomicChat gemma-4-31B-it-MLX-8bit on huggingface.co
117
Total runs
-10
24-hour runs
-44
3-day runs
-90
7-day runs
-975
30-day runs
More Information About gemma-4-31B-it-MLX-8bit huggingface.co Model
Url of gemma-4-31B-it-MLX-8bit
gemma-4-31B-it-MLX-8bit huggingface.co Url
Provider of gemma-4-31B-it-MLX-8bit huggingface.co
Other API from AtomicChat
Updated:August 19 2026
Total runs:
307.2K
Run Growth:
237.2K
Growth Rate:
77.24%
Total runs:
88.9K
Run Growth:
79.8K
Growth Rate:
89.74%
Total runs:
73.0K
Run Growth:
53.1K
Growth Rate:
72.78%
Total runs:
72.9K
Run Growth:
56.8K
Growth Rate:
78.00%
Total runs:
72.4K
Run Growth:
54.3K
Growth Rate:
74.94%
Total runs:
59.8K
Run Growth:
59.8K
Growth Rate:
100.00%
Total runs:
59.5K
Run Growth:
56.4K
Growth Rate:
94.84%
Total runs:
7.5K
Run Growth:
-1.3K
Growth Rate:
-16.64%
Total runs:
7.5K
Run Growth:
5.4K
Growth Rate:
71.79%
Total runs:
5.6K
Run Growth:
113
Growth Rate:
2.03%
Total runs:
5.0K
Run Growth:
-14.0K
Growth Rate:
-280.59%
Total runs:
4.6K
Run Growth:
-1.9K
Growth Rate:
-41.02%
Total runs:
4.6K
Run Growth:
-12.8K
Growth Rate:
-279.45%
Total runs:
4.4K
Run Growth:
-9.7K
Growth Rate:
-219.28%
Total runs:
3.3K
Run Growth:
-2.8K
Growth Rate:
-83.75%
Total runs:
2.7K
Run Growth:
436
Growth Rate:
17.07%
Total runs:
2.5K
Run Growth:
-1.3K
Growth Rate:
-53.05%
Total runs:
2.3K
Run Growth:
-11.8K
Growth Rate:
-511.13%
Total runs:
2.3K
Run Growth:
-1.4K
Growth Rate:
-61.26%
Total runs:
2.2K
Run Growth:
-2.8K
Growth Rate:
-126.64%
Total runs:
2.0K
Run Growth:
295
Growth Rate:
14.55%
Total runs:
2.0K
Run Growth:
-9.4K
Growth Rate:
-478.02%
Total runs:
1.8K
Run Growth:
-15.0K
Growth Rate:
-850.62%
Total runs:
1.7K
Run Growth:
657
Growth Rate:
37.65%
Total runs:
1.7K
Run Growth:
960
Growth Rate:
55.81%
Total runs:
1.6K
Run Growth:
616
Growth Rate:
38.02%
Total runs:
1.6K
Run Growth:
1.6K
Growth Rate:
100.00%
Total runs:
1.5K
Run Growth:
-594
Growth Rate:
-39.49%
Total runs:
1.3K
Run Growth:
-2.1K
Growth Rate:
-163.80%
Total runs:
1.2K
Run Growth:
1.2K
Growth Rate:
100.00%
Total runs:
1.1K
Run Growth:
1.1K
Growth Rate:
100.00%
Total runs:
1.0K
Run Growth:
1.0K
Growth Rate:
100.00%
Total runs:
976
Run Growth:
976
Growth Rate:
100.00%
Total runs:
964
Run Growth:
964
Growth Rate:
100.00%
Total runs:
934
Run Growth:
-324
Growth Rate:
-34.69%
Total runs:
867
Run Growth:
-945
Growth Rate:
-109.00%
Total runs:
778
Run Growth:
-288
Growth Rate:
-37.02%
Total runs:
654
Run Growth:
-3.6K
Growth Rate:
-547.71%
Total runs:
618
Run Growth:
-7.7K
Growth Rate:
-1249.03%
Total runs:
602
Run Growth:
602
Growth Rate:
100.00%
Total runs:
563
Run Growth:
-45
Growth Rate:
-7.99%
Total runs:
555
Run Growth:
555
Growth Rate:
100.00%
Total runs:
535
Run Growth:
-3.3K
Growth Rate:
-619.07%
Total runs:
523
Run Growth:
24
Growth Rate:
4.59%
Total runs:
523
Run Growth:
-623
Growth Rate:
-119.12%
Total runs:
480
Run Growth:
-467
Growth Rate:
-97.29%
Total runs:
465
Run Growth:
-1.3K
Growth Rate:
-271.61%
Total runs:
430
Run Growth:
-1.4K
Growth Rate:
-320.70%
Total runs:
429
Run Growth:
-426
Growth Rate:
-99.30%
Total runs:
426
Run Growth:
410
Growth Rate:
96.24%
Total runs:
394
Run Growth:
-542
Growth Rate:
-137.56%
Total runs:
391
Run Growth:
-1.3K
Growth Rate:
-329.41%
Total runs:
379
Run Growth:
379
Growth Rate:
100.00%
Total runs:
357
Run Growth:
-1.4K
Growth Rate:
-405.88%
Total runs:
336
Run Growth:
336
Growth Rate:
100.00%
Total runs:
313
Run Growth:
-37
Growth Rate:
-11.82%
Total runs:
296
Run Growth:
-568
Growth Rate:
-191.89%
Total runs:
283
Run Growth:
-1.4K
Growth Rate:
-496.11%
Total runs:
281
Run Growth:
281
Growth Rate:
100.00%
Total runs:
273
Run Growth:
273
Growth Rate:
100.00%
Total runs:
272
Run Growth:
-141
Growth Rate:
-51.84%
Total runs:
269
Run Growth:
269
Growth Rate:
100.00%
Total runs:
257
Run Growth:
-843
Growth Rate:
-328.02%
Total runs:
245
Run Growth:
-1.1K
Growth Rate:
-433.88%
Total runs:
237
Run Growth:
-5.6K
Growth Rate:
-2350.63%
Total runs:
235
Run Growth:
170
Growth Rate:
72.34%
Total runs:
231
Run Growth:
-794
Growth Rate:
-343.72%
Total runs:
218
Run Growth:
218
Growth Rate:
100.00%
Total runs:
211
Run Growth:
-656
Growth Rate:
-310.90%
Total runs:
201
Run Growth:
-305
Growth Rate:
-151.74%
Total runs:
199
Run Growth:
-20
Growth Rate:
-10.05%
Total runs:
189
Run Growth:
189
Growth Rate:
100.00%
Total runs:
177
Run Growth:
-957
Growth Rate:
-540.68%
Total runs:
169
Run Growth:
-223
Growth Rate:
-131.95%
Total runs:
159
Run Growth:
-774
Growth Rate:
-486.79%
Total runs:
144
Run Growth:
-283
Growth Rate:
-196.53%
Total runs:
141
Run Growth:
-419
Growth Rate:
-297.16%
Total runs:
139
Run Growth:
-707
Growth Rate:
-508.63%
Total runs:
137
Run Growth:
-313
Growth Rate:
-228.47%
Total runs:
137
Run Growth:
-228
Growth Rate:
-166.42%
Total runs:
136
Run Growth:
-818
Growth Rate:
-601.47%
Total runs:
127
Run Growth:
-831
Growth Rate:
-654.33%
Total runs:
122
Run Growth:
-700
Growth Rate:
-573.77%
Total runs:
119
Run Growth:
-744
Growth Rate:
-625.21%
Total runs:
117
Run Growth:
117
Growth Rate:
100.00%
Total runs:
117
Run Growth:
104
Growth Rate:
88.89%
Total runs:
116
Run Growth:
-1.1K
Growth Rate:
-964.66%
Total runs:
114
Run Growth:
-894
Growth Rate:
-784.21%
Total runs:
107
Run Growth:
-253
Growth Rate:
-236.45%
Total runs:
106
Run Growth:
-423
Growth Rate:
-399.06%
Total runs:
94
Run Growth:
82
Growth Rate:
87.23%
Total runs:
91
Run Growth:
-440
Growth Rate:
-483.52%
Total runs:
78
Run Growth:
22
Growth Rate:
28.21%
Total runs:
62
Run Growth:
-19
Growth Rate:
-30.65%
Total runs:
55
Run Growth:
-26
Growth Rate:
-47.27%
Total runs:
48
Run Growth:
-6
Growth Rate:
-12.50%
Total runs:
48
Run Growth:
4
Growth Rate:
8.33%