Total runs:
318.4K
Run Growth:
237.2K
Growth Rate:
77.24%
Sponsored by
YouArt
AtomicChat / gemma-4-12B-it-MLX-8bit
Model's Last Updated: July 23 2026
text-generation
Introduction of gemma-4-12B-it-MLX-8bit
Model Details of gemma-4-12B-it-MLX-8bit
Gemma 4 12B , self-quantized to MLX by Atomic Chat . Built straight from Google's original weights with a per-tensor importance matrix, so this is not a repack of somebody else's files. Runs fully offline.
Highlights
- 11.95B parameters : the weights this repo quantizes.
- Context length : 256K tokens, as published by Google.
- 48 layers : Dense decoder, hybrid sliding-window (1024) and global attention.
- Modalities : Text, Image, Audio.
- Full imatrix ladder : every quant is calibrated with an importance matrix.
- Reasoning : All models in the family are designed as highly capable reasoners, with configurable thinking modes.
- Diverse & Efficient Architectures : Offers Dense and Mixture-of-Experts (MoE) variants of different sizes for scalable deployment.
These MLXs are self-quantized from the original weights , not a repack. The importance matrix keeps low-bit quants closer to the full-precision model.
Model Overview
| Property | Value |
|---|---|
| Base model |
google/gemma-4-12B-it
|
| Parameters | 11.95B |
| Layers | 48 |
| Sliding window | 1024 tokens |
| Context length | 256K tokens |
| Vocabulary | 262K |
| Modalities | Text, Image, Audio |
| Architecture |
Dense decoder, hybrid sliding-window (1024) and global attention, 16 attention heads over 8 KV heads,
Gemma4UnifiedForConditionalGeneration
|
| This repo | MLX weights |
Benchmarks
| Benchmark | Score |
|---|---|
| MMLU Pro | 77.2% |
| AIME 2026 no tools | 77.5% |
| LiveCodeBench v6 | 72.0% |
| Codeforces ELO | 1659 |
| GPQA Diamond | 78.8% |
| Tau2 (average over 3) | 69.0% |
| HLE no tools | 5.2% |
| BigBench Extra Hard | 53.0% |
| MMMLU | 83.4% |
| MMMU Pro | 69.1% |
| OmniDocBench 1.5 (average edit distance, lower is better) | 0.164 |
| MATH-Vision | 79.7% |
| MedXPertQA MM | 48.7% |
| CoVoST | 38.5 |
| FLEURS (lower is better) | 0.069 |
| MRCR v2 8 needle 128k (average) | 43.4% |
Scores are Google's published results for the base
google/gemma-4-12B-it
, not our own measurements. Quantization preserves the large majority of this;
Q4_K_M
and up stay close to full precision.
Get started
-
Atomic Chat
:
search
AtomicChat/gemma-4-12B-it-MLX-8bitand hit Use this model . -
mlx-lm:
mlx_lm.generate --model AtomicChat/gemma-4-12B-it-MLX-8bit --prompt "Hello" --max-tokens 512 -
Server:
mlx_lm.server --model AtomicChat/gemma-4-12B-it-MLX-8bit --port 8080
Best practices
| Parameter | Value |
|---|---|
| temperature | 1.0 |
| top_p | 0.95 |
| top_k | 64 |
Google's recommended sampling configuration for
google/gemma-4-12B-it
.
How these were made
-
Download
google/gemma-4-12B-it(original weights). -
Convert and quantize with
mlx_lm.converton our pipeline.
License
Original model by Google, released under the Apache 2.0 license. Full terms: Apache 2.0 . Quantized by Atomic Chat.
Runs of AtomicChat gemma-4-12B-it-MLX-8bit on huggingface.co
128
Total runs
-11
24-hour runs
-49
3-day runs
-76
7-day runs
-774
30-day runs
More Information About gemma-4-12B-it-MLX-8bit huggingface.co Model
Url of gemma-4-12B-it-MLX-8bit
gemma-4-12B-it-MLX-8bit huggingface.co Url
Provider of gemma-4-12B-it-MLX-8bit huggingface.co
Other API from AtomicChat
Updated:August 09 2026
Total runs:
307.4K
Run Growth:
277.1K
Growth Rate:
88.62%
Total runs:
89.5K
Run Growth:
79.8K
Growth Rate:
89.74%
Total runs:
89.2K
Run Growth:
59.8K
Growth Rate:
100.00%
Total runs:
72.9K
Run Growth:
56.8K
Growth Rate:
78.00%
Total runs:
72.7K
Run Growth:
53.1K
Growth Rate:
72.78%
Total runs:
72.4K
Run Growth:
54.3K
Growth Rate:
74.94%
Total runs:
60.1K
Run Growth:
56.4K
Growth Rate:
94.84%
Total runs:
7.5K
Run Growth:
-1.3K
Growth Rate:
-16.64%
Total runs:
5.9K
Run Growth:
113
Growth Rate:
2.03%
Total runs:
5.3K
Run Growth:
5.4K
Growth Rate:
71.79%
Total runs:
4.6K
Run Growth:
-1.9K
Growth Rate:
-41.02%
Total runs:
4.6K
Run Growth:
-14.0K
Growth Rate:
-280.59%
Total runs:
4.5K
Run Growth:
-12.8K
Growth Rate:
-279.45%
Total runs:
4.4K
Run Growth:
-9.7K
Growth Rate:
-219.28%
Total runs:
3.6K
Run Growth:
-2.8K
Growth Rate:
-83.75%
Total runs:
2.7K
Run Growth:
436
Growth Rate:
17.07%
Total runs:
2.7K
Run Growth:
-1.3K
Growth Rate:
-53.05%
Total runs:
2.5K
Run Growth:
-2.8K
Growth Rate:
-126.64%
Total runs:
2.3K
Run Growth:
-1.4K
Growth Rate:
-61.26%
Total runs:
2.3K
Run Growth:
-11.8K
Growth Rate:
-511.13%
Total runs:
2.0K
Run Growth:
-9.4K
Growth Rate:
-478.02%
Total runs:
2.0K
Run Growth:
295
Growth Rate:
14.55%
Total runs:
1.9K
Run Growth:
960
Growth Rate:
55.81%
Total runs:
1.9K
Run Growth:
-15.0K
Growth Rate:
-850.62%
Total runs:
1.7K
Run Growth:
657
Growth Rate:
37.65%
Total runs:
1.6K
Run Growth:
616
Growth Rate:
38.02%
Total runs:
1.6K
Run Growth:
1.6K
Growth Rate:
100.00%
Total runs:
1.6K
Run Growth:
-594
Growth Rate:
-39.49%
Total runs:
1.3K
Run Growth:
-2.1K
Growth Rate:
-163.80%
Total runs:
1.3K
Run Growth:
1.1K
Growth Rate:
100.00%
Total runs:
1.2K
Run Growth:
1.2K
Growth Rate:
100.00%
Total runs:
1.0K
Run Growth:
1.0K
Growth Rate:
100.00%
Total runs:
988
Run Growth:
976
Growth Rate:
100.00%
Total runs:
982
Run Growth:
964
Growth Rate:
100.00%
Total runs:
952
Run Growth:
-324
Growth Rate:
-34.69%
Total runs:
770
Run Growth:
-288
Growth Rate:
-37.02%
Total runs:
715
Run Growth:
-945
Growth Rate:
-109.00%
Total runs:
680
Run Growth:
-3.6K
Growth Rate:
-547.71%
Total runs:
606
Run Growth:
-7.7K
Growth Rate:
-1249.03%
Total runs:
602
Run Growth:
602
Growth Rate:
100.00%
Total runs:
569
Run Growth:
-45
Growth Rate:
-7.99%
Total runs:
562
Run Growth:
555
Growth Rate:
100.00%
Total runs:
530
Run Growth:
24
Growth Rate:
4.59%
Total runs:
529
Run Growth:
-623
Growth Rate:
-119.12%
Total runs:
526
Run Growth:
-3.3K
Growth Rate:
-619.07%
Total runs:
476
Run Growth:
-467
Growth Rate:
-97.29%
Total runs:
457
Run Growth:
-1.3K
Growth Rate:
-271.61%
Total runs:
429
Run Growth:
-426
Growth Rate:
-99.30%
Total runs:
420
Run Growth:
410
Growth Rate:
96.24%
Total runs:
414
Run Growth:
-1.4K
Growth Rate:
-320.70%
Total runs:
397
Run Growth:
-542
Growth Rate:
-137.56%
Total runs:
390
Run Growth:
379
Growth Rate:
100.00%
Total runs:
378
Run Growth:
-1.4K
Growth Rate:
-405.88%
Total runs:
372
Run Growth:
-1.3K
Growth Rate:
-329.41%
Total runs:
365
Run Growth:
336
Growth Rate:
100.00%
Total runs:
363
Run Growth:
-37
Growth Rate:
-11.82%
Total runs:
291
Run Growth:
-568
Growth Rate:
-191.89%
Total runs:
283
Run Growth:
281
Growth Rate:
100.00%
Total runs:
282
Run Growth:
-1.4K
Growth Rate:
-496.11%
Total runs:
277
Run Growth:
273
Growth Rate:
100.00%
Total runs:
271
Run Growth:
269
Growth Rate:
100.00%
Total runs:
259
Run Growth:
-843
Growth Rate:
-328.02%
Total runs:
256
Run Growth:
-141
Growth Rate:
-51.84%
Total runs:
251
Run Growth:
170
Growth Rate:
72.34%
Total runs:
235
Run Growth:
-5.6K
Growth Rate:
-2350.63%
Total runs:
224
Run Growth:
-794
Growth Rate:
-343.72%
Total runs:
221
Run Growth:
218
Growth Rate:
100.00%
Total runs:
211
Run Growth:
-656
Growth Rate:
-310.90%
Total runs:
206
Run Growth:
-1.1K
Growth Rate:
-433.88%
Total runs:
198
Run Growth:
-305
Growth Rate:
-151.74%
Total runs:
194
Run Growth:
-20
Growth Rate:
-10.05%
Total runs:
193
Run Growth:
189
Growth Rate:
100.00%
Total runs:
172
Run Growth:
-223
Growth Rate:
-131.95%
Total runs:
161
Run Growth:
-957
Growth Rate:
-540.68%
Total runs:
140
Run Growth:
-419
Growth Rate:
-297.16%
Total runs:
137
Run Growth:
-818
Growth Rate:
-601.47%
Total runs:
132
Run Growth:
-313
Growth Rate:
-228.47%
Total runs:
131
Run Growth:
-707
Growth Rate:
-508.63%
Total runs:
128
Run Growth:
-283
Growth Rate:
-196.53%
Total runs:
124
Run Growth:
-228
Growth Rate:
-166.42%
Total runs:
117
Run Growth:
117
Growth Rate:
100.00%
Total runs:
117
Run Growth:
-831
Growth Rate:
-654.33%
Total runs:
117
Run Growth:
104
Growth Rate:
88.89%
Total runs:
116
Run Growth:
-700
Growth Rate:
-573.77%
Total runs:
112
Run Growth:
-744
Growth Rate:
-625.21%
Total runs:
112
Run Growth:
-894
Growth Rate:
-784.21%
Total runs:
111
Run Growth:
-975
Growth Rate:
-833.33%
Total runs:
108
Run Growth:
-423
Growth Rate:
-399.06%
Total runs:
106
Run Growth:
-253
Growth Rate:
-236.45%
Total runs:
105
Run Growth:
-1.1K
Growth Rate:
-964.66%
Total runs:
94
Run Growth:
82
Growth Rate:
87.23%
Total runs:
92
Run Growth:
-440
Growth Rate:
-483.52%
Total runs:
75
Run Growth:
22
Growth Rate:
28.21%
Total runs:
58
Run Growth:
-19
Growth Rate:
-30.65%
Total runs:
51
Run Growth:
-26
Growth Rate:
-47.27%
Total runs:
45
Run Growth:
-6
Growth Rate:
-12.50%
Total runs:
45
Run Growth:
4
Growth Rate:
8.33%