Total runs:
342.1K
Run Growth:
260.0K
Growth Rate:
78.00%
Sponsored by
APIMart
AtomicChat / gemma-4-26B-A4B-it-MLX-4bit
Model's Last Updated: July 23 2026
text-generation
Introduction of gemma-4-26B-A4B-it-MLX-4bit
Model Details of gemma-4-26B-A4B-it-MLX-4bit
Gemma 4 26B A4B , self-quantized to MLX by Atomic Chat . Built straight from Google's original weights with a per-tensor importance matrix, so this is not a repack of somebody else's files. Runs fully offline.
Highlights
- 25.2B total / 3.8B active per token parameters : the weights this repo quantizes.
- Context length : 256K tokens, as published by Google.
- 30 layers : Mixture-of-Experts, hybrid sliding-window (1024) and global attention.
- Modalities : Text, Image.
- Full imatrix ladder : every quant is calibrated with an importance matrix.
- Reasoning : All models in the family are designed as highly capable reasoners, with configurable thinking modes.
- Diverse & Efficient Architectures : Offers Dense and Mixture-of-Experts (MoE) variants of different sizes for scalable deployment.
These MLXs are self-quantized from the original weights , not a repack. The importance matrix keeps low-bit quants closer to the full-precision model.
Model Overview
| Property | Value |
|---|---|
| Base model |
google/gemma-4-26B-A4B-it
|
| Parameters | 25.2B total / 3.8B active per token |
| Layers | 30 |
| Experts | 128 routed (top-8) |
| Sliding window | 1024 tokens |
| Context length | 256K tokens |
| Vocabulary | 262K |
| Modalities | Text, Image |
| Architecture |
Mixture-of-Experts, 128 experts (top-8), hybrid sliding-window (1024) and global attention, 16 attention heads over 8 KV heads,
Gemma4ForConditionalGeneration
|
| This repo | MLX weights |
Benchmarks
| Benchmark | Score |
|---|---|
| MMLU Pro | 82.6% |
| AIME 2026 no tools | 88.3% |
| LiveCodeBench v6 | 77.1% |
| Codeforces ELO | 1718 |
| GPQA Diamond | 82.3% |
| Tau2 (average over 3) | 68.2% |
| HLE no tools | 8.7% |
| HLE with search | 17.2% |
| BigBench Extra Hard | 64.8% |
| MMMLU | 86.3% |
| MMMU Pro | 73.8% |
| OmniDocBench 1.5 (average edit distance, lower is better) | 0.149 |
| MATH-Vision | 82.4% |
| MedXPertQA MM | 58.1% |
| MRCR v2 8 needle 128k (average) | 44.1% |
Scores are Google's published results for the base
google/gemma-4-26B-A4B-it
, not our own measurements. Quantization preserves the large majority of this;
Q4_K_M
and up stay close to full precision.
Get started
-
Atomic Chat
:
search
AtomicChat/gemma-4-26B-A4B-it-MLX-4bitand hit Use this model . -
mlx-lm:
mlx_lm.generate --model AtomicChat/gemma-4-26B-A4B-it-MLX-4bit --prompt "Hello" --max-tokens 512 -
Server:
mlx_lm.server --model AtomicChat/gemma-4-26B-A4B-it-MLX-4bit --port 8080
Best practices
| Parameter | Value |
|---|---|
| temperature | 1.0 |
| top_p | 0.95 |
| top_k | 64 |
Google's recommended sampling configuration for
google/gemma-4-26B-A4B-it
.
How these were made
-
Download
google/gemma-4-26B-A4B-it(original weights). -
Convert and quantize with
mlx_lm.converton our pipeline.
License
Original model by Google, released under the Apache 2.0 license. Full terms: Apache 2.0 . Quantized by Atomic Chat.
Runs of AtomicChat gemma-4-26B-A4B-it-MLX-4bit on huggingface.co
465
Total runs
-10
24-hour runs
-15
3-day runs
8
7-day runs
-530
30-day runs
More Information About gemma-4-26B-A4B-it-MLX-4bit huggingface.co Model
Url of gemma-4-26B-A4B-it-MLX-4bit
gemma-4-26B-A4B-it-MLX-4bit huggingface.co Url
Provider of gemma-4-26B-A4B-it-MLX-4bit huggingface.co
Other API from AtomicChat
Updated:August 09 2026
Total runs:
246.6K
Run Growth:
224.7K
Growth Rate:
86.33%
Total runs:
170.7K
Run Growth:
142.2K
Growth Rate:
100.00%
Total runs:
95.1K
Run Growth:
83.1K
Growth Rate:
90.10%
Total runs:
73.6K
Run Growth:
47.9K
Growth Rate:
65.57%
Total runs:
73.4K
Run Growth:
46.9K
Growth Rate:
64.40%
Total runs:
73.2K
Run Growth:
45.9K
Growth Rate:
63.30%
Total runs:
63.0K
Run Growth:
57.9K
Growth Rate:
94.97%
Total runs:
6.5K
Run Growth:
1.1K
Growth Rate:
17.87%
Total runs:
5.2K
Run Growth:
14
Growth Rate:
0.28%
Total runs:
4.4K
Run Growth:
-2.8K
Growth Rate:
-64.34%
Total runs:
4.2K
Run Growth:
-13.4K
Growth Rate:
-309.09%
Total runs:
4.1K
Run Growth:
-8.2K
Growth Rate:
-196.28%
Total runs:
3.7K
Run Growth:
-10.6K
Growth Rate:
-284.91%
Total runs:
3.7K
Run Growth:
-15.7K
Growth Rate:
-378.44%
Total runs:
3.6K
Run Growth:
-2.2K
Growth Rate:
-58.47%
Total runs:
3.0K
Run Growth:
-2.4K
Growth Rate:
-88.22%
Total runs:
2.9K
Run Growth:
629
Growth Rate:
21.50%
Total runs:
2.8K
Run Growth:
-730
Growth Rate:
-26.74%
Total runs:
2.4K
Run Growth:
-1.4K
Growth Rate:
-59.41%
Total runs:
2.2K
Run Growth:
-8.9K
Growth Rate:
-432.04%
Total runs:
2.1K
Run Growth:
369
Growth Rate:
18.16%
Total runs:
2.1K
Run Growth:
-13.6K
Growth Rate:
-623.58%
Total runs:
1.9K
Run Growth:
827
Growth Rate:
45.64%
Total runs:
1.9K
Run Growth:
-14.8K
Growth Rate:
-808.50%
Total runs:
1.7K
Run Growth:
657
Growth Rate:
37.65%
Total runs:
1.6K
Run Growth:
1.5K
Growth Rate:
100.00%
Total runs:
1.6K
Run Growth:
1.6K
Growth Rate:
100.00%
Total runs:
1.6K
Run Growth:
-563
Growth Rate:
-35.72%
Total runs:
1.6K
Run Growth:
708
Growth Rate:
44.84%
Total runs:
1.2K
Run Growth:
1.2K
Growth Rate:
100.00%
Total runs:
1.2K
Run Growth:
-1.9K
Growth Rate:
-158.26%
Total runs:
1.2K
Run Growth:
-99
Growth Rate:
-8.56%
Total runs:
1.0K
Run Growth:
-1.0K
Growth Rate:
-97.48%
Total runs:
1.0K
Run Growth:
1.0K
Growth Rate:
100.00%
Total runs:
1.0K
Run Growth:
1.0K
Growth Rate:
100.00%
Total runs:
1.0K
Run Growth:
1.0K
Growth Rate:
100.00%
Total runs:
735
Run Growth:
-102
Growth Rate:
-13.65%
Total runs:
631
Run Growth:
-3.6K
Growth Rate:
-554.97%
Total runs:
623
Run Growth:
-7.6K
Growth Rate:
-1226.13%
Total runs:
602
Run Growth:
602
Growth Rate:
100.00%
Total runs:
602
Run Growth:
-75
Growth Rate:
-12.91%
Total runs:
599
Run Growth:
-3.3K
Growth Rate:
-556.97%
Total runs:
585
Run Growth:
577
Growth Rate:
100.00%
Total runs:
565
Run Growth:
495
Growth Rate:
100.00%
Total runs:
554
Run Growth:
27
Growth Rate:
5.05%
Total runs:
534
Run Growth:
-290
Growth Rate:
-54.21%
Total runs:
502
Run Growth:
-1.3K
Growth Rate:
-299.32%
Total runs:
499
Run Growth:
135
Growth Rate:
28.30%
Total runs:
429
Run Growth:
-426
Growth Rate:
-99.30%
Total runs:
411
Run Growth:
408
Growth Rate:
100.00%
Total runs:
407
Run Growth:
-1.3K
Growth Rate:
-307.13%
Total runs:
405
Run Growth:
-1.4K
Growth Rate:
-339.80%
Total runs:
391
Run Growth:
-306
Growth Rate:
-78.87%
Total runs:
384
Run Growth:
353
Growth Rate:
90.98%
Total runs:
305
Run Growth:
240
Growth Rate:
78.69%
Total runs:
297
Run Growth:
294
Growth Rate:
100.00%
Total runs:
293
Run Growth:
290
Growth Rate:
100.00%
Total runs:
293
Run Growth:
-610
Growth Rate:
-206.08%
Total runs:
286
Run Growth:
281
Growth Rate:
100.00%
Total runs:
282
Run Growth:
-137
Growth Rate:
-47.57%
Total runs:
269
Run Growth:
-340
Growth Rate:
-126.39%
Total runs:
251
Run Growth:
-1.5K
Growth Rate:
-558.94%
Total runs:
245
Run Growth:
-561
Growth Rate:
-225.30%
Total runs:
233
Run Growth:
232
Growth Rate:
100.00%
Total runs:
225
Run Growth:
-1.6K
Growth Rate:
-766.18%
Total runs:
223
Run Growth:
-832
Growth Rate:
-364.91%
Total runs:
222
Run Growth:
-94
Growth Rate:
-48.45%
Total runs:
218
Run Growth:
-6.4K
Growth Rate:
-2937.33%
Total runs:
204
Run Growth:
201
Growth Rate:
100.00%
Total runs:
192
Run Growth:
-265
Growth Rate:
-156.80%
Total runs:
192
Run Growth:
-173
Growth Rate:
-91.05%
Total runs:
168
Run Growth:
-592
Growth Rate:
-293.07%
Total runs:
161
Run Growth:
-907
Growth Rate:
-546.39%
Total runs:
137
Run Growth:
-732
Growth Rate:
-534.31%
Total runs:
137
Run Growth:
-164
Growth Rate:
-116.31%
Total runs:
135
Run Growth:
-380
Growth Rate:
-271.43%
Total runs:
135
Run Growth:
-284
Growth Rate:
-218.46%
Total runs:
126
Run Growth:
-857
Growth Rate:
-649.24%
Total runs:
120
Run Growth:
-500
Growth Rate:
-393.70%
Total runs:
117
Run Growth:
117
Growth Rate:
100.00%
Total runs:
117
Run Growth:
104
Growth Rate:
88.89%
Total runs:
110
Run Growth:
-733
Growth Rate:
-621.19%
Total runs:
107
Run Growth:
-219
Growth Rate:
-200.92%
Total runs:
106
Run Growth:
-780
Growth Rate:
-690.27%
Total runs:
106
Run Growth:
-885
Growth Rate:
-790.18%
Total runs:
104
Run Growth:
-1.0K
Growth Rate:
-922.73%
Total runs:
102
Run Growth:
-390
Growth Rate:
-375.00%
Total runs:
96
Run Growth:
-1.2K
Growth Rate:
-1189.90%
Total runs:
94
Run Growth:
82
Growth Rate:
87.23%
Total runs:
84
Run Growth:
-417
Growth Rate:
-479.31%
Total runs:
79
Run Growth:
-932
Growth Rate:
-991.49%
Total runs:
65
Run Growth:
-5
Growth Rate:
-7.35%
Total runs:
64
Run Growth:
-31
Growth Rate:
-51.67%
Total runs:
57
Run Growth:
-35
Growth Rate:
-66.04%
Total runs:
47
Run Growth:
-1
Growth Rate:
-2.13%
Total runs:
45
Run Growth:
-11
Growth Rate:
-23.91%