Total runs:
669.3K
Run Growth:
31.3K
Growth Rate:
4.67%
Sponsored by
APIMart
FINAL-Bench / POCKET-KR-GGUF
Model's Last Updated: September 25 2026
text-generation
Introduction of POCKET-KR-GGUF
Model Details of POCKET-KR-GGUF
๐ Collections
โถ POCKET Models โ this family (on-device, no GPU) Darwin Family ยท Aether Foundation ยท VKAE Accelerated ยท Metacognition Adapters
POCKET-KR-GGUF ยท ํ๊ตญ์ด
35B์์ ํ๊ตญ์ด ์ ๋ฌธ๊ฐ๋ง ๊ณจ๋ผ๋ธ ํฐ์ฉ ๋น๋. Android 8 GB+์์ GPU ์์ด ๋๋๋ค. iPhone์ POCKET-KR-MLX ๋ฅผ ๋ฐ์ผ์ธ์.
๐ Try it live, no install โ
โ a 35B model answering on a CPU-only box.
Pick your build โ
-0f6e56){kind=icon}
The POCKET lineup โ pick by your device
| Repo | File | Size | Runs on | Best for | Korean PPL* |
|---|---|---|---|---|---|
| POCKET-35B-GGUF |
Q4_K_M
|
21 GB | PC / server (32 GB RAM) | top quality | 5.79 |
| POCKET-35B-GGUF |
Q2_K
โญ
|
13 GB | mini-PC, no GPU | daily driver | 6.49 |
| POCKET-35B-GGUF |
IQ1_M
|
8.2 GB | 16 GB RAM box | smallest full model | 9.69 |
| POCKET-KR-GGUF |
IQ2_M
|
5.1 GB | Android 8 GB+ | ๐ฐ๐ท Korean phone | 7.95 |
| POCKET-KR-MLX | 2-bit | 5.1 GB | ๐ iPhone / iPad / Mac | ๐ฐ๐ท Korean, Apple-native | 7.95 |
| POCKET-EN-GGUF |
iPhone-mix
|
5.3 GB | ๐ iPhone (PocketPal) | ๐ English phone | โ |
| POCKET-EN-GGUF |
PC-mix
|
6.8 GB | PC / Android | ๐ English, best quality | โ |
*Wikipedia-Korean perplexity, lower is better.
Q4_K_M
= 5.79 baseline. English builds are tuned on English; see each repo.
๐ Why MLX for Korean but GGUF for English on iPhone? Apple-native MLX only does uniform quantization. Korean survives it (96 experts hold up); English needs our mixed-precision trick, which only GGUF supports โ so the English iPhone build ships as a GGUF you run with PocketPal . Honest, not lazy.
Benchmarks โ what is measured, what is not
We measure Bonsai on the same machine with the same stock
llama.cpp
, and we tell you where we lose.
[measured]
Generation speed โ POCKET wins on both CPU and GPU:
| POCKET-35B IQ1_M | Bonsai-27B Q1_0 | ||
|---|---|---|---|
| CPU generate (Xeon, 16t) | 27.0 tok/s | 10.1 | ๐ข 2.69ร |
| GPU generate (H100) | 197 tok/s | 89 | ๐ข 2.22ร |
| GPU prompt (H100) | 753 | 1816 | ๐ด 0.41ร |
| Quality (HellaSwag, 400q) | 61.0% | 60.0% | โช tie (CI overlaps) |
[measured on a MacBook M3 Pro, 18 GB]
โ and on a laptop, POCKET wins
every
axis, including prompt processing:
| POCKET-35B IQ1_M | Bonsai-27B Q1_0 | ||
|---|---|---|---|
| Metal generate (tg64) | 25.4 tok/s | 12.8 | ๐ข 1.99ร |
| CPU generate (8 threads) | 13.8 tok/s | 4.4 | ๐ข 3.13ร |
| Metal prompt (pp128) | 240.7 tok/s | 73.4 | ๐ข 3.28ร |
| CPU prompt (pp128) | 45.5 tok/s | 9.6 | ๐ข 4.75ร |
On a laptop GPU the arithmetic headroom that let Bonsai win prefill on an H100 is gone, so MoE sparsity wins across the board.
POCKET-35B-Q2_K
runs on the M3 Pro's CPU at
19.5 tok/s
โ on an 18 GB Mac, run Q2_K on CPU (
-ngl 0
); its 13 GB exceeds the recommended Metal budget.
[pending โ community reports welcome]
on-device
iPhone
and
Strix Halo
throughput. We publish only what we ran ourselves; help us fill the rest.
The same-size rival
Ternary-Bonsai-27B-Q2_0(7.2 GB) fails to load in upstream llama.cpp โ it needs the PrismML fork. POCKET runs on the tools you already have.
Files in this repo
| File | Size | Experts | Runs on | Korean PPL |
|---|---|---|---|---|
POCKET-KR-IQ2_M.gguf
โญ
|
5.1 GB | 96 | Android 8 GB+ | 7.95 |
POCKET-KR-160-Q2_K.gguf
|
8.5 GB | 160 | phone/PC | 6.88 (quality-first) |
POCKET-KR-160-Q3_K_M.gguf
|
11 GB | 160 | PC | 6.35 |
Pruned from 256 experts to the ones Korean actually uses (94% routing coverage at 128). Active params unchanged โ same speed, half the size.
Quickstart
llama-cli -m POCKET-KR-IQ2_M.gguf -p "๋ํ๋ฏผ๊ตญ์ ์๋๋" -ngl 0 -t 8
On Android: PocketPal โ import GGUF.
Lineage โ where POCKET comes from
POCKET is quantized from Darwin-36B-Opus , VIDRAFT's flagship โ a model bred and evolved over several generations on the Darwin platform (crossbreeding, healing, expert surgery). Darwin-36B-Opus itself traces back to a Qwen3.5-family MoE architecture.
| Component | Origin |
|---|---|
| Starting checkpoint | Darwin-36B-Opus โ VIDRAFT, multi-generation Darwin evolution |
| Base architecture | Qwen3.5-family MoE (256 experts, top-8), unchanged |
Quantization (
Q4_K_M
โฆ
IQ1_M
)
|
stock llama.cpp โ no custom format |
| Runtime | upstream llama.cpp / Apple MLX โ unmodified |
| Expert pruning + domain imatrix (KR/EN builds) | ours (VIDRAFT) |
The CPU/GPU speed comes from the sparse-MoE architecture plus ordinary quantization โ reproducible with the same base and the same tools. What we add is the Darwin-evolved weights, the honest measurement, the Korean tuning, and the pruning that makes the 5 GB phone builds.
Limitations
- The iPhone/Mac speed is not yet measured by us โ community reports welcome.
-
Extreme quants (
IQ1_M) hurt Korean ~2.8ร more than English; useQ2_Kor larger for quality. -
English phone builds trade quality for size; the PC build (
PC-mix) is much closer to full quality.
License
Apache-2.0.
POCKET is a VIDRAFT model family. 35B, in your pocket. No GPU.
Runs of FINAL-Bench POCKET-KR-GGUF on huggingface.co
995
Total runs
7
24-hour runs
8
3-day runs
477
7-day runs
808
30-day runs
More Information About POCKET-KR-GGUF huggingface.co Model
Url of POCKET-KR-GGUF
POCKET-KR-GGUF huggingface.co Url
Provider of POCKET-KR-GGUF huggingface.co
Other API from FINAL-Bench
Updated:September 25 2026
Total runs:
296.2K
Run Growth:
13.2K
Growth Rate:
4.45%
Total runs:
2.4K
Run Growth:
2.4K
Growth Rate:
100.00%
Total runs:
1.4K
Run Growth:
1.3K
Growth Rate:
97.65%
Total runs:
1.0K
Run Growth:
-5
Growth Rate:
-0.48%
Total runs:
963
Run Growth:
-17
Growth Rate:
-1.77%
Total runs:
912
Run Growth:
497
Growth Rate:
54.50%
Total runs:
806
Run Growth:
535
Growth Rate:
66.38%
Total runs:
804
Run Growth:
804
Growth Rate:
100.00%
Total runs:
905
Run Growth:
434
Growth Rate:
59.78%
Total runs:
546
Run Growth:
-23.3K
Growth Rate:
-4275.46%
Total runs:
491
Run Growth:
322
Growth Rate:
65.58%
Total runs:
452
Run Growth:
446
Growth Rate:
98.67%
Total runs:
432
Run Growth:
432
Growth Rate:
100.00%
Total runs:
414
Run Growth:
414
Growth Rate:
100.00%
Total runs:
401
Run Growth:
239
Growth Rate:
59.60%
Total runs:
385
Run Growth:
49
Growth Rate:
12.73%
Total runs:
366
Run Growth:
137
Growth Rate:
37.43%
Total runs:
346
Run Growth:
260
Growth Rate:
75.14%
Total runs:
329
Run Growth:
258
Growth Rate:
78.42%
Total runs:
296
Run Growth:
43
Growth Rate:
14.93%
Total runs:
263
Run Growth:
219
Growth Rate:
89.75%
Total runs:
251
Run Growth:
251
Growth Rate:
100.00%
Total runs:
236
Run Growth:
1
Growth Rate:
0.42%
Total runs:
198
Run Growth:
-99
Growth Rate:
-50.00%
Total runs:
198
Run Growth:
-29
Growth Rate:
-14.65%
Total runs:
163
Run Growth:
163
Growth Rate:
100.00%
Total runs:
162
Run Growth:
89
Growth Rate:
54.94%
Total runs:
127
Run Growth:
114
Growth Rate:
89.76%
Total runs:
90
Run Growth:
48
Growth Rate:
53.33%
Total runs:
72
Run Growth:
-180
Growth Rate:
-250.00%
Total runs:
63
Run Growth:
37
Growth Rate:
58.73%
Total runs:
61
Run Growth:
61
Growth Rate:
100.00%
Total runs:
60
Run Growth:
60
Growth Rate:
100.00%
Total runs:
60
Run Growth:
17
Growth Rate:
28.33%
Total runs:
52
Run Growth:
52
Growth Rate:
100.00%
Total runs:
52
Run Growth:
52
Growth Rate:
100.00%
Total runs:
51
Run Growth:
51
Growth Rate:
100.00%
Total runs:
50
Run Growth:
50
Growth Rate:
100.00%
Total runs:
48
Run Growth:
48
Growth Rate:
100.00%
Total runs:
47
Run Growth:
-143
Growth Rate:
-304.26%
Total runs:
47
Run Growth:
16
Growth Rate:
34.04%
Total runs:
46
Run Growth:
46
Growth Rate:
100.00%
Total runs:
46
Run Growth:
46
Growth Rate:
100.00%
Total runs:
43
Run Growth:
43
Growth Rate:
100.00%
Total runs:
40
Run Growth:
40
Growth Rate:
100.00%
Total runs:
31
Run Growth:
22
Growth Rate:
70.97%
Total runs:
21
Run Growth:
7
Growth Rate:
33.33%
Total runs:
13
Run Growth:
6
Growth Rate:
46.15%
Total runs:
3
Run Growth:
3
Growth Rate:
100.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%