Total runs:
1.5K
Run Growth:
-784
Growth Rate:
-65.01%
Sponsored by
Agentkit
DJLougen / Qwable-5-27B-Coder-GGUF
Model's Last Updated: June 23 2026
text-generation
Introduction of Qwable-5-27B-Coder-GGUF
Model Details of Qwable-5-27B-Coder-GGUF
Qwable-5-27B-Coder (GGUF)
Qwable-5-27B-Coder is a Qwen3.6-based coder-agent tune trained first on Claude Fable 5 traces , then continued on Kimi 2.7 Coder traces . It is built for the messy part of coding work: reading a repo, planning a patch, using terminal feedback, fixing the miss, and carrying constraints through long turns.
This repository hosts the GGUF builds for llama.cpp / Ollama / local workstation inference. The MTP head is embedded (
blk.64.nextn.*,nextn_predict_layers=1) for speculative decoding, and a vision mmproj is included for multimodal use.
Early maintainer runs show Qwable outperforming the base model on a private coder benchmark. Public scores, harness settings, and task definitions will be added when the evaluation packet is ready.
Training, quantization, and coder-agent evaluation are expensive. If Qwable helps your work, support continued releases at ko-fi.com/djlougen .
Release channels
| Repo | Format | Use it when |
|---|---|---|
DJLougen/Qwable-5-27B-Coder
|
BF16 Transformers safetensors | You want the source checkpoint, further training, conversion, or quality-ceiling evaluation. |
DJLougen/Qwable-5-27B-Coder-GGUF
|
GGUF | You want llama.cpp, Ollama, or local workstation inference. |
DJLougen/Qwable-5-27B-Coder-NVFP4
|
ModelOpt NVFP4 safetensors | You want a compact NVIDIA-serving checkpoint for supported vLLM / TensorRT-LLM stacks. |
GGUF files
All quants embed the MTP head and were converted from the BF16 checkpoint.
IQ1_S
is built with an importance matrix (the MTP block is kept at Q6_K so it stays usable).
| File | Bits | Size | Notes |
|---|---|---|---|
Qwable-5-27B-Coder-Q8_0.gguf
|
8.50 bpw | ~29 GB | Highest fidelity GGUF. |
Qwable-5-27B-Coder-Q6_K.gguf
|
6.56 bpw | ~22 GB | Near-lossless, smaller. |
Qwable-5-27B-Coder-Q4_K_M.gguf
|
4.92 bpw | ~17 GB | Balanced default for most GPUs. |
Qwable-5-27B-Coder-IQ1_S.gguf
|
~2.1 bpw | ~7 GB | Smallest; imatrix-quantized, lowest fidelity. |
mmproj-Qwable-5-27B-Coder-f16.gguf
|
f16 | ~0.9 GB | Vision projector (pair with any text quant). |
chat_template.jinja
|
- | - | Chat template. |
Requires a llama.cpp build with
qwen3_5
architecture support (MTP/
nextn
aware).
Quickstart (llama.cpp)
Download a single quant:
hf download DJLougen/Qwable-5-27B-Coder-GGUF \
Qwable-5-27B-Coder-Q4_K_M.gguf --local-dir .
Plain text inference:
llama-server -m Qwable-5-27B-Coder-Q4_K_M.gguf -ngl 99 -c 8192 --jinja
MTP speculative decoding (uses the embedded MTP head as the draft; shared weights):
llama-server \
-m Qwable-5-27B-Coder-Q8_0.gguf \
-md Qwable-5-27B-Coder-Q8_0.gguf \
--spec-type draft-mtp \
-ngl 99 -ngld 99 -c 8192 --jinja
Multimodal (add the vision projector):
llama-mtmd-cli \
-m Qwable-5-27B-Coder-Q4_K_M.gguf \
--mmproj mmproj-Qwable-5-27B-Coder-f16.gguf \
-ngl 99
Trace stack
unsloth/Qwen3.6-27B
-> Claude Fable 5 coder-agent traces
-> Kimi 2.7 Coder traces
-> Qwable-5-27B-Coder
-> GGUF (this repo)
The release is aimed at agentic coding behavior, not benchmark-demo prose. The training signal is trace-shaped: inspect, decide, edit, verify, recover.
| Attribute | Details |
|---|---|
| Base |
unsloth/Qwen3.6-27B
|
| Source checkpoint |
DJLougen/Qwable-5-27B-Coder
|
| Architecture tag |
qwen3_5
|
| Release format | GGUF (llama.cpp) |
| MTP |
Embedded (
nextn_predict_layers=1
), usable via
--spec-type draft-mtp
|
| Vision |
mmproj-*-f16.gguf
included
|
| Pipeline |
image-text-to-text
|
| Primary use | coding agents, repository work, terminal workflows, tool-use-style chat |
| License | Apache-2.0 |
What Qwable is tuned to do
- Navigate real repositories instead of isolated snippets.
- Translate failing command output into the next useful patch.
- Keep constraints alive across multi-step coding tasks.
- Produce tool-friendly, implementation-oriented answers.
- Handle long engineering prompts with logs, diffs, stack traces, and partial failures.
- Bias toward concrete edits, commands, and verification over generic advice.
Prompting profile
Qwable works best when the prompt looks like an actual coding task, not a riddle.
Good inputs include the relevant files, exact failing command output, hard constraints, expected output format, tool boundaries, and a verifier command or acceptance test when available.
Suggested system prompt:
You are Qwable, a precise coding agent. Inspect before editing. Prefer minimal, correct patches. Preserve existing conventions. Verify behavior with the narrowest meaningful test before finalizing.
The current
generation_config.json
uses
temperature=1.0
,
top_p=0.95
, and
top_k=20
.
Evaluation status
Current public status: early maintainer testing only. The maintainer has observed wins over the base model on a private coder benchmark, but reproducible claims require the full packet: benchmark name, split, prompt format, tool schema, harness commit, sampling settings, pass/fail rules, and raw results.
Vision and multimodal note
The repository is configured as
image-text-to-text
, and the base model family supports image/video tokens through the Qwen vision stack via the included
mmproj
. This fine-tune is marketed for coding behavior. Do not assume it improves vision understanding unless you evaluate that separately.
Limitations
- Public benchmark scores are not published yet.
- The model may inherit failure modes from the base model and from the trace sources.
- Long-context behavior depends on runtime implementation, hardware, KV cache settings, and prompt structure.
- Tool-use quality depends on prompt format and schema consistency.
-
Low-bit quants (especially
IQ1_S) trade quality for size; preferQ4_K_Mor higher for real work. - The card does not claim safety alignment beyond the base model and fine-tuning data.
License
Released under Apache-2.0, following the upstream base model license metadata.
Runs of DJLougen Qwable-5-27B-Coder-GGUF on huggingface.co
421
Total runs
27
24-hour runs
10
3-day runs
58
7-day runs
-2.9K
30-day runs
More Information About Qwable-5-27B-Coder-GGUF huggingface.co Model
Url of Qwable-5-27B-Coder-GGUF
Qwable-5-27B-Coder-GGUF huggingface.co Url
Provider of Qwable-5-27B-Coder-GGUF huggingface.co
Other API from DJLougen
Updated:April 04 2026
Total runs:
1.4K
Run Growth:
-3.4K
Growth Rate:
-234.70%
Total runs:
577
Run Growth:
8
Growth Rate:
1.39%
Total runs:
549
Run Growth:
-495
Growth Rate:
-90.16%
Total runs:
512
Run Growth:
-2.1K
Growth Rate:
-404.69%
Total runs:
471
Run Growth:
-341
Growth Rate:
-72.40%
Total runs:
242
Run Growth:
-6.4K
Growth Rate:
-2660.33%
Total runs:
228
Run Growth:
-634
Growth Rate:
-278.07%
Total runs:
205
Run Growth:
27
Growth Rate:
13.17%
Total runs:
186
Run Growth:
-3.0K
Growth Rate:
-1627.42%
Total runs:
179
Run Growth:
-1.7K
Growth Rate:
-975.98%
Total runs:
179
Run Growth:
-232
Growth Rate:
-129.61%
Total runs:
170
Run Growth:
106
Growth Rate:
62.35%
Total runs:
154
Run Growth:
-2.1K
Growth Rate:
-1349.35%
Total runs:
144
Run Growth:
-290
Growth Rate:
-201.39%
Total runs:
141
Run Growth:
-1.7K
Growth Rate:
-1226.95%
Total runs:
129
Run Growth:
-3.2K
Growth Rate:
-2482.17%
Total runs:
125
Run Growth:
-170
Growth Rate:
-136.00%
Total runs:
122
Run Growth:
-984
Growth Rate:
-806.56%
Total runs:
119
Run Growth:
-1.3K
Growth Rate:
-1058.82%
Total runs:
111
Run Growth:
-254
Growth Rate:
-228.83%
Total runs:
111
Run Growth:
-797
Growth Rate:
-718.02%
Total runs:
106
Run Growth:
-930
Growth Rate:
-877.36%
Total runs:
96
Run Growth:
-303
Growth Rate:
-315.63%
Total runs:
93
Run Growth:
64
Growth Rate:
68.82%
Total runs:
92
Run Growth:
-1.3K
Growth Rate:
-1421.74%
Total runs:
91
Run Growth:
24
Growth Rate:
26.37%
Total runs:
89
Run Growth:
89
Growth Rate:
100.00%
Total runs:
83
Run Growth:
36
Growth Rate:
43.37%
Total runs:
75
Run Growth:
-123
Growth Rate:
-164.00%
Total runs:
72
Run Growth:
-192
Growth Rate:
-266.67%
Total runs:
63
Run Growth:
-169
Growth Rate:
-268.25%
Total runs:
59
Run Growth:
-960
Growth Rate:
-1627.12%
Total runs:
56
Run Growth:
-368
Growth Rate:
-657.14%
Total runs:
55
Run Growth:
-45
Growth Rate:
-81.82%
Total runs:
55
Run Growth:
-14
Growth Rate:
-25.45%
Total runs:
54
Run Growth:
54
Growth Rate:
100.00%
Total runs:
53
Run Growth:
-811
Growth Rate:
-1530.19%
Total runs:
49
Run Growth:
49
Growth Rate:
100.00%
Total runs:
48
Run Growth:
38
Growth Rate:
79.17%
Total runs:
47
Run Growth:
-492
Growth Rate:
-1046.81%
Total runs:
43
Run Growth:
-445
Growth Rate:
-1034.88%
Total runs:
37
Run Growth:
-389
Growth Rate:
-1051.35%
Total runs:
32
Run Growth:
32
Growth Rate:
100.00%
Total runs:
30
Run Growth:
-201
Growth Rate:
-670.00%
Total runs:
28
Run Growth:
-28
Growth Rate:
-100.00%
Total runs:
28
Run Growth:
-45
Growth Rate:
-160.71%
Total runs:
25
Run Growth:
-7
Growth Rate:
-28.00%
Total runs:
23
Run Growth:
-81
Growth Rate:
-352.17%
Total runs:
22
Run Growth:
-6
Growth Rate:
-27.27%
Total runs:
21
Run Growth:
-201
Growth Rate:
-957.14%
Total runs:
21
Run Growth:
-3
Growth Rate:
-14.29%
Total runs:
20
Run Growth:
-21
Growth Rate:
-105.00%
Total runs:
18
Run Growth:
-6
Growth Rate:
-33.33%
Total runs:
18
Run Growth:
-517
Growth Rate:
-2872.22%
Total runs:
18
Run Growth:
-135
Growth Rate:
-750.00%
Total runs:
12
Run Growth:
4
Growth Rate:
33.33%
Total runs:
12
Run Growth:
-10
Growth Rate:
-83.33%
Total runs:
11
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
-28
Growth Rate:
-350.00%
Total runs:
5
Run Growth:
-138
Growth Rate:
-2760.00%
Total runs:
3
Run Growth:
-1
Growth Rate:
-33.33%
Total runs:
2
Run Growth:
-84
Growth Rate:
-4200.00%
Total runs:
1
Run Growth:
-105
Growth Rate:
-10500.00%
Total runs:
1
Run Growth:
-3
Growth Rate:
-300.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%