Total runs:
533.2K
Run Growth:
-258.0K
Growth Rate:
-48.38%
Sponsored by
APIMart
FINAL-Bench / Darwin-27B-ZTC-v2
Model's Last Updated: October 09 2026
text-classification
Introduction of Darwin-27B-ZTC-v2
Model Details of Darwin-27B-ZTC-v2
Darwin-27B-ZTC-v2
-7c3aed?style=for-the-badge){kind=icon}
A zero-token decision engine from the Darwin family, second version.
Darwin-27B-ZTC-v2 reads a piece of state and a typed question (
noul
yes or no,
choice
one of N labels,
score
an ordered rubric) and returns a probability for every option. It uses one forward pass per question and generates no tokens.
v2 adds control and workflow decisions (games, drones, retrieval control, entity alignment, customer and incident workflows) on top of FINAL-Bench/Darwin-27B-ZTC .
Results
S1MB (System One Mosaic Benchmark), english-v1: #1
#1 on the
S1MB leaderboard
under both of its rankings: the default
Borda score
and
Task Avg
. All 137 benchmarks complete, measured with the S1MB evaluator and its
autojev
adapter at revision
a8f283a
, then validated and merged by the S1MB maintainer (
results
).
The numbers below follow the leaderboard's own code (
viewer/src/lib/borda.ts
,
types.ts
) applied to the published results file of 2026-10-09 02:44 UTC, over the 102 models with complete results.
- Borda score (default sort): rank the models on every benchmark, give 100 points to first place and 0 to last, and average over the 137 benchmarks.
- Task Avg : mean baseline-adjusted score (0 to 100) within each task, then the mean of Noul, Choice and Score.
| Rank | Model | Borda score | Task Avg | Noul (59) | Choice (57) | Score (21) |
|---|---|---|---|---|---|---|
| 1 | Darwin-27B-ZTC-v2 | 89.58 | 66.46 | 67.66 | 71.51 | 60.21 |
| 2 | openjev/openjev | 87.50 | 62.60 | 65.22 | 67.74 | 54.83 |
| 3 | denis-pplx/AutoJev-27B | 87.07 | 60.80 | 64.96 | 68.11 | 49.34 |
| 4 | caiovicentino1/Eikos-27B | 85.43 | 59.86 | 64.14 | 67.61 | 47.83 |
| 5 | TypeSafe Jev 1.13 | 85.05 | 59.59 | 64.63 | 67.22 | 46.92 |
qasper-noul-test-v1
was run with
--context-limit 32768
(12 of its decisions exceed the default 8192 tokens; nothing is truncated), recorded in the result metadata.
Training overlap (disclosed).
v2 was trained on the
train
split of
ZefanCai/Open-Jev
(CC0). S1MB includes 22 benchmarks built from the
test
split of the same Open-Jev tasks. We used no S1MB test case: an exact-match filter over every S1MB test state, query and document removed zero training rows. v2 was not trained on any S1MB data or on Typed Decisions data.
How it was made
- Start from Darwin-27B-ZTC (v1).
-
Continue full-weight training on the Open-Jev
trainsplit mixed with v1's original training data, selecting the checkpoint on held-out development rows only. - Average the weights of v1 and the continued model (50/50). The average keeps v1's skills on its original tasks and adds the new control and workflow skills.
Files and usage
The layout is the same as v1: backbone weights (BF16, about 54 GB),
readout.safetensors
,
decision_config.json
, tokenizer, and the inference code in
autojev/
(from
autojev
, MIT, with text-only backbone support added).
-
ztc_server.py: aPOST /v1/systemoneserver (ZTC_MODEL=<path> PORT=8000 python ztc_server.py). -
ztc_engine.py: an in-process engine for the Decision Index kit.
import sys
from huggingface_hub import snapshot_download
path = snapshot_download("FINAL-Bench/Darwin-27B-ZTC-v2")
sys.path.insert(0, path)
from autojev.model import DecisionModel
model = DecisionModel(checkpoint=path)
row = {"state": {"ticket": "Charged twice for one order."},
"question": {"type": "choice", "instructions": "What should support do?",
"criteria": {"refund": "Refund the duplicate charge.", "escalate": "Send to billing.", "close": "No action."}}}
print(model.predict([row])[0])
Citation
@misc{darwin27bztcv2,
title = {Darwin-27B-ZTC-v2: a zero-token decision engine},
author = {VIDRAFT and FINAL-Bench},
year = {2026},
url = {https://huggingface.co/FINAL-Bench/Darwin-27B-ZTC-v2}
}
Runs of FINAL-Bench Darwin-27B-ZTC-v2 on huggingface.co
117
Total runs
0
24-hour runs
10
3-day runs
38
7-day runs
117
30-day runs
More Information About Darwin-27B-ZTC-v2 huggingface.co Model
Url of Darwin-27B-ZTC-v2
Darwin-27B-ZTC-v2 huggingface.co Url
Provider of Darwin-27B-ZTC-v2 huggingface.co
Other API from FINAL-Bench
Updated:September 25 2026
Total runs:
271.4K
Run Growth:
-61.7K
Growth Rate:
-22.74%
Total runs:
90.5K
Run Growth:
90.5K
Growth Rate:
100.00%
Total runs:
5.8K
Run Growth:
4.2K
Growth Rate:
98.33%
Total runs:
3.7K
Run Growth:
1.2K
Growth Rate:
100.00%
Total runs:
2.5K
Run Growth:
2.5K
Growth Rate:
100.00%
Total runs:
2.2K
Run Growth:
1.9K
Growth Rate:
86.96%
Total runs:
2.1K
Run Growth:
2.1K
Growth Rate:
100.00%
Total runs:
1.5K
Run Growth:
1.5K
Growth Rate:
100.00%
Total runs:
1.5K
Run Growth:
1.4K
Growth Rate:
97.81%
Total runs:
1.1K
Run Growth:
1.1K
Growth Rate:
100.00%
Total runs:
995
Run Growth:
605
Growth Rate:
60.80%
Total runs:
988
Run Growth:
-61
Growth Rate:
-6.17%
Total runs:
912
Run Growth:
497
Growth Rate:
54.50%
Total runs:
806
Run Growth:
535
Growth Rate:
66.38%
Total runs:
600
Run Growth:
-122
Growth Rate:
-20.33%
Total runs:
522
Run Growth:
505
Growth Rate:
100.00%
Total runs:
491
Run Growth:
322
Growth Rate:
65.58%
Total runs:
471
Run Growth:
465
Growth Rate:
98.73%
Total runs:
432
Run Growth:
432
Growth Rate:
100.00%
Total runs:
417
Run Growth:
385
Growth Rate:
94.59%
Total runs:
401
Run Growth:
239
Growth Rate:
59.60%
Total runs:
385
Run Growth:
49
Growth Rate:
12.73%
Total runs:
358
Run Growth:
285
Growth Rate:
100.00%
Total runs:
346
Run Growth:
260
Growth Rate:
75.14%
Total runs:
305
Run Growth:
60
Growth Rate:
19.67%
Total runs:
254
Run Growth:
-37
Growth Rate:
-14.62%
Total runs:
251
Run Growth:
-99
Growth Rate:
-40.08%
Total runs:
234
Run Growth:
53
Growth Rate:
22.94%
Total runs:
191
Run Growth:
191
Growth Rate:
100.00%
Total runs:
165
Run Growth:
-38
Growth Rate:
-23.03%
Total runs:
162
Run Growth:
89
Growth Rate:
54.94%
Total runs:
156
Run Growth:
77
Growth Rate:
49.36%
Total runs:
155
Run Growth:
-72
Growth Rate:
-46.45%
Total runs:
153
Run Growth:
-82
Growth Rate:
-53.59%
Total runs:
127
Run Growth:
114
Growth Rate:
89.76%
Total runs:
111
Run Growth:
48
Growth Rate:
47.52%
Total runs:
109
Run Growth:
35
Growth Rate:
32.11%
Total runs:
102
Run Growth:
85
Growth Rate:
83.33%
Total runs:
72
Run Growth:
-180
Growth Rate:
-250.00%
Total runs:
63
Run Growth:
37
Growth Rate:
58.73%
Total runs:
61
Run Growth:
61
Growth Rate:
100.00%
Total runs:
60
Run Growth:
60
Growth Rate:
100.00%
Total runs:
60
Run Growth:
17
Growth Rate:
28.33%
Total runs:
52
Run Growth:
52
Growth Rate:
100.00%
Total runs:
52
Run Growth:
52
Growth Rate:
100.00%
Total runs:
51
Run Growth:
51
Growth Rate:
100.00%
Total runs:
50
Run Growth:
50
Growth Rate:
100.00%
Total runs:
48
Run Growth:
48
Growth Rate:
100.00%
Total runs:
47
Run Growth:
16
Growth Rate:
34.04%
Total runs:
46
Run Growth:
46
Growth Rate:
100.00%
Total runs:
46
Run Growth:
46
Growth Rate:
100.00%
Total runs:
43
Run Growth:
43
Growth Rate:
100.00%
Total runs:
40
Run Growth:
40
Growth Rate:
100.00%
Total runs:
31
Run Growth:
22
Growth Rate:
70.97%
Total runs:
13
Run Growth:
6
Growth Rate:
46.15%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%