Total runs:
1.1M
Run Growth:
362.8K
Growth Rate:
34.09%
Sponsored by
YouArt
allenai / tmax-27b
Model's Last Updated: June 23 2026
Introduction of tmax-27b
Model Details of tmax-27b
💻 Code · 🤗 Models & Data · 📜 Paper · 📓 Blog
For full information, go check out the Tmax paper here .
TMax 27B
TMax 27B is a model trained using DPPO on top of Qwen 3.6 27B for use as a terminal-agent. It achieves roughly 43% on Terminal Bench 2.0 after 160 steps of RL training.
This model is part of a collection of terminal agents in various sizes.
Additionally, we provide model checkpoints as branches of the repository. The main model checkpoint is step 160 as this performed best on TBLite. For this model only, we upload checkpoints at step 100, 160, 200, 240, 300 steps.
Evaluation Results
| Model | TB Lite | TB 2.1 | TB 2.0 (daytona) |
|---|---|---|---|
| Qwen 3.5 2B | 5.71 +/- 1.6 | 1.9 +/- 1.4 | 2.3 +/- 1.0 |
| Tmax 2B | 11.8 +/- 1.4 | 4.2 +/- 1.2 | 2.9 +/- 0.6 |
| Qwen 3.5 4B | 31.8 +/- 3.8 | ? | 16.6 +/- 1.7 |
| Tmax 4B | 42.6 +/- 1.5 | 19.9 +/- 1.1 | 18.9 +/- 1.9 |
| Qwen 3.5 9B | 41.9 +/- 2.7 | 16.1 +/- 3.7 | 21.1 +/- 2.6 |
| Tmax 9B (this model!) | 57.2 +/- 2.5 | 28.8 +/- 3.7 | 27.2 +/- 1.5 |
| Qwen 3.6 27B | 70.8 +/- 2.1 | 40.5 +/- 2.4 | 39.6 +/- 2.1 |
| Tmax 27B | 68.6 +/- 4.7 | 44.9 +/- 1.8 | 42.7 +/- 0.7 |
For details on evaluation methodology please check our paper. In general, we used a podman (docker) backend with default timeouts and custom harness similar to mini-swe-agent. For the 'daytona' runs, we used the daytona backend. For Lite/2.1, we show mean and standard error over 3 runs. For daytona, we show it over 5 runs.
Model Details
Model Description
- Developed by: Ai2
- Language(s) (NLP): English
- License: Apache 2.0
- Finetuned from model [optional]: Qwen 3.5 9B
- Dataset: TMax-15k
Use
To use this model, we recommend serving with vllm (or your inference framework of choice) with:
uvx vllm==0.19.1 serve allenai/tmax-27b \
--served-model-name tmax-27b \
--enable-auto-tool-choice \
--tool-call-parser qwen3_xml \
--port 8008 \
--max-model-len 65536 \
--tensor-parallel-size 8 \
--language_model_only
Make sure to set
language_model_only
as we removed the vision head during training.
For more details on evaluation, please see our codebase .
Hyperparameters
This model was trained using DPPO with the following hyperparameters:
- base model : hamishivi/Qwen3.6-27B
- Dataset : tmax 15K
- Max prompt tokens : 2048
- Max per-turn tokens : 16384
- Max overall tokens : 65536
- Pack length : 67584
- Per-device train batch size : 1
- Unique prompts per rollout : 8
- Samples per prompt rollout : 32
- Async steps : 4
- Max steps : 64
- Learning rate : 1e-6
- LR scheduler : constant
- Total training steps : 500 steps (this checkpoint is from 200 steps of training, which performed best on TBLite)
- Sampling Temperature : 1.0
- KL Beta : 0.0
- Loss fn : DPPO
- Divergence : binary TV
- TV threshold : 0.1
- Advantage normalization : centered (no division by stdev)
- FP32 LM head : true
For more details on training, please see our codebase .
License
This model is licensed under Apache 2.0. It is intended for research and educational use in accordance with Ai2's Responsible Use Guidelines .
Citation
If you use our model or data, please cite our paper:
@misc{ivison2026tmax,
title={{TMAX}: A Simple Recipe for Terminal Agents},
author={Ivison, Hamish and Yin, Junjie Oscar and Shao, Rulin and Xiao, Teng and Lambert, Nathan and Hajishirzi, Hannaneh},
year={2026},
}
Runs of allenai tmax-27b on huggingface.co
3.0K
Total runs
0
24-hour runs
264
3-day runs
2.1K
7-day runs
3.0K
30-day runs
More Information About tmax-27b huggingface.co Model
Url of tmax-27b
tmax-27b huggingface.co Url
Provider of tmax-27b huggingface.co
Other API from allenai
Updated:December 04 2024
Total runs:
1.0M
Run Growth:
96.2K
Growth Rate:
9.42%
Total runs:
744.5K
Run Growth:
276.8K
Growth Rate:
37.18%
Total runs:
615.1K
Run Growth:
-21.4K
Growth Rate:
-3.48%
Total runs:
303.3K
Run Growth:
126.0K
Growth Rate:
41.55%
Total runs:
295.1K
Run Growth:
-342.5K
Growth Rate:
-116.09%
Total runs:
263.3K
Run Growth:
-204.9K
Growth Rate:
-77.80%
Total runs:
218.2K
Run Growth:
-11.6K
Growth Rate:
-5.35%
Total runs:
157.9K
Run Growth:
38.5K
Growth Rate:
24.40%
Total runs:
136.2K
Run Growth:
-2.6K
Growth Rate:
-1.93%
Total runs:
122.9K
Run Growth:
-59.4K
Growth Rate:
-48.52%
Total runs:
114.5K
Run Growth:
-141.3K
Growth Rate:
-123.42%
Total runs:
87.2K
Run Growth:
38.3K
Growth Rate:
43.92%
Total runs:
65.9K
Run Growth:
-1.1K
Growth Rate:
-1.61%
Total runs:
65.6K
Run Growth:
-10.7K
Growth Rate:
-16.33%
Total runs:
60.7K
Run Growth:
22.7K
Growth Rate:
35.48%
Total runs:
43.6K
Run Growth:
13.3K
Growth Rate:
30.43%
Total runs:
43.6K
Run Growth:
-5.6K
Growth Rate:
-12.93%
Total runs:
41.7K
Run Growth:
2.2K
Growth Rate:
5.33%
Total runs:
26.8K
Run Growth:
21.5K
Growth Rate:
80.42%
Total runs:
26.6K
Run Growth:
2.7K
Growth Rate:
10.63%
Total runs:
24.8K
Run Growth:
-998
Growth Rate:
-3.99%
Total runs:
21.9K
Run Growth:
-431
Growth Rate:
-1.97%
Total runs:
19.5K
Run Growth:
-2.9K
Growth Rate:
-14.75%
Total runs:
19.0K
Run Growth:
-11.3K
Growth Rate:
-58.76%
Total runs:
15.1K
Run Growth:
1.7K
Growth Rate:
11.12%
Total runs:
14.2K
Run Growth:
-1.9K
Growth Rate:
-13.07%
Total runs:
13.4K
Run Growth:
-43.9K
Growth Rate:
-373.95%
Total runs:
13.0K
Run Growth:
-3.7K
Growth Rate:
-28.82%
Total runs:
12.7K
Run Growth:
12.6K
Growth Rate:
99.79%
Total runs:
12.5K
Run Growth:
10.6K
Growth Rate:
84.94%
Total runs:
12.5K
Run Growth:
-5.5K
Growth Rate:
-43.86%
Total runs:
9.5K
Run Growth:
4.4K
Growth Rate:
46.24%
Total runs:
9.3K
Run Growth:
-2.9K
Growth Rate:
-31.23%
Total runs:
9.0K
Run Growth:
-843
Growth Rate:
-9.27%
Total runs:
8.6K
Run Growth:
-4.0K
Growth Rate:
-46.57%
Total runs:
8.2K
Run Growth:
-15.5K
Growth Rate:
-189.12%
Total runs:
8.0K
Run Growth:
1.2K
Growth Rate:
14.92%
Total runs:
7.4K
Run Growth:
-710
Growth Rate:
-9.54%
Total runs:
7.0K
Run Growth:
6.0K
Growth Rate:
87.86%
Total runs:
6.0K
Run Growth:
-333
Growth Rate:
-5.54%
Total runs:
5.3K
Run Growth:
-1.6K
Growth Rate:
-30.22%
Total runs:
5.1K
Run Growth:
-22.0K
Growth Rate:
-416.40%
Total runs:
5.0K
Run Growth:
257
Growth Rate:
5.12%
Total runs:
4.6K
Run Growth:
1.1K
Growth Rate:
23.14%
Total runs:
4.2K
Run Growth:
3.9K
Growth Rate:
93.23%
Total runs:
4.1K
Run Growth:
1.5K
Growth Rate:
37.45%
Total runs:
4.0K
Run Growth:
1.8K
Growth Rate:
44.39%
Total runs:
4.0K
Run Growth:
-354
Growth Rate:
-8.93%
Total runs:
3.4K
Run Growth:
2.5K
Growth Rate:
66.75%
Total runs:
3.0K
Run Growth:
-7.4K
Growth Rate:
-256.75%
Total runs:
2.7K
Run Growth:
6
Growth Rate:
0.21%
Total runs:
2.7K
Run Growth:
-2.4K
Growth Rate:
-90.00%
Total runs:
2.5K
Run Growth:
-654
Growth Rate:
-27.48%
Total runs:
2.4K
Run Growth:
-263
Growth Rate:
-10.60%
Total runs:
2.4K
Run Growth:
2.5K
Growth Rate:
96.12%
Total runs:
2.3K
Run Growth:
1.7K
Growth Rate:
73.17%
Total runs:
2.2K
Run Growth:
760
Growth Rate:
34.48%
Total runs:
2.2K
Run Growth:
943
Growth Rate:
43.34%
Total runs:
2.1K
Run Growth:
1.9K
Growth Rate:
91.58%
Total runs:
2.1K
Run Growth:
1.3K
Growth Rate:
63.85%
Total runs:
2.0K
Run Growth:
-2.4K
Growth Rate:
-119.11%
Total runs:
2.0K
Run Growth:
-616
Growth Rate:
-31.11%
Total runs:
1.9K
Run Growth:
430
Growth Rate:
23.72%
Total runs:
1.8K
Run Growth:
-3.0K
Growth Rate:
-166.76%
Total runs:
1.7K
Run Growth:
1.5K
Growth Rate:
83.81%
Total runs:
1.7K
Run Growth:
509
Growth Rate:
29.75%
Total runs:
1.7K
Run Growth:
-4.8K
Growth Rate:
-288.55%
Total runs:
1.6K
Run Growth:
466
Growth Rate:
28.64%
Total runs:
1.5K
Run Growth:
-1.4K
Growth Rate:
-93.45%
Total runs:
1.5K
Run Growth:
785
Growth Rate:
51.61%
Total runs:
1.5K
Run Growth:
1.5K
Growth Rate:
99.20%
Total runs:
1.5K
Run Growth:
-404
Growth Rate:
-28.39%
Total runs:
1.5K
Run Growth:
1.3K
Growth Rate:
89.69%
Total runs:
1.4K
Run Growth:
-1.4K
Growth Rate:
-95.23%
Total runs:
1.3K
Run Growth:
-1.5K
Growth Rate:
-118.32%
Total runs:
1.2K
Run Growth:
810
Growth Rate:
66.83%