Total runs:
24.5K
Run Growth:
491
Growth Rate:
2.01%
Sponsored by
APIMart
arcee-ai / Trinity-Mini-Base-Pre-Anneal
Model's Last Updated: May 29 2026
text-generation
Introduction of Trinity-Mini-Base-Pre-Anneal
Model Details of Trinity-Mini-Base-Pre-Anneal
Trinity Mini Base Pre Anneal
Trinity-Mini-Base-Pre-Anneal is an Arcee AI 26B MoE model with 3B active parameters. It is the medium-sized model in our new Trinity family, a series of open-weight models for enterprise and tinkerers alike.
This base model is a pre-anneal checkpoint captured at Adam LR: 0.002, Muon LR: 0.001 before starting learning rate decay on a high-quality data mix. While this checkpoint was not exposed to the anneal phase mix containing high proportions of math and code content, it has been trained on significant amounts of such data. This checkpoint is not suitable for chatting or general use without further finetuning and should be trained for your specific domain before use.
Trinity-Mini-Base-Pre-Anneal is trained on 8.8T tokens gathered and curated through a key partnership with Datology , building upon the excellent dataset we used on AFM-4.5B with additional math and code.
Training was performed on a cluster of 512 H200 GPUs powered by Prime Intellect using HSDP parallelism.
More details, including key architecture decisions, can be found on our blog here
Model Details
- Model Architecture: AfmoeForCausalLM
- Parameters: 26B, 3B active
- Experts: 128 total, 8 active, 1 shared
- Context length: 4K
-
Learning rate during pretraining
:
-
adam_lr = 0.0002 -
muon_lr = 0.001
-
- Training Tokens: 8.8T
- License: Apache 2.0
Try out our reasoning tune
Trinity Mini is available today on openrouter:
https://openrouter.ai/arcee-ai/trinity-mini
curl -X POST "https://openrouter.ai/v1/chat/completions" \
-H "Authorization: Bearer $OPENROUTER_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "arcee-ai/trinity-mini",
"messages": [
{
"role": "user",
"content": "What are some fun things to do in New York?"
}
]
}'
License
Trinity-Mini-Base-Pre-Anneal is released under the Apache-2.0 license.
Runs of arcee-ai Trinity-Mini-Base-Pre-Anneal on huggingface.co
258
Total runs
0
24-hour runs
17
3-day runs
23
7-day runs
23
30-day runs
More Information About Trinity-Mini-Base-Pre-Anneal huggingface.co Model
Url of Trinity-Mini-Base-Pre-Anneal
Trinity-Mini-Base-Pre-Anneal huggingface.co Url
Provider of Trinity-Mini-Base-Pre-Anneal huggingface.co
Other API from arcee-ai
Updated:May 29 2026
Total runs:
10.0K
Run Growth:
9.3K
Growth Rate:
92.47%
Total runs:
4.2K
Run Growth:
-6.3K
Growth Rate:
-147.69%
Total runs:
4.0K
Run Growth:
-11.3K
Growth Rate:
-278.17%
Total runs:
1.8K
Run Growth:
1.5K
Growth Rate:
82.87%
Total runs:
1.7K
Run Growth:
-860
Growth Rate:
-49.60%
Total runs:
1.5K
Run Growth:
1.5K
Growth Rate:
98.63%
Total runs:
1.5K
Run Growth:
520
Growth Rate:
34.51%
Total runs:
1.2K
Run Growth:
-106
Growth Rate:
-8.55%
Total runs:
1.1K
Run Growth:
347
Growth Rate:
31.66%
Total runs:
1.1K
Run Growth:
881
Growth Rate:
81.57%
Total runs:
1.1K
Run Growth:
57
Growth Rate:
5.42%
Total runs:
1.0K
Run Growth:
-1.8K
Growth Rate:
-174.58%
Total runs:
850
Run Growth:
0
Growth Rate:
0.00%
Total runs:
850
Run Growth:
-813
Growth Rate:
-95.65%
Total runs:
766
Run Growth:
-6.3K
Growth Rate:
-820.89%
Total runs:
643
Run Growth:
474
Growth Rate:
73.72%
Total runs:
626
Run Growth:
-868
Growth Rate:
-138.66%
Total runs:
614
Run Growth:
-4.4K
Growth Rate:
-715.15%
Total runs:
528
Run Growth:
-163
Growth Rate:
-30.87%
Total runs:
505
Run Growth:
201
Growth Rate:
39.80%
Total runs:
503
Run Growth:
382
Growth Rate:
75.94%
Total runs:
486
Run Growth:
119
Growth Rate:
24.49%
Total runs:
448
Run Growth:
107
Growth Rate:
23.88%
Total runs:
408
Run Growth:
0
Growth Rate:
0.00%
Total runs:
351
Run Growth:
351
Growth Rate:
100.00%
Total runs:
281
Run Growth:
0
Growth Rate:
0.00%
Total runs:
256
Run Growth:
235
Growth Rate:
91.80%
Total runs:
243
Run Growth:
-1.7K
Growth Rate:
-680.25%
Total runs:
242
Run Growth:
196
Growth Rate:
80.99%
Total runs:
228
Run Growth:
-796
Growth Rate:
-349.12%
Total runs:
183
Run Growth:
135
Growth Rate:
73.77%
Total runs:
178
Run Growth:
103
Growth Rate:
58.52%
Total runs:
177
Run Growth:
98
Growth Rate:
55.37%
Total runs:
170
Run Growth:
-48
Growth Rate:
-28.24%
Total runs:
158
Run Growth:
-1
Growth Rate:
-0.63%
Total runs:
148
Run Growth:
-99
Growth Rate:
-66.89%
Total runs:
141
Run Growth:
106
Growth Rate:
75.18%
Total runs:
129
Run Growth:
72
Growth Rate:
55.81%
Total runs:
120
Run Growth:
11
Growth Rate:
9.17%
Total runs:
115
Run Growth:
51
Growth Rate:
44.35%
Total runs:
104
Run Growth:
81
Growth Rate:
77.88%
Total runs:
98
Run Growth:
83
Growth Rate:
85.57%
Total runs:
98
Run Growth:
86
Growth Rate:
87.76%
Total runs:
97
Run Growth:
87
Growth Rate:
89.69%
Total runs:
96
Run Growth:
75
Growth Rate:
79.79%
Total runs:
93
Run Growth:
35
Growth Rate:
37.63%
Total runs:
92
Run Growth:
33
Growth Rate:
35.87%
Total runs:
91
Run Growth:
77
Growth Rate:
85.56%
Total runs:
91
Run Growth:
78
Growth Rate:
86.67%
Total runs:
91
Run Growth:
70
Growth Rate:
76.92%
Total runs:
91
Run Growth:
76
Growth Rate:
84.44%
Total runs:
91
Run Growth:
77
Growth Rate:
85.56%
Total runs:
91
Run Growth:
70
Growth Rate:
76.92%
Total runs:
91
Run Growth:
79
Growth Rate:
86.81%
Total runs:
90
Run Growth:
68
Growth Rate:
73.91%
Total runs:
89
Run Growth:
70
Growth Rate:
78.65%
Total runs:
88
Run Growth:
80
Growth Rate:
91.95%
Total runs:
88
Run Growth:
80
Growth Rate:
90.91%
Total runs:
88
Run Growth:
77
Growth Rate:
87.50%
Total runs:
88
Run Growth:
79
Growth Rate:
89.77%
Total runs:
87
Run Growth:
75
Growth Rate:
86.21%
Total runs:
86
Run Growth:
75
Growth Rate:
87.21%
Total runs:
86
Run Growth:
65
Growth Rate:
75.58%
Total runs:
86
Run Growth:
65
Growth Rate:
75.58%
Total runs:
86
Run Growth:
71
Growth Rate:
82.56%
Total runs:
86
Run Growth:
78
Growth Rate:
90.70%
Total runs:
85
Run Growth:
66
Growth Rate:
77.65%
Total runs:
85
Run Growth:
73
Growth Rate:
85.88%
Total runs:
85
Run Growth:
73
Growth Rate:
85.88%
Total runs:
85
Run Growth:
69
Growth Rate:
82.14%
Total runs:
85
Run Growth:
74
Growth Rate:
87.06%