Sponsored by
Vmake Labs Video Enhancer
arcee-ai / Trinity-Mini-GGUF
Model's Last Updated: May 29 2026
text-generation
Introduction of Trinity-Mini-GGUF
Model Details of Trinity-Mini-GGUF
Trinity Mini GGUF
Trinity Mini is an Arcee AI 26B MoE model with 3B active parameters. It is the medium-sized model in our new Trinity family, a series of open-weight models for enterprise and tinkerers alike.
This model is tuned for reasoning, but in testing, it uses a similar total token count to competitive instruction-tuned models.
These are the GGUF files for running on llama.cpp powered platforms
Trinity Mini is trained on 10T tokens gathered and curated through a key partnership with Datology , building upon the excellent dataset we used on AFM-4.5B with additional math and code.
Training was performed on a cluster of 512 H200 GPUs powered by Prime Intellect using HSDP parallelism.
More details, including key architecture decisions, can be found on our blog here
Try it out now at chat.arcee.ai
Model Details
- Model Architecture: AfmoeForCausalLM
- Parameters: 26B, 3B active
- Experts: 128 total, 8 active, 1 shared
- Context length: 128k
- Training Tokens: 10T
- License: Apache 2.0
-
Recommended settings:
- temperature: 0.15
- top_k: 50
- top_p: 0.75
- min_p: 0.06
Benchmarks
Running our model
llama.cpp
Supported in llama.cpp release b7061
Download the latest llama.cpp release
llama-server -hf arcee-ai/Trinity-Mini-GGUF:q4_k_m \
--temp 0.15 \
--top-k 50 \
--top-p 0.75
--min-p 0.06
LM Studio
Supported in latest LM Studio runtime
Update to latest available, then verify your runtime by:
- Click "Power User" at the bottom left
- Click the green "Developer" icon at the top left
- Select "LM Runtimes" at the top
- Refresh the list of runtimes and verify that the latest is installed
Then, go to Model Search and search for
arcee-ai/Trinity-Mini-GGUF
, download your prefered size, and load it up in the chat
API
Trinity Mini is available today on openrouter:
https://openrouter.ai/arcee-ai/trinity-mini
curl -X POST "https://openrouter.ai/v1/chat/completions" \
-H "Authorization: Bearer $OPENROUTER_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "arcee-ai/trinity-mini",
"messages": [
{
"role": "user",
"content": "What are some fun things to do in New York?"
}
]
}'
License
Trinity-Mini is released under the Apache-2.0 license.
Runs of arcee-ai Trinity-Mini-GGUF on huggingface.co
1.2K
Total runs
0
24-hour runs
-3
3-day runs
-102
7-day runs
-106
30-day runs
More Information About Trinity-Mini-GGUF huggingface.co Model
Url of Trinity-Mini-GGUF
Trinity-Mini-GGUF huggingface.co Url
Provider of Trinity-Mini-GGUF huggingface.co
Other API from arcee-ai
Total runs:
14.3K
Run Growth:
14.2K
Growth Rate:
99.11%
Total runs:
5.6K
Run Growth:
-752
Growth Rate:
-13.47%
Total runs:
3.5K
Run Growth:
-757
Growth Rate:
-21.63%
Total runs:
2.5K
Run Growth:
1.2K
Growth Rate:
48.53%
Total runs:
2.3K
Run Growth:
-925
Growth Rate:
-39.70%
Total runs:
1.9K
Run Growth:
1.1K
Growth Rate:
55.61%
Total runs:
1.8K
Run Growth:
1.5K
Growth Rate:
82.87%
Total runs:
1.7K
Run Growth:
-860
Growth Rate:
-49.60%
Total runs:
1.7K
Run Growth:
-3.2K
Growth Rate:
-191.35%
Total runs:
1.7K
Run Growth:
1.0K
Growth Rate:
63.04%
Total runs:
1.5K
Run Growth:
-221
Growth Rate:
-14.38%
Total runs:
1.5K
Run Growth:
1.5K
Growth Rate:
98.63%
Total runs:
1.4K
Run Growth:
-188
Growth Rate:
-13.04%
Total runs:
1.1K
Run Growth:
-302
Growth Rate:
-27.23%
Total runs:
1.1K
Run Growth:
240
Growth Rate:
22.02%
Total runs:
1.0K
Run Growth:
-6
Growth Rate:
-0.58%
Total runs:
1.0K
Run Growth:
-1.8K
Growth Rate:
-174.58%
Total runs:
1.0K
Run Growth:
633
Growth Rate:
62.36%
Total runs:
904
Run Growth:
-298
Growth Rate:
-32.96%
Total runs:
874
Run Growth:
-132
Growth Rate:
-15.10%
Total runs:
850
Run Growth:
0
Growth Rate:
0.00%
Total runs:
766
Run Growth:
-6.3K
Growth Rate:
-820.89%
Total runs:
673
Run Growth:
406
Growth Rate:
60.33%
Total runs:
614
Run Growth:
-4.4K
Growth Rate:
-715.15%
Total runs:
607
Run Growth:
231
Growth Rate:
38.06%
Total runs:
590
Run Growth:
-13
Growth Rate:
-2.20%
Total runs:
589
Run Growth:
-847
Growth Rate:
-143.80%
Total runs:
505
Run Growth:
201
Growth Rate:
39.80%
Total runs:
483
Run Growth:
169
Growth Rate:
34.99%
Total runs:
448
Run Growth:
107
Growth Rate:
23.88%
Total runs:
410
Run Growth:
175
Growth Rate:
42.68%
Total runs:
408
Run Growth:
0
Growth Rate:
0.00%
Total runs:
371
Run Growth:
-460
Growth Rate:
-123.99%
Total runs:
351
Run Growth:
351
Growth Rate:
100.00%
Total runs:
283
Run Growth:
179
Growth Rate:
63.25%
Total runs:
281
Run Growth:
0
Growth Rate:
0.00%
Total runs:
281
Run Growth:
125
Growth Rate:
44.48%
Total runs:
243
Run Growth:
-1.7K
Growth Rate:
-680.25%
Total runs:
225
Run Growth:
-143
Growth Rate:
-63.56%
Total runs:
216
Run Growth:
-40
Growth Rate:
-18.52%
Total runs:
183
Run Growth:
65
Growth Rate:
35.52%
Total runs:
163
Run Growth:
73
Growth Rate:
44.79%
Total runs:
158
Run Growth:
-1
Growth Rate:
-0.63%
Total runs:
148
Run Growth:
-99
Growth Rate:
-66.89%
Total runs:
143
Run Growth:
-37
Growth Rate:
-25.87%
Total runs:
138
Run Growth:
8
Growth Rate:
5.80%
Total runs:
136
Run Growth:
12
Growth Rate:
8.82%
Total runs:
139
Run Growth:
-41
Growth Rate:
-30.15%
Total runs:
134
Run Growth:
53
Growth Rate:
39.55%
Total runs:
121
Run Growth:
38
Growth Rate:
31.40%
Total runs:
118
Run Growth:
20
Growth Rate:
16.95%
Total runs:
117
Run Growth:
30
Growth Rate:
25.64%
Total runs:
116
Run Growth:
10
Growth Rate:
8.62%
Total runs:
108
Run Growth:
16
Growth Rate:
14.81%
Total runs:
108
Run Growth:
21
Growth Rate:
19.44%
Total runs:
107
Run Growth:
19
Growth Rate:
17.76%
Total runs:
107
Run Growth:
30
Growth Rate:
28.04%
Total runs:
107
Run Growth:
8
Growth Rate:
7.48%
Total runs:
107
Run Growth:
10
Growth Rate:
9.35%
Total runs:
115
Run Growth:
10
Growth Rate:
9.43%
Total runs:
105
Run Growth:
15
Growth Rate:
14.29%
Total runs:
104
Run Growth:
16
Growth Rate:
15.38%
Total runs:
104
Run Growth:
7
Growth Rate:
6.73%
Total runs:
103
Run Growth:
14
Growth Rate:
13.59%
Total runs:
102
Run Growth:
5
Growth Rate:
4.90%
Total runs:
106
Run Growth:
6
Growth Rate:
5.88%
Total runs:
102
Run Growth:
0
Growth Rate:
0.00%
Total runs:
102
Run Growth:
14
Growth Rate:
13.73%
Total runs:
101
Run Growth:
17
Growth Rate:
16.83%
Total runs:
101
Run Growth:
18
Growth Rate:
17.82%
Total runs:
101
Run Growth:
10
Growth Rate:
9.90%
Total runs:
101
Run Growth:
16
Growth Rate:
15.84%
Total runs:
100
Run Growth:
14
Growth Rate:
14.00%
Total runs:
105
Run Growth:
-6
Growth Rate:
-6.00%
Total runs:
103
Run Growth:
13
Growth Rate:
13.00%