Sponsored by
APIMart
arcee-ai / Trinity-Mini-GGUF
Model's Last Updated: May 29 2026
text-generation
Introduction of Trinity-Mini-GGUF
Model Details of Trinity-Mini-GGUF
Trinity Mini GGUF
Trinity Mini is an Arcee AI 26B MoE model with 3B active parameters. It is the medium-sized model in our new Trinity family, a series of open-weight models for enterprise and tinkerers alike.
This model is tuned for reasoning, but in testing, it uses a similar total token count to competitive instruction-tuned models.
These are the GGUF files for running on llama.cpp powered platforms
Trinity Mini is trained on 10T tokens gathered and curated through a key partnership with Datology , building upon the excellent dataset we used on AFM-4.5B with additional math and code.
Training was performed on a cluster of 512 H200 GPUs powered by Prime Intellect using HSDP parallelism.
More details, including key architecture decisions, can be found on our blog here
Try it out now at chat.arcee.ai
Model Details
- Model Architecture: AfmoeForCausalLM
- Parameters: 26B, 3B active
- Experts: 128 total, 8 active, 1 shared
- Context length: 128k
- Training Tokens: 10T
- License: Apache 2.0
-
Recommended settings:
- temperature: 0.15
- top_k: 50
- top_p: 0.75
- min_p: 0.06
Benchmarks
Running our model
llama.cpp
Supported in llama.cpp release b7061
Download the latest llama.cpp release
llama-server -hf arcee-ai/Trinity-Mini-GGUF:q4_k_m \
--temp 0.15 \
--top-k 50 \
--top-p 0.75
--min-p 0.06
LM Studio
Supported in latest LM Studio runtime
Update to latest available, then verify your runtime by:
- Click "Power User" at the bottom left
- Click the green "Developer" icon at the top left
- Select "LM Runtimes" at the top
- Refresh the list of runtimes and verify that the latest is installed
Then, go to Model Search and search for
arcee-ai/Trinity-Mini-GGUF
, download your prefered size, and load it up in the chat
API
Trinity Mini is available today on openrouter:
https://openrouter.ai/arcee-ai/trinity-mini
curl -X POST "https://openrouter.ai/v1/chat/completions" \
-H "Authorization: Bearer $OPENROUTER_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "arcee-ai/trinity-mini",
"messages": [
{
"role": "user",
"content": "What are some fun things to do in New York?"
}
]
}'
License
Trinity-Mini is released under the Apache-2.0 license.
Runs of arcee-ai Trinity-Mini-GGUF on huggingface.co
1.2K
Total runs
0
24-hour runs
-3
3-day runs
-102
7-day runs
-106
30-day runs
More Information About Trinity-Mini-GGUF huggingface.co Model
Url of Trinity-Mini-GGUF
Trinity-Mini-GGUF huggingface.co Url
Provider of Trinity-Mini-GGUF huggingface.co
Other API from arcee-ai
Total runs:
14.3K
Run Growth:
14.2K
Growth Rate:
99.11%
Total runs:
5.6K
Run Growth:
-752
Growth Rate:
-13.47%
Total runs:
3.7K
Run Growth:
-287
Growth Rate:
-7.75%
Total runs:
2.5K
Run Growth:
1.2K
Growth Rate:
48.53%
Total runs:
2.5K
Run Growth:
1.1K
Growth Rate:
45.07%
Total runs:
2.4K
Run Growth:
-613
Growth Rate:
-25.18%
Total runs:
2.1K
Run Growth:
470
Growth Rate:
22.15%
Total runs:
1.9K
Run Growth:
1.0K
Growth Rate:
53.85%
Total runs:
1.8K
Run Growth:
1.5K
Growth Rate:
82.87%
Total runs:
1.7K
Run Growth:
-860
Growth Rate:
-49.60%
Total runs:
1.7K
Run Growth:
1.3K
Growth Rate:
79.47%
Total runs:
1.7K
Run Growth:
-3.2K
Growth Rate:
-191.35%
Total runs:
1.6K
Run Growth:
1.0K
Growth Rate:
62.29%
Total runs:
1.5K
Run Growth:
1.5K
Growth Rate:
98.63%
Total runs:
1.5K
Run Growth:
140
Growth Rate:
9.62%
Total runs:
1.4K
Run Growth:
522
Growth Rate:
37.96%
Total runs:
1.2K
Run Growth:
2
Growth Rate:
0.17%
Total runs:
1.1K
Run Growth:
839
Growth Rate:
73.99%
Total runs:
1.1K
Run Growth:
709
Growth Rate:
65.05%
Total runs:
1.0K
Run Growth:
-6
Growth Rate:
-0.58%
Total runs:
1.0K
Run Growth:
-1.8K
Growth Rate:
-174.58%
Total runs:
922
Run Growth:
173
Growth Rate:
18.76%
Total runs:
875
Run Growth:
-124
Growth Rate:
-14.17%
Total runs:
850
Run Growth:
0
Growth Rate:
0.00%
Total runs:
766
Run Growth:
-6.3K
Growth Rate:
-820.89%
Total runs:
664
Run Growth:
421
Growth Rate:
63.40%
Total runs:
614
Run Growth:
-4.4K
Growth Rate:
-715.15%
Total runs:
612
Run Growth:
349
Growth Rate:
57.03%
Total runs:
590
Run Growth:
-13
Growth Rate:
-2.20%
Total runs:
505
Run Growth:
201
Growth Rate:
39.80%
Total runs:
467
Run Growth:
405
Growth Rate:
86.72%
Total runs:
448
Run Growth:
107
Growth Rate:
23.88%
Total runs:
410
Run Growth:
175
Growth Rate:
42.68%
Total runs:
408
Run Growth:
0
Growth Rate:
0.00%
Total runs:
351
Run Growth:
351
Growth Rate:
100.00%
Total runs:
281
Run Growth:
0
Growth Rate:
0.00%
Total runs:
278
Run Growth:
130
Growth Rate:
46.76%
Total runs:
269
Run Growth:
170
Growth Rate:
63.20%
Total runs:
243
Run Growth:
-1.7K
Growth Rate:
-680.25%
Total runs:
215
Run Growth:
23
Growth Rate:
10.70%
Total runs:
183
Run Growth:
72
Growth Rate:
39.34%
Total runs:
158
Run Growth:
-1
Growth Rate:
-0.63%
Total runs:
157
Run Growth:
66
Growth Rate:
42.04%
Total runs:
148
Run Growth:
-99
Growth Rate:
-66.89%
Total runs:
142
Run Growth:
-21
Growth Rate:
-14.79%
Total runs:
140
Run Growth:
-41
Growth Rate:
-29.29%
Total runs:
137
Run Growth:
4
Growth Rate:
2.92%
Total runs:
137
Run Growth:
15
Growth Rate:
10.95%
Total runs:
136
Run Growth:
54
Growth Rate:
39.71%
Total runs:
133
Run Growth:
-51
Growth Rate:
-39.23%
Total runs:
119
Run Growth:
25
Growth Rate:
21.01%
Total runs:
119
Run Growth:
36
Growth Rate:
30.25%
Total runs:
114
Run Growth:
28
Growth Rate:
24.56%
Total runs:
113
Run Growth:
9
Growth Rate:
7.96%
Total runs:
111
Run Growth:
36
Growth Rate:
32.43%
Total runs:
110
Run Growth:
20
Growth Rate:
18.18%
Total runs:
109
Run Growth:
24
Growth Rate:
22.02%
Total runs:
108
Run Growth:
19
Growth Rate:
17.59%
Total runs:
108
Run Growth:
7
Growth Rate:
6.48%
Total runs:
108
Run Growth:
11
Growth Rate:
10.19%
Total runs:
108
Run Growth:
12
Growth Rate:
11.32%
Total runs:
105
Run Growth:
14
Growth Rate:
13.33%
Total runs:
105
Run Growth:
16
Growth Rate:
15.24%
Total runs:
104
Run Growth:
15
Growth Rate:
14.42%
Total runs:
104
Run Growth:
-1
Growth Rate:
-0.97%
Total runs:
103
Run Growth:
15
Growth Rate:
14.56%
Total runs:
103
Run Growth:
22
Growth Rate:
21.36%
Total runs:
102
Run Growth:
18
Growth Rate:
17.65%
Total runs:
102
Run Growth:
9
Growth Rate:
8.82%
Total runs:
101
Run Growth:
15
Growth Rate:
14.85%
Total runs:
101
Run Growth:
17
Growth Rate:
16.83%
Total runs:
101
Run Growth:
18
Growth Rate:
17.82%
Total runs:
102
Run Growth:
7
Growth Rate:
6.93%
Total runs:
101
Run Growth:
14
Growth Rate:
13.86%