Total runs:
24.5K
Run Growth:
491
Growth Rate:
2.01%
Sponsored by
PoYo.AI
arcee-ai / Trinity-Large-Preview
Model's Last Updated: May 29 2026
text-generation
Introduction of Trinity-Large-Preview
Model Details of Trinity-Large-Preview
Trinity-Large-Preview
Introduction
Trinity-Large-Preview is a 398B-parameter sparse Mixture-of-Experts (MoE) model with approximately 13B active parameters per token. It is the largest model in Arcee AI's Trinity family, trained on more than 17 trillion tokens and delivering frontier-level performance with strong long-context comprehension. Trinity-Large-Preview is a lightly post-trained model based on Trinity-Large-Base.
Try it at chat.arcee.ai
More details on the training of Trinity Large are available in the technical report .
Model Variants
The Trinity Large family consists of three checkpoints from the same training run:
- Trinity-Large-Preview (this release): Lightly post-trained, chat-ready model undergoing active RL
- Trinity-Large-TrueBase : 10T-token pre-anneal pretraining checkpoint
- Trinity-Large-Base : Full 17T-token pretrained foundation model with mid-training anneals
Architecture
Trinity-Large-Preview uses a sparse MoE configuration designed to maximize efficiency while maintaining large-scale capacity.
| Hyperparameter | Value |
|---|---|
| Total parameters | ~398B |
| Active parameters per token | ~13B |
| Experts | 256 (1 shared) |
| Active experts | 4 |
| Routing strategy | 4-of-256 (1.56% sparsity) |
| Dense layers | 6 |
| Pretraining context length | 8,192 |
| Context length after extension | 512k |
| Architecture | Sparse MoE (AfmoeForCausalLM) |
Benchmarks
| Benchmark | Llama 4 Maverick | Trinity-Large Preview |
|---|---|---|
| MMLU | 85.5 | 87.2 |
| MMLU-Pro | 80.5 | 75.2 |
| GPQA-Diamond | 69.8 | 63.3 |
| AIME 2025 | 19.3 | 24.0 |
Training Configuration
Pretraining
- Training tokens: 17 trillion
- Data partner: Datology
Posttraining
- This checkpoint was instruction tuned on 20B tokens.
Infrastructure
- Hardware: 2,048 NVIDIA B300 GPUs
- Parallelism: HSDP + Expert Parallelism
- Compute partner: Prime Intellect
Usage
Running our model
Transformers
Use the
main
transformers branch or pass
trust_remote_code=True
with a released version.
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
model_id = "arcee-ai/Trinity-Large-Preview"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype=torch.bfloat16,
device_map="auto",
trust_remote_code=True
)
messages = [
{"role": "user", "content": "Who are you?"},
]
input_ids = tokenizer.apply_chat_template(
messages,
add_generation_prompt=True,
return_tensors="pt"
).to(model.device)
outputs = model.generate(
input_ids,
max_new_tokens=256,
do_sample=True,
temperature=0.8,
top_k=50,
top_p=0.8
)
response = tokenizer.decode(outputs[0], skip_special_tokens=True)
print(response)
VLLM
Supported in VLLM release 0.11.1+
vllm serve arcee-ai/Trinity-Large-Preview \
--dtype bfloat16 \
--enable-auto-tool-choice \
--tool-call-parser hermes
llama.cpp
Supported in llama.cpp release b7061+
llama-server -hf arcee-ai/Trinity-Large-Preview-GGUF:q4_k_m
LM Studio
Supported in the latest LM Studio runtime. Search for
arcee-ai/Trinity-Large-Preview-GGUF
in Model Search.
API
Available on OpenRouter:
curl -X POST "https://openrouter.ai/v1/chat/completions" \
-H "Authorization: Bearer $OPENROUTER_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "arcee-ai/trinity-large-preview",
"messages": [
{
"role": "user",
"content": "What are some fun things to do in New York?"
}
]
}'
License
Trinity-Large-Preview is released under the Apache License, Version 2.0.
Citation
@misc{arcee_trinity_large_preview,
title = {Trinity-Large-Preview},
author = {{Arcee AI}},
year = {2026},
note = {398B sparse MoE model trained on 17T tokens}
}
Runs of arcee-ai Trinity-Large-Preview on huggingface.co
448
Total runs
0
24-hour runs
-5
3-day runs
0
7-day runs
107
30-day runs
More Information About Trinity-Large-Preview huggingface.co Model
Url of Trinity-Large-Preview
Trinity-Large-Preview huggingface.co Url
Provider of Trinity-Large-Preview huggingface.co
Other API from arcee-ai
Updated:May 29 2026
Total runs:
4.2K
Run Growth:
-5.4K
Growth Rate:
-129.01%
Total runs:
2.5K
Run Growth:
2.1K
Growth Rate:
81.28%
Total runs:
2.3K
Run Growth:
944
Growth Rate:
41.88%
Total runs:
1.8K
Run Growth:
1.5K
Growth Rate:
82.87%
Total runs:
1.7K
Run Growth:
-860
Growth Rate:
-49.60%
Total runs:
1.6K
Run Growth:
724
Growth Rate:
43.88%
Total runs:
1.5K
Run Growth:
1.5K
Growth Rate:
95.37%
Total runs:
1.5K
Run Growth:
1.5K
Growth Rate:
98.63%
Total runs:
1.5K
Run Growth:
1.4K
Growth Rate:
94.65%
Total runs:
1.4K
Run Growth:
1.2K
Growth Rate:
85.64%
Total runs:
1.4K
Run Growth:
1.1K
Growth Rate:
82.79%
Total runs:
1.3K
Run Growth:
96
Growth Rate:
7.16%
Total runs:
1.3K
Run Growth:
-4.1K
Growth Rate:
-318.18%
Total runs:
1.2K
Run Growth:
-106
Growth Rate:
-8.55%
Total runs:
1.2K
Run Growth:
-347
Growth Rate:
-29.33%
Total runs:
1.0K
Run Growth:
-6
Growth Rate:
-0.58%
Total runs:
1.0K
Run Growth:
869
Growth Rate:
83.64%
Total runs:
1.0K
Run Growth:
-1.8K
Growth Rate:
-174.58%
Total runs:
926
Run Growth:
-349
Growth Rate:
-37.69%
Total runs:
850
Run Growth:
0
Growth Rate:
0.00%
Total runs:
782
Run Growth:
612
Growth Rate:
91.89%
Total runs:
766
Run Growth:
-6.3K
Growth Rate:
-820.89%
Total runs:
614
Run Growth:
-4.4K
Growth Rate:
-715.15%
Total runs:
528
Run Growth:
-163
Growth Rate:
-30.87%
Total runs:
505
Run Growth:
201
Growth Rate:
39.80%
Total runs:
503
Run Growth:
382
Growth Rate:
75.94%
Total runs:
475
Run Growth:
450
Growth Rate:
94.74%
Total runs:
449
Run Growth:
108
Growth Rate:
23.58%
Total runs:
410
Run Growth:
175
Growth Rate:
42.68%
Total runs:
408
Run Growth:
0
Growth Rate:
0.00%
Total runs:
369
Run Growth:
230
Growth Rate:
62.33%
Total runs:
351
Run Growth:
351
Growth Rate:
100.00%
Total runs:
281
Run Growth:
0
Growth Rate:
0.00%
Total runs:
279
Run Growth:
-37
Growth Rate:
-13.26%
Total runs:
243
Run Growth:
-1.7K
Growth Rate:
-680.25%
Total runs:
235
Run Growth:
143
Growth Rate:
60.85%
Total runs:
183
Run Growth:
84
Growth Rate:
45.90%
Total runs:
182
Run Growth:
135
Growth Rate:
70.68%
Total runs:
180
Run Growth:
82
Growth Rate:
45.56%
Total runs:
170
Run Growth:
114
Growth Rate:
66.67%
Total runs:
158
Run Growth:
-1
Growth Rate:
-0.63%
Total runs:
148
Run Growth:
-99
Growth Rate:
-66.89%
Total runs:
140
Run Growth:
92
Growth Rate:
65.71%
Total runs:
138
Run Growth:
52
Growth Rate:
37.68%
Total runs:
138
Run Growth:
74
Growth Rate:
53.62%
Total runs:
131
Run Growth:
79
Growth Rate:
61.24%
Total runs:
123
Run Growth:
82
Growth Rate:
66.13%
Total runs:
118
Run Growth:
63
Growth Rate:
53.39%
Total runs:
117
Run Growth:
77
Growth Rate:
65.81%
Total runs:
117
Run Growth:
74
Growth Rate:
63.25%
Total runs:
116
Run Growth:
68
Growth Rate:
58.62%
Total runs:
115
Run Growth:
74
Growth Rate:
64.35%
Total runs:
114
Run Growth:
75
Growth Rate:
65.79%
Total runs:
114
Run Growth:
75
Growth Rate:
65.79%
Total runs:
113
Run Growth:
75
Growth Rate:
65.79%
Total runs:
111
Run Growth:
67
Growth Rate:
60.36%
Total runs:
111
Run Growth:
67
Growth Rate:
60.36%
Total runs:
111
Run Growth:
71
Growth Rate:
63.96%
Total runs:
109
Run Growth:
69
Growth Rate:
63.30%
Total runs:
109
Run Growth:
70
Growth Rate:
64.22%
Total runs:
109
Run Growth:
72
Growth Rate:
64.86%
Total runs:
109
Run Growth:
70
Growth Rate:
64.22%
Total runs:
107
Run Growth:
69
Growth Rate:
64.49%
Total runs:
105
Run Growth:
60
Growth Rate:
57.14%
Total runs:
105
Run Growth:
67
Growth Rate:
63.21%
Total runs:
103
Run Growth:
61
Growth Rate:
59.22%
Total runs:
102
Run Growth:
61
Growth Rate:
59.80%
Total runs:
101
Run Growth:
69
Growth Rate:
68.32%
Total runs:
100
Run Growth:
62
Growth Rate:
62.00%
Total runs:
100
Run Growth:
65
Growth Rate:
65.00%
Total runs:
100
Run Growth:
59
Growth Rate:
59.00%
Total runs:
99
Run Growth:
57
Growth Rate:
57.58%