Sponsored by
APIMart
arcee-ai / Trinity-Nano-Preview-MLX-6bit
Model's Last Updated: May 29 2026
text-generation
Introduction of Trinity-Nano-Preview-MLX-6bit
Model Details of Trinity-Nano-Preview-MLX-6bit
Trinity Nano MLX 6bit
Trinity Nano Preview is a preview of Arcee AI's 6B MoE model with 1B active parameters. It is the small-sized model in our new Trinity family, a series of open-weight models for enterprise and tinkerers alike.
This is a chat tuned model, with a delightful personality and charm we think users will love. We note that this model is pushing the limits of sparsity in small language models with only 800M non-embedding parameters active per token, and as such may be unstable in certain use cases, especially in this preview.
This is an experimental release, it's fun to talk to but will not be hosted anywhere, so download it and try it out yourself!
Trinity Nano Preview is trained on 10T tokens gathered and curated through a key partnership with Datology , building upon the excellent dataset we used on AFM-4.5B with additional math and code.
Training was performed on a cluster of 512 H200 GPUs powered by Prime Intellect using HSDP parallelism.
More details, including key architecture decisions, can be found on our blog here
Model Details
- Model Architecture: AfmoeForCausalLM
- Parameters: 6B, 1B active
- Experts: 128 total, 8 active, 1 shared
- Context length: 128k
- Training Tokens: 10T
- License: Apache 2.0
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
from mlx_lm.sample_utils import make_sampler, make_logits_processors
model, tokenizer = load("arcee-ai/Trinity-Nano-Preview-MLX-6bit")
prompt = "What is the capital of France?"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, tokenize=False, add_generation_prompt=True
)
sampler = make_sampler(temp=0.1, top_k=50, top_p=0.1)
logits_processors = make_logits_processors(repetition_penalty=1.05)
response = generate(
model,
tokenizer,
prompt=prompt,
max_tokens=512,
sampler=sampler,
logits_processors=logits_processors,
verbose=True,
)
Runs of arcee-ai Trinity-Nano-Preview-MLX-6bit on huggingface.co
92
Total runs
0
24-hour runs
0
3-day runs
33
7-day runs
33
30-day runs
More Information About Trinity-Nano-Preview-MLX-6bit huggingface.co Model
Url of Trinity-Nano-Preview-MLX-6bit
Trinity-Nano-Preview-MLX-6bit huggingface.co Url
Provider of Trinity-Nano-Preview-MLX-6bit huggingface.co
Other API from arcee-ai
Total runs:
14.2K
Run Growth:
14.1K
Growth Rate:
99.17%
Total runs:
5.6K
Run Growth:
-752
Growth Rate:
-13.47%
Total runs:
3.1K
Run Growth:
-968
Growth Rate:
-30.44%
Total runs:
2.5K
Run Growth:
1.2K
Growth Rate:
48.53%
Total runs:
2.3K
Run Growth:
-1.0K
Growth Rate:
-45.36%
Total runs:
1.9K
Run Growth:
1.0K
Growth Rate:
53.11%
Total runs:
1.8K
Run Growth:
1.5K
Growth Rate:
82.87%
Total runs:
1.7K
Run Growth:
-860
Growth Rate:
-49.60%
Total runs:
1.7K
Run Growth:
1.0K
Growth Rate:
60.65%
Total runs:
1.7K
Run Growth:
-3.2K
Growth Rate:
-191.35%
Total runs:
1.6K
Run Growth:
-771
Growth Rate:
-48.86%
Total runs:
1.5K
Run Growth:
1.5K
Growth Rate:
98.63%
Total runs:
1.5K
Run Growth:
-1000
Growth Rate:
-66.80%
Total runs:
1.1K
Run Growth:
557
Growth Rate:
50.96%
Total runs:
1.1K
Run Growth:
-672
Growth Rate:
-60.76%
Total runs:
1.0K
Run Growth:
-6
Growth Rate:
-0.58%
Total runs:
1.0K
Run Growth:
-1.8K
Growth Rate:
-174.58%
Total runs:
981
Run Growth:
-414
Growth Rate:
-42.20%
Total runs:
880
Run Growth:
-101
Growth Rate:
-11.48%
Total runs:
850
Run Growth:
0
Growth Rate:
0.00%
Total runs:
841
Run Growth:
-554
Growth Rate:
-65.87%
Total runs:
766
Run Growth:
-6.3K
Growth Rate:
-820.89%
Total runs:
614
Run Growth:
-4.4K
Growth Rate:
-715.15%
Total runs:
590
Run Growth:
-13
Growth Rate:
-2.20%
Total runs:
580
Run Growth:
-861
Growth Rate:
-145.69%
Total runs:
567
Run Growth:
-948
Growth Rate:
-167.20%
Total runs:
505
Run Growth:
201
Growth Rate:
39.80%
Total runs:
503
Run Growth:
96
Growth Rate:
19.09%
Total runs:
502
Run Growth:
198
Growth Rate:
33.67%
Total runs:
497
Run Growth:
-501
Growth Rate:
-100.80%
Total runs:
448
Run Growth:
107
Growth Rate:
23.88%
Total runs:
410
Run Growth:
175
Growth Rate:
42.68%
Total runs:
408
Run Growth:
0
Growth Rate:
0.00%
Total runs:
355
Run Growth:
-1.0K
Growth Rate:
-289.01%
Total runs:
351
Run Growth:
351
Growth Rate:
100.00%
Total runs:
327
Run Growth:
-148
Growth Rate:
-45.26%
Total runs:
299
Run Growth:
187
Growth Rate:
62.75%
Total runs:
287
Run Growth:
128
Growth Rate:
43.54%
Total runs:
281
Run Growth:
0
Growth Rate:
0.00%
Total runs:
243
Run Growth:
-1.7K
Growth Rate:
-680.25%
Total runs:
242
Run Growth:
31
Growth Rate:
12.81%
Total runs:
220
Run Growth:
-44
Growth Rate:
-20.00%
Total runs:
215
Run Growth:
117
Growth Rate:
54.93%
Total runs:
204
Run Growth:
-861
Growth Rate:
-422.06%
Total runs:
190
Run Growth:
64
Growth Rate:
33.68%
Total runs:
158
Run Growth:
-1
Growth Rate:
-0.63%
Total runs:
148
Run Growth:
-99
Growth Rate:
-66.89%
Total runs:
140
Run Growth:
-44
Growth Rate:
-31.43%
Total runs:
140
Run Growth:
6
Growth Rate:
4.29%
Total runs:
137
Run Growth:
1
Growth Rate:
0.73%
Total runs:
132
Run Growth:
46
Growth Rate:
34.85%
Total runs:
131
Run Growth:
37
Growth Rate:
28.24%
Total runs:
128
Run Growth:
-47
Growth Rate:
-35.88%
Total runs:
125
Run Growth:
23
Growth Rate:
17.69%
Total runs:
119
Run Growth:
10
Growth Rate:
8.06%
Total runs:
113
Run Growth:
26
Growth Rate:
22.41%
Total runs:
111
Run Growth:
18
Growth Rate:
16.22%
Total runs:
110
Run Growth:
14
Growth Rate:
12.73%
Total runs:
109
Run Growth:
4
Growth Rate:
3.67%
Total runs:
107
Run Growth:
28
Growth Rate:
26.17%
Total runs:
107
Run Growth:
13
Growth Rate:
12.15%
Total runs:
106
Run Growth:
11
Growth Rate:
9.65%
Total runs:
106
Run Growth:
13
Growth Rate:
12.26%
Total runs:
106
Run Growth:
-1
Growth Rate:
-0.94%
Total runs:
105
Run Growth:
11
Growth Rate:
10.48%
Total runs:
105
Run Growth:
21
Growth Rate:
20.00%
Total runs:
104
Run Growth:
5
Growth Rate:
4.81%
Total runs:
104
Run Growth:
16
Growth Rate:
15.38%
Total runs:
104
Run Growth:
12
Growth Rate:
11.54%
Total runs:
103
Run Growth:
20
Growth Rate:
19.42%
Total runs:
103
Run Growth:
12
Growth Rate:
11.65%
Total runs:
103
Run Growth:
13
Growth Rate:
12.62%
Total runs:
102
Run Growth:
15
Growth Rate:
14.71%
Total runs:
102
Run Growth:
15
Growth Rate:
14.71%
Total runs:
102
Run Growth:
18
Growth Rate:
17.65%
Total runs:
101
Run Growth:
18
Growth Rate:
17.82%