Trinity Nano Preview is a preview of Arcee AI's 6B MoE model with 1B active parameters. It is the small-sized model in our new Trinity family, a series of open-weight models for enterprise and tinkerers alike.
This is a chat tuned model, with a delightful personality and charm we think users will love. We note that this model is pushing the limits of sparsity in small language models with only 800M non-embedding parameters active per token, and as such
may be unstable
in certain use cases, especially in this preview.
This is an
experimental
release, it's fun to talk to but will not be hosted anywhere, so download it and try it out yourself!
Trinity Nano Preview is trained on 10T tokens gathered and curated through a key partnership with
Datology
, building upon the excellent dataset we used on
AFM-4.5B
with additional math and code.
Training was performed on a cluster of 512 H200 GPUs powered by
Prime Intellect
using HSDP parallelism.
More details, including key architecture decisions, can be found on our blog
here
Trinity-Nano-Preview-MLX-5bit huggingface.co is an AI model on huggingface.co that provides Trinity-Nano-Preview-MLX-5bit's model effect (), which can be used instantly with this arcee-ai Trinity-Nano-Preview-MLX-5bit model. huggingface.co supports a free trial of the Trinity-Nano-Preview-MLX-5bit model, and also provides paid use of the Trinity-Nano-Preview-MLX-5bit. Support call Trinity-Nano-Preview-MLX-5bit model through api, including Node.js, Python, http.
Trinity-Nano-Preview-MLX-5bit huggingface.co is an online trial and call api platform, which integrates Trinity-Nano-Preview-MLX-5bit's modeling effects, including api services, and provides a free online trial of Trinity-Nano-Preview-MLX-5bit, you can try Trinity-Nano-Preview-MLX-5bit online for free by clicking the link below.
arcee-ai Trinity-Nano-Preview-MLX-5bit online free url in huggingface.co:
Trinity-Nano-Preview-MLX-5bit is an open source model from GitHub that offers a free installation service, and any user can find Trinity-Nano-Preview-MLX-5bit on GitHub to install. At the same time, huggingface.co provides the effect of Trinity-Nano-Preview-MLX-5bit install, users can directly use Trinity-Nano-Preview-MLX-5bit installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
Trinity-Nano-Preview-MLX-5bit install url in huggingface.co: