FP16 safetensors (HuggingFace
diffusers
format) of the ternary Bonsai Image 4B model. This repo exists for users who want to run Bonsai Image with stock
diffusers
or other frameworks that don't yet support our low-bit packs natively. The ternary kernels live in
MLX
(Apple Silicon, 2-bit out of the box) and the
gemlite
low-bit GEMM stack (CUDA).
We strongly recommend using the optimized low-bit packs instead.
The ternary format is where the Bonsai Image gains come from — a 6.4× transformer footprint reduction, sub-iPhone deployment, and ~5× faster inference vs the stock FP16 pipeline on Apple Silicon. This unpacked FP16 version is full-size and provides none of those advantages.
For the optimized ternary release packs (recommended):
bonsai-image-ternary-4B-unpacked huggingface.co is an AI model on huggingface.co that provides bonsai-image-ternary-4B-unpacked's model effect (), which can be used instantly with this prism-ml bonsai-image-ternary-4B-unpacked model. huggingface.co supports a free trial of the bonsai-image-ternary-4B-unpacked model, and also provides paid use of the bonsai-image-ternary-4B-unpacked. Support call bonsai-image-ternary-4B-unpacked model through api, including Node.js, Python, http.
bonsai-image-ternary-4B-unpacked huggingface.co is an online trial and call api platform, which integrates bonsai-image-ternary-4B-unpacked's modeling effects, including api services, and provides a free online trial of bonsai-image-ternary-4B-unpacked, you can try bonsai-image-ternary-4B-unpacked online for free by clicking the link below.
prism-ml bonsai-image-ternary-4B-unpacked online free url in huggingface.co:
bonsai-image-ternary-4B-unpacked is an open source model from GitHub that offers a free installation service, and any user can find bonsai-image-ternary-4B-unpacked on GitHub to install. At the same time, huggingface.co provides the effect of bonsai-image-ternary-4B-unpacked install, users can directly use bonsai-image-ternary-4B-unpacked installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
bonsai-image-ternary-4B-unpacked install url in huggingface.co: