prism-ml / Ternary-Bonsai-2-27B-gguf-dev

huggingface.co
Total runs: 8.2K
24-hour runs: 0
7-day runs: 1.5K
30-day runs: 7.4K
Model's Last Updated: September 18 2026
text-generation

Introduction of Ternary-Bonsai-2-27B-gguf-dev

Model Details of Ternary-Bonsai-2-27B-gguf-dev

Bonsai 2 27B, Q2_0 (testing build)

The Q2_0 packing of Bonsai 2 27B, kept separate until upstream support lands.

Bonsai 2 needs an activation transform that currently only exists in our llama.cpp fork . Stock llama.cpp will load this file anyway, since it knows the Q2_0 type and the qwen35 architecture, and outputs gibberish with no warning. The main repo's PQ2_0 and PTQ1_0 use types stock llama.cpp does not know, so it stops with an error rather than running them. That is why they ship there and this one does not.

It is here for testing, kernel work, and upstreaming. It moves to the main repo once that lands.

For normal use: Ternary-Bonsai-2-27B-gguf , or Ternary-Bonsai-2-27B-mlx-2bit on Apple Silicon. Setup for every backend: Bonsai-demo .

[email protected]

Runs of prism-ml Ternary-Bonsai-2-27B-gguf-dev on huggingface.co

8.2K
Total runs
0
24-hour runs
605
3-day runs
1.5K
7-day runs
7.4K
30-day runs

More Information About Ternary-Bonsai-2-27B-gguf-dev huggingface.co Model

More Ternary-Bonsai-2-27B-gguf-dev license Visit here:

https://choosealicense.com/licenses/apache-2.0

Ternary-Bonsai-2-27B-gguf-dev huggingface.co

Ternary-Bonsai-2-27B-gguf-dev huggingface.co is an AI model on huggingface.co that provides Ternary-Bonsai-2-27B-gguf-dev's model effect (), which can be used instantly with this prism-ml Ternary-Bonsai-2-27B-gguf-dev model. huggingface.co supports a free trial of the Ternary-Bonsai-2-27B-gguf-dev model, and also provides paid use of the Ternary-Bonsai-2-27B-gguf-dev. Support call Ternary-Bonsai-2-27B-gguf-dev model through api, including Node.js, Python, http.

Ternary-Bonsai-2-27B-gguf-dev huggingface.co Url

https://huggingface.co/prism-ml/Ternary-Bonsai-2-27B-gguf-dev

prism-ml Ternary-Bonsai-2-27B-gguf-dev online free

Ternary-Bonsai-2-27B-gguf-dev huggingface.co is an online trial and call api platform, which integrates Ternary-Bonsai-2-27B-gguf-dev's modeling effects, including api services, and provides a free online trial of Ternary-Bonsai-2-27B-gguf-dev, you can try Ternary-Bonsai-2-27B-gguf-dev online for free by clicking the link below.

prism-ml Ternary-Bonsai-2-27B-gguf-dev online free url in huggingface.co:

https://huggingface.co/prism-ml/Ternary-Bonsai-2-27B-gguf-dev

Ternary-Bonsai-2-27B-gguf-dev install

Ternary-Bonsai-2-27B-gguf-dev is an open source model from GitHub that offers a free installation service, and any user can find Ternary-Bonsai-2-27B-gguf-dev on GitHub to install. At the same time, huggingface.co provides the effect of Ternary-Bonsai-2-27B-gguf-dev install, users can directly use Ternary-Bonsai-2-27B-gguf-dev installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Ternary-Bonsai-2-27B-gguf-dev install url in huggingface.co:

https://huggingface.co/prism-ml/Ternary-Bonsai-2-27B-gguf-dev

Url of Ternary-Bonsai-2-27B-gguf-dev

Ternary-Bonsai-2-27B-gguf-dev huggingface.co Url

Provider of Ternary-Bonsai-2-27B-gguf-dev huggingface.co

prism-ml
ORGANIZATIONS

Other API from prism-ml