kaitchup / Ornith-1.5-9B-hum-balanced

huggingface.co
Total runs: 41
24-hour runs: 0
7-day runs: 9
30-day runs: 25
Model's Last Updated: August 30 2026

Introduction of Ornith-1.5-9B-hum-balanced

Model Details of Ornith-1.5-9B-hum-balanced

This is Qwen/Qwen3.8-27B quantized with AutoRound . Model packed by llm-compressor .

Quantization:

  • INT data types
  • ~3.5 bits for linear layers
  • 8-bit LM head
  • BF16 MTP layers
  • 8-bit activations

The model is compatible with vLLM (tested: v0.26+). Made and Tested with an RTX Pro 6000 (Google Colab's G4). Currently under evaluation: Subscribe to be notified when I publish the results.

Instructions
vllm serve [this_model_id] \
  --tensor-parallel-size 1 \
  --enable-auto-tool-choice \
  --tool-call-parser qwen3_xml \
  --reasoning-parser qwen3 \
  --trust-remote-code

Add --speculative-config '{"method":"mtp","num_speculative_tokens":X}' for MTP, where good values for X are between 2 and 6 (depending on your tasks and concurrency).

Runs of kaitchup Ornith-1.5-9B-hum-balanced on huggingface.co

41
Total runs
0
24-hour runs
4
3-day runs
9
7-day runs
25
30-day runs

More Information About Ornith-1.5-9B-hum-balanced huggingface.co Model

More Ornith-1.5-9B-hum-balanced license Visit here:

https://choosealicense.com/licenses/apache-2.0

Ornith-1.5-9B-hum-balanced huggingface.co

Ornith-1.5-9B-hum-balanced huggingface.co is an AI model on huggingface.co that provides Ornith-1.5-9B-hum-balanced's model effect (), which can be used instantly with this kaitchup Ornith-1.5-9B-hum-balanced model. huggingface.co supports a free trial of the Ornith-1.5-9B-hum-balanced model, and also provides paid use of the Ornith-1.5-9B-hum-balanced. Support call Ornith-1.5-9B-hum-balanced model through api, including Node.js, Python, http.

Ornith-1.5-9B-hum-balanced huggingface.co Url

https://huggingface.co/kaitchup/Ornith-1.5-9B-hum-balanced

kaitchup Ornith-1.5-9B-hum-balanced online free

Ornith-1.5-9B-hum-balanced huggingface.co is an online trial and call api platform, which integrates Ornith-1.5-9B-hum-balanced's modeling effects, including api services, and provides a free online trial of Ornith-1.5-9B-hum-balanced, you can try Ornith-1.5-9B-hum-balanced online for free by clicking the link below.

kaitchup Ornith-1.5-9B-hum-balanced online free url in huggingface.co:

https://huggingface.co/kaitchup/Ornith-1.5-9B-hum-balanced

Ornith-1.5-9B-hum-balanced install

Ornith-1.5-9B-hum-balanced is an open source model from GitHub that offers a free installation service, and any user can find Ornith-1.5-9B-hum-balanced on GitHub to install. At the same time, huggingface.co provides the effect of Ornith-1.5-9B-hum-balanced install, users can directly use Ornith-1.5-9B-hum-balanced installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Ornith-1.5-9B-hum-balanced install url in huggingface.co:

https://huggingface.co/kaitchup/Ornith-1.5-9B-hum-balanced

Url of Ornith-1.5-9B-hum-balanced

Ornith-1.5-9B-hum-balanced huggingface.co Url

Provider of Ornith-1.5-9B-hum-balanced huggingface.co

kaitchup
ORGANIZATIONS

Other API from kaitchup