The model is compatible with vLLM (tested: v0.26+). Made and Tested with an RTX Pro 6000 (Google Colab's G4).
Currently under evaluation:
Subscribe
to be notified when I publish the results.
Add --speculative-config '{"method":"mtp","num_speculative_tokens":X}' for MTP, where good values for X are between 2 and 6 (depending on your tasks and concurrency).
Runs of kaitchup Ornith-1.5-9B-hum-quality on huggingface.co
44
Total runs
0
24-hour runs
0
3-day runs
6
7-day runs
9
30-day runs
More Information About Ornith-1.5-9B-hum-quality huggingface.co Model
More Ornith-1.5-9B-hum-quality license Visit here:
Ornith-1.5-9B-hum-quality huggingface.co is an AI model on huggingface.co that provides Ornith-1.5-9B-hum-quality's model effect (), which can be used instantly with this kaitchup Ornith-1.5-9B-hum-quality model. huggingface.co supports a free trial of the Ornith-1.5-9B-hum-quality model, and also provides paid use of the Ornith-1.5-9B-hum-quality. Support call Ornith-1.5-9B-hum-quality model through api, including Node.js, Python, http.
Ornith-1.5-9B-hum-quality huggingface.co is an online trial and call api platform, which integrates Ornith-1.5-9B-hum-quality's modeling effects, including api services, and provides a free online trial of Ornith-1.5-9B-hum-quality, you can try Ornith-1.5-9B-hum-quality online for free by clicking the link below.
kaitchup Ornith-1.5-9B-hum-quality online free url in huggingface.co:
Ornith-1.5-9B-hum-quality is an open source model from GitHub that offers a free installation service, and any user can find Ornith-1.5-9B-hum-quality on GitHub to install. At the same time, huggingface.co provides the effect of Ornith-1.5-9B-hum-quality install, users can directly use Ornith-1.5-9B-hum-quality installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
Ornith-1.5-9B-hum-quality install url in huggingface.co: