cmp-nct / llava-1.6-gguf

huggingface.co
Total runs: 3.1K
24-hour runs: 108
7-day runs: 966
30-day runs: 1.6K
Model's Last Updated: February 22 2024
image-text-to-text

Introduction of llava-1.6-gguf

Model Details of llava-1.6-gguf

Update: PR is merged, llama.cpp now natively supports these models
Important: Verify that processing a simple question with any image at least uses 1200 tokens of prompt processing, that shows that the new PR is in use. If your prompt is just 576 + a few tokens, you are using llava-1.5 code (or projector) and this is incompatible with llava-1.6

note Keep in mind the different fine tunes as described in the llama.cpp llava readme, it's essential to use the non defaults for non vicuna models

The mmproj files are the embedded ViT's that came with llava-1.6, I've not compared them but given the previous releases from the team I'd be surprised if the ViT has not been fine tuned this time. If that's the case, using another ViT can cause issues.
You need to use the mmproj of the right model but you can mix quantizations.

Original models: https://github.com/haotian-liu/LLaVA

Runs of cmp-nct llava-1.6-gguf on huggingface.co

3.1K
Total runs
108
24-hour runs
579
3-day runs
966
7-day runs
1.6K
30-day runs

More Information About llava-1.6-gguf huggingface.co Model

More llava-1.6-gguf license Visit here:

https://choosealicense.com/licenses/apache-2.0

llava-1.6-gguf huggingface.co

llava-1.6-gguf huggingface.co is an AI model on huggingface.co that provides llava-1.6-gguf's model effect (), which can be used instantly with this cmp-nct llava-1.6-gguf model. huggingface.co supports a free trial of the llava-1.6-gguf model, and also provides paid use of the llava-1.6-gguf. Support call llava-1.6-gguf model through api, including Node.js, Python, http.

llava-1.6-gguf huggingface.co Url

https://huggingface.co/cmp-nct/llava-1.6-gguf

cmp-nct llava-1.6-gguf online free

llava-1.6-gguf huggingface.co is an online trial and call api platform, which integrates llava-1.6-gguf's modeling effects, including api services, and provides a free online trial of llava-1.6-gguf, you can try llava-1.6-gguf online for free by clicking the link below.

cmp-nct llava-1.6-gguf online free url in huggingface.co:

https://huggingface.co/cmp-nct/llava-1.6-gguf

llava-1.6-gguf install

llava-1.6-gguf is an open source model from GitHub that offers a free installation service, and any user can find llava-1.6-gguf on GitHub to install. At the same time, huggingface.co provides the effect of llava-1.6-gguf install, users can directly use llava-1.6-gguf installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

llava-1.6-gguf install url in huggingface.co:

https://huggingface.co/cmp-nct/llava-1.6-gguf

Url of llava-1.6-gguf

llava-1.6-gguf huggingface.co Url

Provider of llava-1.6-gguf huggingface.co

cmp-nct
ORGANIZATIONS

Other API from cmp-nct

huggingface.co

Total runs: 11
Run Growth: 3
Growth Rate: 27.27%
Updated:May 30 2026