bartowski / blossom-v5-9b-GGUF

huggingface.co
Total runs: 130
24-hour runs: 1
7-day runs: -13
30-day runs: -265
Model's Last Updated: March 22 2024
text-generation

Introduction of blossom-v5-9b-GGUF

Model Details of blossom-v5-9b-GGUF

Llamacpp Quantizations of blossom-v5-9b

Using llama.cpp release b2440 for quantization.

Original model: https://huggingface.co/Azure99/blossom-v5-9b

Download a file (not the whole branch) from below:

Filename Quant type File Size Description
blossom-v5-9b-Q8_0.gguf Q8_0 9.38GB Extremely high quality, generally unneeded but max available quant.
blossom-v5-9b-Q6_K.gguf Q6_K 7.24GB Very high quality, near perfect, recommended .
blossom-v5-9b-Q5_K_M.gguf Q5_K_M 6.25GB High quality, very usable.
blossom-v5-9b-Q5_K_S.gguf Q5_K_S 6.10GB High quality, very usable.
blossom-v5-9b-Q5_0.gguf Q5_0 6.10GB High quality, older format, generally not recommended.
blossom-v5-9b-Q4_K_M.gguf Q4_K_M 5.32GB Good quality, similar to 4.25 bpw.
blossom-v5-9b-Q4_K_S.gguf Q4_K_S 5.07GB Slightly lower quality with small space savings.
blossom-v5-9b-IQ4_NL.gguf IQ4_NL 5.08GB Good quality, similar to Q4_K_S, new method of quanting,
blossom-v5-9b-IQ4_XS.gguf IQ4_XS 4.82GB Decent quality, new method with similar performance to Q4.
blossom-v5-9b-Q4_0.gguf Q4_0 5.03GB Decent quality, older format, generally not recommended.
blossom-v5-9b-IQ3_M.gguf IQ3_M 4.05GB Medium-low quality, new method with decent performance.
blossom-v5-9b-IQ3_S.gguf IQ3_S 3.91GB Lower quality, new method with decent performance, recommended over Q3 quants.
blossom-v5-9b-Q3_K_L.gguf Q3_K_L 4.69GB Lower quality but usable, good for low RAM availability.
blossom-v5-9b-Q3_K_M.gguf Q3_K_M 4.32GB Even lower quality.
blossom-v5-9b-Q3_K_S.gguf Q3_K_S 3.89GB Low quality, not recommended.
blossom-v5-9b-Q2_K.gguf Q2_K 3.35GB Extremely low quality, not recommended.

Want to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski

Runs of bartowski blossom-v5-9b-GGUF on huggingface.co

130
Total runs
1
24-hour runs
38
3-day runs
-13
7-day runs
-265
30-day runs

More Information About blossom-v5-9b-GGUF huggingface.co Model

More blossom-v5-9b-GGUF license Visit here:

https://choosealicense.com/licenses/apache-2.0

blossom-v5-9b-GGUF huggingface.co

blossom-v5-9b-GGUF huggingface.co is an AI model on huggingface.co that provides blossom-v5-9b-GGUF's model effect (), which can be used instantly with this bartowski blossom-v5-9b-GGUF model. huggingface.co supports a free trial of the blossom-v5-9b-GGUF model, and also provides paid use of the blossom-v5-9b-GGUF. Support call blossom-v5-9b-GGUF model through api, including Node.js, Python, http.

blossom-v5-9b-GGUF huggingface.co Url

https://huggingface.co/bartowski/blossom-v5-9b-GGUF

bartowski blossom-v5-9b-GGUF online free

blossom-v5-9b-GGUF huggingface.co is an online trial and call api platform, which integrates blossom-v5-9b-GGUF's modeling effects, including api services, and provides a free online trial of blossom-v5-9b-GGUF, you can try blossom-v5-9b-GGUF online for free by clicking the link below.

bartowski blossom-v5-9b-GGUF online free url in huggingface.co:

https://huggingface.co/bartowski/blossom-v5-9b-GGUF

blossom-v5-9b-GGUF install

blossom-v5-9b-GGUF is an open source model from GitHub that offers a free installation service, and any user can find blossom-v5-9b-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of blossom-v5-9b-GGUF install, users can directly use blossom-v5-9b-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

blossom-v5-9b-GGUF install url in huggingface.co:

https://huggingface.co/bartowski/blossom-v5-9b-GGUF

Url of blossom-v5-9b-GGUF

blossom-v5-9b-GGUF huggingface.co Url

Provider of blossom-v5-9b-GGUF huggingface.co

bartowski
ORGANIZATIONS

Other API from bartowski

huggingface.co

Total runs: 42.1K
Run Growth: -5.2K
Growth Rate: -12.29%
Updated:July 15 2026