Abiray / BitCPM4-CANN-3B-GGUF

huggingface.co
Total runs: 33
24-hour runs: -2
7-day runs: -36
30-day runs: -35
Model's Last Updated: May 18 2026

Introduction of BitCPM4-CANN-3B-GGUF

Model Details of BitCPM4-CANN-3B-GGUF

Abiray/BitCPM4-CANN-3B-GGUF

This repository contains quantized GGUF formats of the openbmb/BitCPM4-CANN-3B model, heavily optimized for local inference using llama.cpp , text-generation-webui, LM Studio, Ollama, and other compatible backend frameworks.

Model Information
Available Files & Hardware Compatibility

The following quantization formats are available. Choose the one that best fits your system's VRAM/RAM capacity and desired inference speed.

Filename Quant Type File Size Description
BitCPM4-CANN-3B-Q8_0.gguf 8-bit 3.83 GB Highest quality, almost indistinguishable from the unquantized base model. Best for machines with ample memory (>5GB VRAM/RAM).
BitCPM4-CANN-3B-Q6_K.gguf 6-bit 2.96 GB Excellent quality with minimal degradation. Recommended for strong standard hardware.
BitCPM4-CANN-3B-Q5_K_M.gguf 5-bit 2.56 GB Great balance of speed, file size, and reasoning capability.
BitCPM4-CANN-3B-Q5_K_S.gguf 5-bit 2.51 GB Slightly faster and smaller than Q5_K_M , with a very minor loss in reasoning quality.
BitCPM4-CANN-3B-Q4_K_M.gguf 4-bit 2.19 GB Recommended. The standard "sweet spot" choice for balancing memory efficiency and intelligence for most users.
BitCPM4-CANN-3B-Q4_K_S.gguf 4-bit 2.09 GB Fast and small. Good for lower-end hardware constraints where memory is tight.
BitCPM4-CANN-3B-Q3_K_M.gguf 3-bit 1.79 GB Lowest quality. Use only if heavily constrained by memory (requires <3GB RAM).
How to Run
Using llama.cpp (Command Line)

If you have compiled llama.cpp , you can run the model directly from your terminal. Replace the filename with the specific version you downloaded:

./llama-cli \
  -m BitCPM4-CANN-3B-Q4_K_M.gguf \
  -p "Explain the concept of artificial intelligence to a five-year-old." \
  -n 256 \
  -c 2048 \
  --temp 0.7

Runs of Abiray BitCPM4-CANN-3B-GGUF on huggingface.co

33
Total runs
-2
24-hour runs
-23
3-day runs
-36
7-day runs
-35
30-day runs

More Information About BitCPM4-CANN-3B-GGUF huggingface.co Model

More BitCPM4-CANN-3B-GGUF license Visit here:

https://choosealicense.com/licenses/apache-2.0

BitCPM4-CANN-3B-GGUF huggingface.co

BitCPM4-CANN-3B-GGUF huggingface.co is an AI model on huggingface.co that provides BitCPM4-CANN-3B-GGUF's model effect (), which can be used instantly with this Abiray BitCPM4-CANN-3B-GGUF model. huggingface.co supports a free trial of the BitCPM4-CANN-3B-GGUF model, and also provides paid use of the BitCPM4-CANN-3B-GGUF. Support call BitCPM4-CANN-3B-GGUF model through api, including Node.js, Python, http.

BitCPM4-CANN-3B-GGUF huggingface.co Url

https://huggingface.co/Abiray/BitCPM4-CANN-3B-GGUF

Abiray BitCPM4-CANN-3B-GGUF online free

BitCPM4-CANN-3B-GGUF huggingface.co is an online trial and call api platform, which integrates BitCPM4-CANN-3B-GGUF's modeling effects, including api services, and provides a free online trial of BitCPM4-CANN-3B-GGUF, you can try BitCPM4-CANN-3B-GGUF online for free by clicking the link below.

Abiray BitCPM4-CANN-3B-GGUF online free url in huggingface.co:

https://huggingface.co/Abiray/BitCPM4-CANN-3B-GGUF

BitCPM4-CANN-3B-GGUF install

BitCPM4-CANN-3B-GGUF is an open source model from GitHub that offers a free installation service, and any user can find BitCPM4-CANN-3B-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of BitCPM4-CANN-3B-GGUF install, users can directly use BitCPM4-CANN-3B-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

BitCPM4-CANN-3B-GGUF install url in huggingface.co:

https://huggingface.co/Abiray/BitCPM4-CANN-3B-GGUF

Url of BitCPM4-CANN-3B-GGUF

BitCPM4-CANN-3B-GGUF huggingface.co Url

Provider of BitCPM4-CANN-3B-GGUF huggingface.co

Abiray
ORGANIZATIONS

Other API from Abiray

huggingface.co

Total runs: 6.6K
Run Growth: -10.1K
Growth Rate: -153.13%
Updated:July 14 2026
huggingface.co

Total runs: 2.4K
Run Growth: -6.3K
Growth Rate: -266.78%
Updated:June 15 2026
huggingface.co

Total runs: 2.0K
Run Growth: -176
Growth Rate: -8.64%
Updated:May 16 2026
huggingface.co

Total runs: 753
Run Growth: 0
Growth Rate: 0.00%
Updated:September 11 2026
huggingface.co

Total runs: 32
Run Growth: -70
Growth Rate: -218.75%
Updated:August 02 2026