Abiray / MiniCPM5-1B-GGUF

huggingface.co
Total runs: 1.0K
24-hour runs: 23
7-day runs: -119
30-day runs: -2.9K
Model's Last Updated: May 28 2026
text-generation

Introduction of MiniCPM5-1B-GGUF

Model Details of MiniCPM5-1B-GGUF

MiniCPM5-1B (GGUF Quantizations)

This repository contains custom GGUF format quantizations of the openbmb/MiniCPM5-1B model.

MiniCPM5-1B is a highly capable 1-billion parameter Transformer built for on-device, local deployment, and resource-constrained scenarios. It utilizes a standard LlamaForCausalLM architecture, features hybrid reasoning (built-in <think> tokens), and supports a massive 131k context window.

📦 Available Files and Quantizations

These models were quantized specifically for high-efficiency CPU/Edge inference using the llama.cpp framework.

Filename Format Size Description
minicpm5-1b-Q4_K_M.gguf Q4_K_M 657 MB Excellent balance of performance and size. (Recommended for 4GB RAM/Mobile)
minicpm5-1b-Q5_K_M.gguf Q5_K_M 751 MB Higher accuracy, slight increase in size.
minicpm5-1b-Q6_K.gguf Q6_K 851 MB Near-perfect fidelity to the base model.
minicpm5-1b-Q8_0.gguf Q8_0 1.1 GB Maximum quantized quality; fast loading.
minicpm5-1b-f16.gguf F16 2.1 GB Unquantized master weight container.
🚀 Quick Start with llama.cpp

Because MiniCPM5-1B uses standard Llama architecture, it is fully supported by llama.cpp out of the box. No custom forks or kernels are required.

1. Interactive CLI

To run the model directly in your terminal using CPU threads:

./llama-cli -m minicpm5-1b-Q4_K_M.gguf -p "Artificial intelligence and local model deployment are transforming technology because" -n 256 -t 4

Runs of Abiray MiniCPM5-1B-GGUF on huggingface.co

1.0K
Total runs
23
24-hour runs
-75
3-day runs
-119
7-day runs
-2.9K
30-day runs

More Information About MiniCPM5-1B-GGUF huggingface.co Model

More MiniCPM5-1B-GGUF license Visit here:

https://choosealicense.com/licenses/apache-2.0

MiniCPM5-1B-GGUF huggingface.co

MiniCPM5-1B-GGUF huggingface.co is an AI model on huggingface.co that provides MiniCPM5-1B-GGUF's model effect (), which can be used instantly with this Abiray MiniCPM5-1B-GGUF model. huggingface.co supports a free trial of the MiniCPM5-1B-GGUF model, and also provides paid use of the MiniCPM5-1B-GGUF. Support call MiniCPM5-1B-GGUF model through api, including Node.js, Python, http.

MiniCPM5-1B-GGUF huggingface.co Url

https://huggingface.co/Abiray/MiniCPM5-1B-GGUF

Abiray MiniCPM5-1B-GGUF online free

MiniCPM5-1B-GGUF huggingface.co is an online trial and call api platform, which integrates MiniCPM5-1B-GGUF's modeling effects, including api services, and provides a free online trial of MiniCPM5-1B-GGUF, you can try MiniCPM5-1B-GGUF online for free by clicking the link below.

Abiray MiniCPM5-1B-GGUF online free url in huggingface.co:

https://huggingface.co/Abiray/MiniCPM5-1B-GGUF

MiniCPM5-1B-GGUF install

MiniCPM5-1B-GGUF is an open source model from GitHub that offers a free installation service, and any user can find MiniCPM5-1B-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of MiniCPM5-1B-GGUF install, users can directly use MiniCPM5-1B-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

MiniCPM5-1B-GGUF install url in huggingface.co:

https://huggingface.co/Abiray/MiniCPM5-1B-GGUF

Url of MiniCPM5-1B-GGUF

MiniCPM5-1B-GGUF huggingface.co Url

Provider of MiniCPM5-1B-GGUF huggingface.co

Abiray
ORGANIZATIONS

Other API from Abiray

huggingface.co

Total runs: 6.5K
Run Growth: -10.1K
Growth Rate: -153.13%
Updated:July 14 2026
huggingface.co

Total runs: 2.3K
Run Growth: -6.3K
Growth Rate: -266.78%
Updated:June 15 2026
huggingface.co

Total runs: 2.1K
Run Growth: -176
Growth Rate: -8.64%
Updated:May 16 2026
huggingface.co

Total runs: 753
Run Growth: 0
Growth Rate: 0.00%
Updated:September 13 2026