This repository contains custom
GGUF
format quantizations of the
openbmb/MiniCPM5-1B
model.
MiniCPM5-1B is a highly capable 1-billion parameter Transformer built for on-device, local deployment, and resource-constrained scenarios. It utilizes a standard
LlamaForCausalLM
architecture, features hybrid reasoning (built-in
<think>
tokens), and supports a massive 131k context window.
📦 Available Files and Quantizations
These models were quantized specifically for high-efficiency CPU/Edge inference using the
llama.cpp
framework.
Filename
Format
Size
Description
minicpm5-1b-Q4_K_M.gguf
Q4_K_M
657 MB
Excellent balance of performance and size.
(Recommended for 4GB RAM/Mobile)
minicpm5-1b-Q5_K_M.gguf
Q5_K_M
751 MB
Higher accuracy, slight increase in size.
minicpm5-1b-Q6_K.gguf
Q6_K
851 MB
Near-perfect fidelity to the base model.
minicpm5-1b-Q8_0.gguf
Q8_0
1.1 GB
Maximum quantized quality; fast loading.
minicpm5-1b-f16.gguf
F16
2.1 GB
Unquantized master weight container.
🚀 Quick Start with llama.cpp
Because MiniCPM5-1B uses standard Llama architecture, it is fully supported by
llama.cpp
out of the box. No custom forks or kernels are required.
1. Interactive CLI
To run the model directly in your terminal using CPU threads:
./llama-cli -m minicpm5-1b-Q4_K_M.gguf -p "Artificial intelligence and local model deployment are transforming technology because" -n 256 -t 4
Runs of Abiray MiniCPM5-1B-GGUF on huggingface.co
1.0K
Total runs
23
24-hour runs
-75
3-day runs
-119
7-day runs
-2.9K
30-day runs
More Information About MiniCPM5-1B-GGUF huggingface.co Model
MiniCPM5-1B-GGUF huggingface.co is an AI model on huggingface.co that provides MiniCPM5-1B-GGUF's model effect (), which can be used instantly with this Abiray MiniCPM5-1B-GGUF model. huggingface.co supports a free trial of the MiniCPM5-1B-GGUF model, and also provides paid use of the MiniCPM5-1B-GGUF. Support call MiniCPM5-1B-GGUF model through api, including Node.js, Python, http.
MiniCPM5-1B-GGUF huggingface.co is an online trial and call api platform, which integrates MiniCPM5-1B-GGUF's modeling effects, including api services, and provides a free online trial of MiniCPM5-1B-GGUF, you can try MiniCPM5-1B-GGUF online for free by clicking the link below.
Abiray MiniCPM5-1B-GGUF online free url in huggingface.co:
MiniCPM5-1B-GGUF is an open source model from GitHub that offers a free installation service, and any user can find MiniCPM5-1B-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of MiniCPM5-1B-GGUF install, users can directly use MiniCPM5-1B-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.