Abiray / Nanbeige4.2-3B-GGUF

huggingface.co
Total runs: 385
24-hour runs: -20
7-day runs: -140
30-day runs: -614
Model's Last Updated: July 22 2026
text-generation

Introduction of Nanbeige4.2-3B-GGUF

Model Details of Nanbeige4.2-3B-GGUF

Nanbeige4.2-3B - GGUF Quants

This repository contains GGUF quantizations for Nanbeige/Nanbeige4.2-3B .

  • Original Model: Nanbeige/Nanbeige4.2-3B
  • Base Architecture: Looped Transformer (3B non-embedding parameters)
  • Quantization Format: GGUF ( Q4_K_M , Q4_K_S , Q5_K_M , Q6_K , Q8_0 )

Available Files & Quantization Details
File Name Size Quant Method Description
Nanbeige4.2-3B-Q4_K_M.gguf ~2.57 GB Q4_K_M 4-bit medium. Recommended balance of speed, memory usage, and quality.
Nanbeige4.2-3B-Q4_K_S.gguf ~2.50 GB Q4_K_S 4-bit small. Slightly lower memory footprint.
Nanbeige4.2-3B-Q5_K_M.gguf ~2.99 GB Q5_K_M 5-bit medium. Higher precision with slight increase in size.
Nanbeige4.2-3B-Q6_K.gguf ~3.42 GB Q6_K 6-bit quantization. Very close to FP16 performance.
Nanbeige4.2-3B-Q8_0.gguf ~4.43 GB Q8_0 8-bit quantization. Maximum quality for GGUF.

Usage Guide
1. Running with llama.cpp

For full support, clone the official or nanbeige42 fork of llama.cpp :

# Clone the repository with Nanbeige support
git clone -b nanbeige42 [https://github.com/Nanbeige/llama.cpp.git](https://github.com/Nanbeige/llama.cpp.git)
cd llama.cpp

# Build with CUDA support
cmake -B build -DGGML_CUDA=ON
cmake --build build --config Release -j

# Download a model from this repository
huggingface-cli download Abiray/Nanbeige4.2-3B-GGUF Nanbeige4.2-3B-Q4_K_M.gguf --local-dir .

# Run CLI inference
./build/bin/llama-cli -m Nanbeige4.2-3B-Q4_K_M.gguf -ngl 99 -p "Which number is bigger, 9.11 or 9.8?"

Runs of Abiray Nanbeige4.2-3B-GGUF on huggingface.co

385
Total runs
-20
24-hour runs
-21
3-day runs
-140
7-day runs
-614
30-day runs

More Information About Nanbeige4.2-3B-GGUF huggingface.co Model

More Nanbeige4.2-3B-GGUF license Visit here:

https://choosealicense.com/licenses/apache-2.0

Nanbeige4.2-3B-GGUF huggingface.co

Nanbeige4.2-3B-GGUF huggingface.co is an AI model on huggingface.co that provides Nanbeige4.2-3B-GGUF's model effect (), which can be used instantly with this Abiray Nanbeige4.2-3B-GGUF model. huggingface.co supports a free trial of the Nanbeige4.2-3B-GGUF model, and also provides paid use of the Nanbeige4.2-3B-GGUF. Support call Nanbeige4.2-3B-GGUF model through api, including Node.js, Python, http.

Nanbeige4.2-3B-GGUF huggingface.co Url

https://huggingface.co/Abiray/Nanbeige4.2-3B-GGUF

Abiray Nanbeige4.2-3B-GGUF online free

Nanbeige4.2-3B-GGUF huggingface.co is an online trial and call api platform, which integrates Nanbeige4.2-3B-GGUF's modeling effects, including api services, and provides a free online trial of Nanbeige4.2-3B-GGUF, you can try Nanbeige4.2-3B-GGUF online for free by clicking the link below.

Abiray Nanbeige4.2-3B-GGUF online free url in huggingface.co:

https://huggingface.co/Abiray/Nanbeige4.2-3B-GGUF

Nanbeige4.2-3B-GGUF install

Nanbeige4.2-3B-GGUF is an open source model from GitHub that offers a free installation service, and any user can find Nanbeige4.2-3B-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of Nanbeige4.2-3B-GGUF install, users can directly use Nanbeige4.2-3B-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Nanbeige4.2-3B-GGUF install url in huggingface.co:

https://huggingface.co/Abiray/Nanbeige4.2-3B-GGUF

Url of Nanbeige4.2-3B-GGUF

Nanbeige4.2-3B-GGUF huggingface.co Url

Provider of Nanbeige4.2-3B-GGUF huggingface.co

Abiray
ORGANIZATIONS

Other API from Abiray

huggingface.co

Total runs: 257.9K
Run Growth: -788.6K
Growth Rate: -299.93%
Updated:August 08 2026
huggingface.co

Total runs: 8.8K
Run Growth: 6.7K
Growth Rate: 75.74%
Updated:June 15 2026
huggingface.co

Total runs: 3.9K
Run Growth: -2.5K
Growth Rate: -64.10%
Updated:July 14 2026
huggingface.co

Total runs: 1.6K
Run Growth: -565
Growth Rate: -34.41%
Updated:May 16 2026
huggingface.co

Total runs: 1.1K
Run Growth: -375
Growth Rate: -29.53%
Updated:September 13 2026
huggingface.co

Total runs: 150
Run Growth: 109
Growth Rate: 73.65%
Updated:August 02 2026