0xSero / GLM-5.1-444B

huggingface.co
Total runs: 35
24-hour runs: 0
7-day runs: -3
30-day runs: -3
Model's Last Updated: May 30 2026
text-generation

Introduction of GLM-5.1-444B

Model Details of GLM-5.1-444B

Support this work → · X · GitHub · REAP paper · Cerebras REAP

GLM-5.1-444B

REAP-pruned zai-org/GLM-5.1 .

At a glance
Base model zai-org/GLM-5.1
Format BF16
Total params 444B
Active / token 14B
Experts / layer 154
Layers 78
Hidden size 6144
Context 202,752
On-disk size 910 GB
Which variant should I pick?
Variant Format Link
GLM-5.1-444B (this) BF16 link
GLM-5.1-444B-GGUF GGUF link
GLM-5.1-478B-NVFP4 NVFP4 link
GLM-5.1-555B BF16 link
GLM-5.1-555B-GGUF GGUF link
GLM-5.1-555B-NVFP4 NVFP4 link
GLM-5.1-555B-W4A16 W4A16 link
Use the 25% pruned version instead: 0xSero/GLM-5.1-555B

For GGUF: 0xSero/GLM-5.1-555B-GGUF


GLM-5.1 - 40% Expert Pruned (REAP) - BF16

This is a 40% expert-pruned version of zai-org/GLM-5.1 using REAP .

Property Value
Base model zai-org/GLM-5.1
Architecture GlmMoeDsaForCausalLM
Routed experts 256 -> 154 (40% removed)
Active params/token ~14B (top-8 routing)
Precision BF16
Known Issues

This model enters repetition loops on ~29% of test probes when generating long-form code or structured output. Affected tasks include:

  • Complex code generation (red-black trees, B-trees, chess engines, regex engines)
  • Structured output (comparison tables, API specs, enum lists)
  • LaTeX-heavy math

The root cause is that removing 40% of experts exceeds the model's pruning tolerance. The 25% pruned variant (192/256 experts) eliminates all repetition loops.

Sibling Models
Model Prune % Status
0xSero/GLM-5.1-555B 25% Recommended
0xSero/GLM-5.1-555B-GGUF 25% Q4 GGUF Recommended
This repo 40% Has repetition issues
0xSero/GLM-5.1-444B-GGUF 40% Q4 GGUF BROKEN
License & citation

License inherited from the base model.

@misc{lasby2025reap,
  title  = {REAP the Experts: Why Pruning Prevails for One-Shot MoE Compression},
  author = {Mike Lasby and Ivan Lazarevich and Nish Sinnadurai and Sean Lie and Yani Ioannou and Vithursan Thangarasa},
  year   = {2025}, eprint = {2510.13999}, archivePrefix = {arXiv}
}
Sponsors

Made possible by NVIDIA · TNG Technology · Lambda · Prime Intellect · Hot Aisle .

Runs of 0xSero GLM-5.1-444B on huggingface.co

35
Total runs
0
24-hour runs
-1
3-day runs
-3
7-day runs
-3
30-day runs

More Information About GLM-5.1-444B huggingface.co Model

More GLM-5.1-444B license Visit here:

https://choosealicense.com/licenses/glm-5

GLM-5.1-444B huggingface.co

GLM-5.1-444B huggingface.co is an AI model on huggingface.co that provides GLM-5.1-444B's model effect (), which can be used instantly with this 0xSero GLM-5.1-444B model. huggingface.co supports a free trial of the GLM-5.1-444B model, and also provides paid use of the GLM-5.1-444B. Support call GLM-5.1-444B model through api, including Node.js, Python, http.

GLM-5.1-444B huggingface.co Url

https://huggingface.co/0xSero/GLM-5.1-444B

0xSero GLM-5.1-444B online free

GLM-5.1-444B huggingface.co is an online trial and call api platform, which integrates GLM-5.1-444B's modeling effects, including api services, and provides a free online trial of GLM-5.1-444B, you can try GLM-5.1-444B online for free by clicking the link below.

0xSero GLM-5.1-444B online free url in huggingface.co:

https://huggingface.co/0xSero/GLM-5.1-444B

GLM-5.1-444B install

GLM-5.1-444B is an open source model from GitHub that offers a free installation service, and any user can find GLM-5.1-444B on GitHub to install. At the same time, huggingface.co provides the effect of GLM-5.1-444B install, users can directly use GLM-5.1-444B installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

GLM-5.1-444B install url in huggingface.co:

https://huggingface.co/0xSero/GLM-5.1-444B

Url of GLM-5.1-444B

GLM-5.1-444B huggingface.co Url

Provider of GLM-5.1-444B huggingface.co

0xSero
ORGANIZATIONS

Other API from 0xSero

huggingface.co

Total runs: 820
Run Growth: 509
Growth Rate: 62.07%
Updated:May 30 2026
huggingface.co

Total runs: 357
Run Growth: -42
Growth Rate: -11.76%
Updated:June 26 2026
huggingface.co

Total runs: 113
Run Growth: 69
Growth Rate: 62.73%
Updated:May 30 2026
huggingface.co

Total runs: 100
Run Growth: 8
Growth Rate: 8.00%
Updated:May 30 2026
huggingface.co

Total runs: 66
Run Growth: 19
Growth Rate: 30.16%
Updated:May 30 2026
huggingface.co

Total runs: 50
Run Growth: 9
Growth Rate: 18.75%
Updated:May 30 2026