0xSero / INTELLECT-3-REAP-50

huggingface.co
Total runs: 48
24-hour runs: 0
7-day runs: 6
30-day runs: 6
Model's Last Updated: March 20 2026
text-generation

Introduction of INTELLECT-3-REAP-50

Model Details of INTELLECT-3-REAP-50

INTELLECT-3-REAP-50

50% expert-pruned version of PrimeIntellect/INTELLECT-3 using Cerebras REAP (Router-weighted Expert Activation Pruning).

Model Details
Property Value
Base Model PrimeIntellect/INTELLECT-3 (248B MoE)
Architecture GLM-4 MoE (glm4_moe)
Compression 50% (64 experts pruned)
Remaining Experts 64 per layer
Parameters ~124B
Format BF16 SafeTensors
Size 107 GB
REAP Configuration
dataset: 0xSero/glm47-reap-calibration-v2
samples: 1360
  - evol-codealpaca-v1: 700 (code generation)
  - xlam-function-calling-60k: 330 (function calling)
  - SWE-smith-trajectories: 330 (agentic multi-turn)
distance_measure: angular
seed: 42
model_max_length: 2048
compression_ratio: 0.50
prune_method: reap
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "0xSero/INTELLECT-3-REAP-50",
    torch_dtype="auto",
    device_map="auto",
    trust_remote_code=True
)
tokenizer = AutoTokenizer.from_pretrained("0xSero/INTELLECT-3-REAP-50", trust_remote_code=True)

messages = [{"role": "user", "content": "Write a Python function to calculate fibonacci numbers"}]
inputs = tokenizer.apply_chat_template(messages, return_tensors="pt", add_generation_prompt=True).to(model.device)
outputs = model.generate(inputs, max_new_tokens=512)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
Related Models
Model Compression Format Size
INTELLECT-3-REAP-50 50% BF16 107GB
INTELLECT-3-REAP-50-W4A16 50% W4A16 GPTQ ~30GB (coming soon)
Citation
@article{cerebras2025reap,
  title={REAP: Router-weighted Expert Activation Pruning for MoE Models},
  author={Cerebras Systems},
  year={2025}
}
Acknowledgments

This model was created as part of efficiency research for large MoE models.

Runs of 0xSero INTELLECT-3-REAP-50 on huggingface.co

48
Total runs
0
24-hour runs
0
3-day runs
6
7-day runs
6
30-day runs

More Information About INTELLECT-3-REAP-50 huggingface.co Model

More INTELLECT-3-REAP-50 license Visit here:

https://choosealicense.com/licenses/apache-2.0

INTELLECT-3-REAP-50 huggingface.co

INTELLECT-3-REAP-50 huggingface.co is an AI model on huggingface.co that provides INTELLECT-3-REAP-50's model effect (), which can be used instantly with this 0xSero INTELLECT-3-REAP-50 model. huggingface.co supports a free trial of the INTELLECT-3-REAP-50 model, and also provides paid use of the INTELLECT-3-REAP-50. Support call INTELLECT-3-REAP-50 model through api, including Node.js, Python, http.

INTELLECT-3-REAP-50 huggingface.co Url

https://huggingface.co/0xSero/INTELLECT-3-REAP-50

0xSero INTELLECT-3-REAP-50 online free

INTELLECT-3-REAP-50 huggingface.co is an online trial and call api platform, which integrates INTELLECT-3-REAP-50's modeling effects, including api services, and provides a free online trial of INTELLECT-3-REAP-50, you can try INTELLECT-3-REAP-50 online for free by clicking the link below.

0xSero INTELLECT-3-REAP-50 online free url in huggingface.co:

https://huggingface.co/0xSero/INTELLECT-3-REAP-50

INTELLECT-3-REAP-50 install

INTELLECT-3-REAP-50 is an open source model from GitHub that offers a free installation service, and any user can find INTELLECT-3-REAP-50 on GitHub to install. At the same time, huggingface.co provides the effect of INTELLECT-3-REAP-50 install, users can directly use INTELLECT-3-REAP-50 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

INTELLECT-3-REAP-50 install url in huggingface.co:

https://huggingface.co/0xSero/INTELLECT-3-REAP-50

Url of INTELLECT-3-REAP-50

INTELLECT-3-REAP-50 huggingface.co Url

Provider of INTELLECT-3-REAP-50 huggingface.co

0xSero
ORGANIZATIONS

Other API from 0xSero

huggingface.co

Total runs: 820
Run Growth: 509
Growth Rate: 62.07%
Updated:May 30 2026
huggingface.co

Total runs: 357
Run Growth: -42
Growth Rate: -11.76%
Updated:June 26 2026
huggingface.co

Total runs: 100
Run Growth: 8
Growth Rate: 8.00%
Updated:May 30 2026
huggingface.co

Total runs: 87
Run Growth: 57
Growth Rate: 70.37%
Updated:May 30 2026
huggingface.co

Total runs: 64
Run Growth: 24
Growth Rate: 40.00%
Updated:May 30 2026
huggingface.co

Total runs: 61
Run Growth: 32
Growth Rate: 54.24%
Updated:May 30 2026
huggingface.co

Total runs: 45
Run Growth: 20
Growth Rate: 46.51%
Updated:May 30 2026
huggingface.co

Total runs: 36
Run Growth: 25
Growth Rate: 71.43%
Updated:May 30 2026