Total runs:
1.8M
Run Growth:
-325.6K
Growth Rate:
-18.15%
Sponsored by
APIMart
Salesforce / xgen-small-4B-instruct-r
Model's Last Updated: May 13 2025
text-generation
Introduction of xgen-small-4B-instruct-r
Model Details of xgen-small-4B-instruct-r
Welcome to the xGen-small family!
xGen-small ( blog , arXiv ) is an enterprise-ready compact LM that combines domain-focused data curation, scalable pre-training, length-extension, and RL fine-tuning to deliver long-context performance at predictable, low cost. This model release is for research purposes only.
Model Series
xGen-small comes in two sizes (4B and 9B) with two variants (pre-trained and post-trained):
| Model | # Total Params | Context Length | Variant | Download |
|---|---|---|---|---|
| salesforce/xgen-small-4B-base-r | 4B | 128k | Pre-trained | 🤗 Link |
| salesforce/xgen-small-4B-instruct-r | 4B | 128k | Post-trained | 🤗 Link |
| salesforce/xgen-small-9B-base-r | 9B | 128k | Pre-trained | 🤗 Link |
| salesforce/xgen-small-9B-instruct-r | 9B | 128k | Post-trained | 🤗 Link |
Usage
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "Salesforce/xgen-small-4B-instruct-r"
tokenizer = AutoTokenizer.from_pretrained(model_name)
device = "cuda" if torch.cuda.is_available() else "cpu"
model = AutoModelForCausalLM.from_pretrained(
model_name,
torch_dtype="auto"
).to(device)
prompt = "What is Salesforce?"
messages = [{"role": "user", "content": prompt}]
inputs = tokenizer.apply_chat_template(
messages,
add_generation_prompt=True,
return_tensors="pt"
).to(model.device)
generated = model.generate(inputs, max_new_tokens=128)
output = tokenizer.decode(
generated[0],
skip_special_tokens=True,
)
print(output)
Evaluation
| Category | Task | Llama 3.2-3B | Gemma 3-4B | Qwen2.5-3B | xGen-small 4B Instruct |
|---|---|---|---|---|---|
| General Knowledge & Reasoning | MMLU | 61.8 | 56.0 | 65.3 | 61.4 |
| General Knowledge & Reasoning | MMLU-Pro | 31.4 | 34.4 | 33.3 | 43.6 |
| Chat | Arena-Hard-v1.0 | 14.7 | 57.6 | 26.9 | 34.2 |
| Chat | MT-Bench | 7.81 | 8.29 | 7.93 | 8.05 |
| Math & Science | GPQA | 29.7 | 31.5 | 31.9 | 35.9 |
| Math & Science | GSM8K | 72.3 | 90.7 | 86.3 | 92.0 |
| Math & Science | MATH | 44.6 | 73.7 | 67.3 | 83.8 |
| Math & Science | AIME 2024 | 3.3 | 10.0 | 10.0 | 30.0 |
| Coding | HumanEval+ | 48.8 | 63.4 | 67.7 | 74.4 |
| Coding | MBPP+ | 52.1 | 66.9 | 61.9 | 52.6 |
| Coding | LiveCodeBench | 7.4 | 13.6 | 10.1 | 32.6 |
Citation
@misc{xgensmall,
title={xGen-small Technical Report},
author={Erik Nijkamp and Bo Pang and Egor Pakhomov and Akash Gokul and Jin Qu and Silvio Savarese and Yingbo Zhou and Caiming Xiong},
year={2025},
eprint={2505.06496},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2505.06496},
}
Ethical Considerations
This release is for research purposes only in support of an academic paper. Our models, datasets, and code are not specifically designed or evaluated for all downstream purposes. We strongly recommend users evaluate and address potential concerns related to accuracy, safety, and fairness before deploying this model. We encourage users to consider the common limitations of AI, comply with applicable laws, and leverage best practices when selecting use cases, particularly for high-risk scenarios where errors or misuse could significantly impact people's lives, rights, or safety. For further guidance on use cases, refer to our AUP and AI AUP.
Model Licenses
The models are being released under CC-BY-NC-4.0, Copyright © Salesforce, Inc. All Rights Reserved.
Runs of Salesforce xgen-small-4B-instruct-r on huggingface.co
392
Total runs
0
24-hour runs
35
3-day runs
-18
7-day runs
-18
30-day runs
More Information About xgen-small-4B-instruct-r huggingface.co Model
Url of xgen-small-4B-instruct-r
xgen-small-4B-instruct-r huggingface.co Url
Provider of xgen-small-4B-instruct-r huggingface.co
Other API from Salesforce
Updated:February 03 2025
Total runs:
932.1K
Run Growth:
-220.3K
Growth Rate:
-23.63%
Total runs:
664.5K
Run Growth:
118.4K
Growth Rate:
17.83%
Total runs:
598.8K
Run Growth:
101.4K
Growth Rate:
16.93%
Total runs:
539.0K
Run Growth:
8.2K
Growth Rate:
1.52%
Total runs:
514.6K
Run Growth:
33.8K
Growth Rate:
6.57%
Total runs:
221.3K
Run Growth:
17.1K
Growth Rate:
7.71%
Total runs:
180.0K
Run Growth:
35.3K
Growth Rate:
19.62%
Total runs:
144.0K
Run Growth:
-99.5K
Growth Rate:
-69.08%
Total runs:
130.6K
Run Growth:
-236
Growth Rate:
-0.18%
Total runs:
122.7K
Run Growth:
42.9K
Growth Rate:
33.83%
Total runs:
97.1K
Run Growth:
37.6K
Growth Rate:
38.70%
Total runs:
93.6K
Run Growth:
48.3K
Growth Rate:
51.57%
Total runs:
48.0K
Run Growth:
4.1K
Growth Rate:
8.46%
Total runs:
37.0K
Run Growth:
37.0K
Growth Rate:
99.94%
Total runs:
33.9K
Run Growth:
8.4K
Growth Rate:
24.56%
Total runs:
33.1K
Run Growth:
15.5K
Growth Rate:
46.97%
Total runs:
32.8K
Run Growth:
28.0K
Growth Rate:
85.48%
Total runs:
23.1K
Run Growth:
-2.0K
Growth Rate:
-8.72%
Total runs:
18.8K
Run Growth:
2.2K
Growth Rate:
11.61%
Total runs:
18.2K
Run Growth:
4.1K
Growth Rate:
22.55%
Total runs:
17.9K
Run Growth:
-53.1K
Growth Rate:
-296.70%
Total runs:
17.5K
Run Growth:
515
Growth Rate:
2.95%
Total runs:
17.4K
Run Growth:
-27.2K
Growth Rate:
-156.30%
Total runs:
15.5K
Run Growth:
-15.4K
Growth Rate:
-99.01%
Total runs:
13.4K
Run Growth:
-8.5K
Growth Rate:
-63.96%
Total runs:
12.4K
Run Growth:
9.4K
Growth Rate:
75.93%
Total runs:
12.3K
Run Growth:
5.7K
Growth Rate:
46.13%
Total runs:
11.8K
Run Growth:
-2.2K
Growth Rate:
-18.70%
Total runs:
11.1K
Run Growth:
-71.6K
Growth Rate:
-645.75%
Total runs:
9.9K
Run Growth:
-1.3K
Growth Rate:
-12.87%
Total runs:
7.2K
Run Growth:
4.3K
Growth Rate:
60.37%
Total runs:
6.2K
Run Growth:
4.7K
Growth Rate:
75.74%
Total runs:
3.5K
Run Growth:
-170
Growth Rate:
-4.84%
Total runs:
3.5K
Run Growth:
2.1K
Growth Rate:
60.11%
Total runs:
3.2K
Run Growth:
-2.2K
Growth Rate:
-70.52%
Total runs:
2.3K
Run Growth:
365
Growth Rate:
15.93%
Total runs:
2.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.1K
Run Growth:
1.3K
Growth Rate:
60.34%
Total runs:
1.5K
Run Growth:
183
Growth Rate:
11.88%
Total runs:
1.2K
Run Growth:
-4.8K
Growth Rate:
-416.31%
Total runs:
1.2K
Run Growth:
551
Growth Rate:
47.54%
Total runs:
1.0K
Run Growth:
-290
Growth Rate:
-28.32%
Total runs:
946
Run Growth:
312
Growth Rate:
30.32%
Total runs:
899
Run Growth:
-328
Growth Rate:
-36.48%
Total runs:
832
Run Growth:
663
Growth Rate:
79.21%
Total runs:
772
Run Growth:
-429
Growth Rate:
-55.57%
Total runs:
748
Run Growth:
-58
Growth Rate:
-7.75%
Total runs:
741
Run Growth:
-80
Growth Rate:
-10.80%
Total runs:
670
Run Growth:
106
Growth Rate:
15.82%
Total runs:
611
Run Growth:
-63
Growth Rate:
-10.31%
Total runs:
594
Run Growth:
89
Growth Rate:
14.98%
Total runs:
550
Run Growth:
38
Growth Rate:
6.75%
Total runs:
540
Run Growth:
433
Growth Rate:
80.19%
Total runs:
540
Run Growth:
-1.3K
Growth Rate:
-230.22%
Total runs:
532
Run Growth:
92
Growth Rate:
17.29%
Total runs:
414
Run Growth:
146
Growth Rate:
35.27%
Total runs:
409
Run Growth:
-221
Growth Rate:
-54.03%
Total runs:
355
Run Growth:
89
Growth Rate:
25.07%
Total runs:
354
Run Growth:
107
Growth Rate:
30.23%
Total runs:
352
Run Growth:
-857
Growth Rate:
-243.47%
Total runs:
343
Run Growth:
-26
Growth Rate:
-7.58%
Total runs:
313
Run Growth:
-711
Growth Rate:
-227.16%
Total runs:
313
Run Growth:
28
Growth Rate:
8.95%
Total runs:
309
Run Growth:
168
Growth Rate:
54.37%
Total runs:
295
Run Growth:
38
Growth Rate:
12.93%
Total runs:
293
Run Growth:
-19
Growth Rate:
-6.48%
Total runs:
281
Run Growth:
-7
Growth Rate:
-2.49%
Total runs:
269
Run Growth:
-328
Growth Rate:
-121.93%
Total runs:
250
Run Growth:
238
Growth Rate:
95.20%
Total runs:
248
Run Growth:
-510
Growth Rate:
-205.65%
Total runs:
243
Run Growth:
20
Growth Rate:
8.23%
Total runs:
185
Run Growth:
-28
Growth Rate:
-15.14%
Total runs:
173
Run Growth:
42
Growth Rate:
24.28%
Total runs:
161
Run Growth:
-129
Growth Rate:
-80.12%
Total runs:
159
Run Growth:
43
Growth Rate:
27.04%
Total runs:
155
Run Growth:
40
Growth Rate:
25.81%
Total runs:
150
Run Growth:
-7
Growth Rate:
-4.67%
Total runs:
149
Run Growth:
-39
Growth Rate:
-26.17%
Total runs:
143
Run Growth:
23
Growth Rate:
16.08%
Total runs:
130
Run Growth:
67
Growth Rate:
51.54%
Total runs:
102
Run Growth:
-638
Growth Rate:
-625.49%
Total runs:
89
Run Growth:
28
Growth Rate:
31.46%