Sponsored by
Vmake Labs Video Enhancer
amphora / r1-orpo-2e-5
Model's Last Updated: September 18 2025
text-generation
Introduction of r1-orpo-2e-5
Model Details of r1-orpo-2e-5
Model Card for r1-orpo-2e-5
This model is a fine-tuned version of deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B . It has been trained using TRL .
Quick start
from transformers import pipeline
question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
generator = pipeline("text-generation", model="amphora/r1-orpo-2e-5", device="cuda")
output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
print(output["generated_text"])
Training procedure
This model was trained with ORPO, a method introduced in ORPO: Monolithic Preference Optimization without Reference Model .
Framework versions
- TRL: 0.21.0
- Transformers: 4.55.2
- Pytorch: 2.6.0+cu126
- Datasets: 4.0.0
- Tokenizers: 0.21.4
Citations
Cite ORPO as:
@article{hong2024orpo,
title = {{ORPO: Monolithic Preference Optimization without Reference Model}},
author = {Jiwoo Hong and Noah Lee and James Thorne},
year = 2024,
eprint = {arXiv:2403.07691}
}
Cite TRL as:
@misc{vonwerra2022trl,
title = {{TRL: Transformer Reinforcement Learning}},
author = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallou{\'e}dec},
year = 2020,
journal = {GitHub repository},
publisher = {GitHub},
howpublished = {\url{https://github.com/huggingface/trl}}
}
Runs of amphora r1-orpo-2e-5 on huggingface.co
11
Total runs
0
24-hour runs
2
3-day runs
3
7-day runs
5
30-day runs
More Information About r1-orpo-2e-5 huggingface.co Model
Url of r1-orpo-2e-5
r1-orpo-2e-5 huggingface.co Url
Provider of r1-orpo-2e-5 huggingface.co
Other API from amphora
Total runs:
1.1K
Run Growth:
-89
Growth Rate:
-8.00%
Total runs:
347
Run Growth:
0
Growth Rate:
0.00%
Total runs:
50
Run Growth:
-53
Growth Rate:
-106.00%
Total runs:
48
Run Growth:
-449
Growth Rate:
-935.42%
Total runs:
27
Run Growth:
-466
Growth Rate:
-1725.93%
Total runs:
21
Run Growth:
-71
Growth Rate:
-338.10%
Total runs:
18
Run Growth:
15
Growth Rate:
83.33%
Total runs:
16
Run Growth:
16
Growth Rate:
100.00%
Total runs:
15
Run Growth:
-165
Growth Rate:
-1100.00%
Total runs:
14
Run Growth:
-27
Growth Rate:
-192.86%
Total runs:
14
Run Growth:
-37
Growth Rate:
-264.29%
Total runs:
14
Run Growth:
-36
Growth Rate:
-257.14%
Total runs:
13
Run Growth:
7
Growth Rate:
53.85%
Total runs:
11
Run Growth:
-1
Growth Rate:
-9.09%
Total runs:
11
Run Growth:
-6
Growth Rate:
-54.55%
Total runs:
10
Run Growth:
3
Growth Rate:
30.00%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
7
Run Growth:
1
Growth Rate:
14.29%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
-1
Growth Rate:
-50.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%