Total runs:
84
Run Growth:
84
Growth Rate:
100.00%
Sponsored by
APIMart
G-reen / EXPERIMENT-DPO-m7b2-1-merged
Model's Last Updated: April 16 2024
text-generation
Introduction of EXPERIMENT-DPO-m7b2-1-merged
Model Details of EXPERIMENT-DPO-m7b2-1-merged
This model was trained as part of a series of experiments testing the performance of pure DPO vs SFT vs ORPO, all supported by Unsloth/Huggingface TRL.
Note: Completely broken. Do not use.
Benchmarks
Average 59.52
ARC 59.47
HellaSwag 82.42
MMLU 62.21
TruthfulQA 40.01
Winogrande 78.3
GSM8K 34.72
Training Details
Duration: ~10-12 hours on one Kaggle T4 with Unsloth
Model: https://huggingface.co/unsloth/mistral-7b-v0.2-bnb-4bit
Dataset: https://huggingface.co/datasets/argilla/dpo-mix-7k
Rank: 8
Alpha: 16
Learning rate: 5e-6
Beta: 0.1
Batch size: 8
Epochs: 1
Learning rate scheduler: Linear
Prompt Format:
You are a helpful assistant.<s>[INST] PROMPT [/INST]RESPONSE</s>
(The start token <s> must be added manually and not automatically)
WanDB Reports
Runs of G-reen EXPERIMENT-DPO-m7b2-1-merged on huggingface.co
54
Total runs
0
24-hour runs
-1
3-day runs
-5
7-day runs
-21
30-day runs
More Information About EXPERIMENT-DPO-m7b2-1-merged huggingface.co Model
Url of EXPERIMENT-DPO-m7b2-1-merged
EXPERIMENT-DPO-m7b2-1-merged huggingface.co Url
Provider of EXPERIMENT-DPO-m7b2-1-merged huggingface.co
Other API from G-reen
Updated:December 27 2025
Total runs:
60
Run Growth:
5
Growth Rate:
8.33%
Total runs:
60
Run Growth:
-3
Growth Rate:
-5.00%
Total runs:
55
Run Growth:
1
Growth Rate:
1.82%
Total runs:
53
Run Growth:
-4
Growth Rate:
-7.55%
Total runs:
52
Run Growth:
24
Growth Rate:
46.15%
Total runs:
37
Run Growth:
24
Growth Rate:
61.54%
Total runs:
35
Run Growth:
0
Growth Rate:
0.00%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
26
Run Growth:
20
Growth Rate:
76.92%
Total runs:
25
Run Growth:
25
Growth Rate:
100.00%
Total runs:
23
Run Growth:
16
Growth Rate:
66.67%
Total runs:
21
Run Growth:
15
Growth Rate:
71.43%
Total runs:
17
Run Growth:
11
Growth Rate:
64.71%
Total runs:
17
Run Growth:
5
Growth Rate:
29.41%
Total runs:
15
Run Growth:
9
Growth Rate:
60.00%
Total runs:
14
Run Growth:
9
Growth Rate:
64.29%
Total runs:
13
Run Growth:
0
Growth Rate:
0.00%
Total runs:
13
Run Growth:
8
Growth Rate:
61.54%
Total runs:
12
Run Growth:
4
Growth Rate:
40.00%
Total runs:
12
Run Growth:
7
Growth Rate:
63.64%
Total runs:
12
Run Growth:
10
Growth Rate:
76.92%
Total runs:
11
Run Growth:
6
Growth Rate:
60.00%
Total runs:
10
Run Growth:
8
Growth Rate:
80.00%
Total runs:
9
Run Growth:
6
Growth Rate:
66.67%
Total runs:
9
Run Growth:
-1
Growth Rate:
-11.11%
Total runs:
8
Run Growth:
6
Growth Rate:
75.00%
Total runs:
7
Run Growth:
-6
Growth Rate:
-85.71%
Total runs:
7
Run Growth:
5
Growth Rate:
55.56%
Total runs:
7
Run Growth:
2
Growth Rate:
28.57%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6
Run Growth:
3
Growth Rate:
50.00%
Total runs:
6
Run Growth:
-2
Growth Rate:
-33.33%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
-12
Growth Rate:
-240.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
-2
Growth Rate:
-40.00%
Total runs:
4
Run Growth:
-44
Growth Rate:
-1100.00%
Total runs:
4
Run Growth:
1
Growth Rate:
20.00%
Total runs:
4
Run Growth:
-4
Growth Rate:
-100.00%
Total runs:
4
Run Growth:
1
Growth Rate:
20.00%
Total runs:
3
Run Growth:
-21
Growth Rate:
-700.00%
Total runs:
3
Run Growth:
-9
Growth Rate:
-300.00%
Total runs:
3
Run Growth:
-10
Growth Rate:
-333.33%
Total runs:
3
Run Growth:
-1
Growth Rate:
-25.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%