Total runs:
2.5K
Run Growth:
220
Growth Rate:
8.86%
Sponsored by
ThumbnailCreator.com
Locutusque / ChatHercules-2.5-Mistral-7B-DPO
Model's Last Updated: March 10 2024
text-generation
Introduction of ChatHercules-2.5-Mistral-7B-DPO
Model Details of ChatHercules-2.5-Mistral-7B-DPO
ChatHercules-2.5-Mistral-7B-DPO
ChatHercules-2.5-Mistral-7B is a merge of the following models using LazyMergekit :
I then use DPO to fine-tune the product of the merge on 20% of argilla/distilabel-intel-orca-dpo-pairs
🧩 Configuration
slices:
- sources:
- model: Locutusque/Hercules-2.5-Mistral-7B
layer_range: [0, 32]
- model: openchat/openchat-3.5-0106
layer_range: [0, 32]
merge_method: slerp
base_model: Locutusque/Hercules-2.5-Mistral-7B
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
dtype: bfloat16
💻 Usage
!pip install -qU transformers accelerate
from transformers import AutoTokenizer
import transformers
import torch
model = "hydra-project/ChatHercules-2.5-Mistral-7B"
messages = [{"role": "user", "content": "What is a large language model?"}]
tokenizer = AutoTokenizer.from_pretrained(model)
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
pipeline = transformers.pipeline(
"text-generation",
model=model,
torch_dtype=torch.float16,
device_map="auto",
)
outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
print(outputs[0]["generated_text"])
Evaluation results
Runs of Locutusque ChatHercules-2.5-Mistral-7B-DPO on huggingface.co
59
Total runs
0
24-hour runs
1
3-day runs
2
7-day runs
-7
30-day runs
More Information About ChatHercules-2.5-Mistral-7B-DPO huggingface.co Model
Url of ChatHercules-2.5-Mistral-7B-DPO
ChatHercules-2.5-Mistral-7B-DPO huggingface.co Url
Provider of ChatHercules-2.5-Mistral-7B-DPO huggingface.co
Other API from Locutusque
Updated:August 01 2023
Total runs:
1.1K
Run Growth:
25
Growth Rate:
2.33%
Total runs:
1.1K
Run Growth:
82
Growth Rate:
7.72%
Total runs:
1.1K
Run Growth:
-1.0K
Growth Rate:
-96.40%
Total runs:
1.0K
Run Growth:
-240
Growth Rate:
-22.90%
Total runs:
1.0K
Run Growth:
85
Growth Rate:
8.24%
Total runs:
1.0K
Run Growth:
60
Growth Rate:
5.90%
Total runs:
995
Run Growth:
-1.3K
Growth Rate:
-125.73%
Total runs:
866
Run Growth:
287
Growth Rate:
33.14%
Total runs:
845
Run Growth:
288
Growth Rate:
34.08%
Total runs:
832
Run Growth:
789
Growth Rate:
94.83%
Total runs:
247
Run Growth:
-55
Growth Rate:
-22.27%
Total runs:
229
Run Growth:
156
Growth Rate:
68.12%
Total runs:
157
Run Growth:
148
Growth Rate:
94.27%
Total runs:
145
Run Growth:
0
Growth Rate:
0.00%
Total runs:
111
Run Growth:
27
Growth Rate:
24.32%
Total runs:
108
Run Growth:
-250
Growth Rate:
-231.48%
Total runs:
101
Run Growth:
31
Growth Rate:
30.69%
Total runs:
99
Run Growth:
8
Growth Rate:
8.08%
Total runs:
88
Run Growth:
4
Growth Rate:
4.55%
Total runs:
85
Run Growth:
-5
Growth Rate:
-5.75%
Total runs:
78
Run Growth:
2
Growth Rate:
2.60%
Total runs:
75
Run Growth:
-3
Growth Rate:
-4.00%
Total runs:
73
Run Growth:
-2
Growth Rate:
-2.74%
Total runs:
72
Run Growth:
-1
Growth Rate:
-1.37%
Total runs:
72
Run Growth:
-1
Growth Rate:
-1.39%
Total runs:
71
Run Growth:
-4
Growth Rate:
-5.56%
Total runs:
68
Run Growth:
2
Growth Rate:
2.94%
Total runs:
68
Run Growth:
32
Growth Rate:
47.06%
Total runs:
67
Run Growth:
-5
Growth Rate:
-7.46%
Total runs:
67
Run Growth:
-4
Growth Rate:
-5.97%
Total runs:
67
Run Growth:
-11
Growth Rate:
-16.42%
Total runs:
66
Run Growth:
-10
Growth Rate:
-15.15%
Total runs:
61
Run Growth:
-3
Growth Rate:
-4.92%
Total runs:
60
Run Growth:
-7
Growth Rate:
-11.67%
Total runs:
58
Run Growth:
36
Growth Rate:
62.07%
Total runs:
55
Run Growth:
-9
Growth Rate:
-16.36%
Total runs:
47
Run Growth:
3
Growth Rate:
6.38%
Total runs:
45
Run Growth:
4
Growth Rate:
8.89%
Total runs:
43
Run Growth:
22
Growth Rate:
51.16%
Total runs:
39
Run Growth:
5
Growth Rate:
12.82%
Total runs:
38
Run Growth:
34
Growth Rate:
89.47%
Total runs:
37
Run Growth:
-3
Growth Rate:
-8.11%
Total runs:
36
Run Growth:
26
Growth Rate:
72.22%
Total runs:
36
Run Growth:
-2
Growth Rate:
-5.56%
Total runs:
36
Run Growth:
19
Growth Rate:
52.78%
Total runs:
34
Run Growth:
24
Growth Rate:
70.59%
Total runs:
34
Run Growth:
6
Growth Rate:
17.65%
Total runs:
33
Run Growth:
1
Growth Rate:
3.03%
Total runs:
29
Run Growth:
-4
Growth Rate:
-12.50%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23
Run Growth:
6
Growth Rate:
26.09%
Total runs:
22
Run Growth:
-3
Growth Rate:
-13.64%
Total runs:
22
Run Growth:
15
Growth Rate:
68.18%
Total runs:
19
Run Growth:
0
Growth Rate:
0.00%
Total runs:
16
Run Growth:
12
Growth Rate:
75.00%
Total runs:
16
Run Growth:
-1
Growth Rate:
-6.25%
Total runs:
14
Run Growth:
-2
Growth Rate:
-14.29%
Total runs:
14
Run Growth:
-4
Growth Rate:
-28.57%
Total runs:
12
Run Growth:
4
Growth Rate:
33.33%
Total runs:
12
Run Growth:
8
Growth Rate:
66.67%
Total runs:
11
Run Growth:
11
Growth Rate:
100.00%
Total runs:
11
Run Growth:
-4
Growth Rate:
-36.36%
Total runs:
10
Run Growth:
7
Growth Rate:
70.00%
Total runs:
10
Run Growth:
2
Growth Rate:
20.00%
Total runs:
10
Run Growth:
-4
Growth Rate:
-40.00%
Total runs:
10
Run Growth:
2
Growth Rate:
20.00%
Total runs:
9
Run Growth:
-20
Growth Rate:
-222.22%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
7
Run Growth:
-22
Growth Rate:
-314.29%
Total runs:
7
Run Growth:
-1
Growth Rate:
-14.29%
Total runs:
6
Run Growth:
-18
Growth Rate:
-300.00%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
1
Growth Rate:
20.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
4
Growth Rate:
100.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
-1
Growth Rate:
-33.33%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
3
Growth Rate:
100.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
1
Growth Rate:
50.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%