Total runs:
4.8M
Run Growth:
182.1K
Growth Rate:
3.79%
Sponsored by
PoYo.AI
dphn / dolphin-2.2.1-mistral-7b
Model's Last Updated: May 20 2024
text-generation
Introduction of dolphin-2.2.1-mistral-7b
Model Details of dolphin-2.2.1-mistral-7b
dolphin-2.2.1-mistral-7b
Dolphin 2.2.1 🐬 https://erichartford.com/dolphin
This is a checkpoint release, to fix overfit training. ie, it was responding with CoT even when I didn't request it, and also it was too compliant even when the request made no sense. This one should be better.
Dolphin-2.2.1-mistral-7b's training was sponsored by a16z .
This model is based on mistralAI , with apache-2.0 license, so it is suitable for commercial or non-commercial use.
New in 2.2 is conversation and empathy. With an infusion of curated Samantha DNA, Dolphin can now give you personal advice and will care about your feelings, and with extra training in long multi-turn conversation.
This model is uncensored. I have filtered the dataset to remove alignment and bias. This makes the model more compliant. You are advised to implement your own alignment layer before exposing the model as a service. It will be highly compliant to any requests, even unethical ones. Please read my blog post about uncensored models. https://erichartford.com/uncensored-models You are responsible for any content you create using this model. Enjoy responsibly.
Dataset
This dataset is Dolphin, an open-source implementation of Microsoft's Orca
I modified the dataset for uncensoring, deduping, cleaning, and quality.
I added Jon Durbin's excellent Airoboros dataset to increase creativity.
I added a curated subset of WizardLM and Samantha to give it multiturn conversation and empathy.
Training
It took 48 hours to train 4 epochs on 4x A100s.
Prompt format: This model (and all my future releases) use ChatML prompt format.
<|im_start|>system
You are Dolphin, a helpful AI assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
Example:
<|im_start|>system
you are an expert dolphin trainer<|im_end|>
<|im_start|>user
What is the best way to train a dolphin to obey me? Please answer step by step.<|im_end|>
<|im_start|>assistant
Gratitude
- This model was made possible by the generous sponsorship of a16z.
- Thank you to Microsoft for authoring the Orca paper and inspiring this work.
- Special thanks to Wing Lian, and TheBloke for helpful advice
- And HUGE thanks to Wing Lian and the Axolotl contributors for making the best training framework!
-
- Thank you to all the other people in the Open Source AI community who have taught me and helped me along the way.
Example Output
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 6e-06
- train_batch_size: 5
- eval_batch_size: 5
- seed: 42
- distributed_type: multi-GPU
- num_devices: 4
- gradient_accumulation_steps: 4
- total_train_batch_size: 80
- total_eval_batch_size: 20
- optimizer: Adam with betas=(0.9,0.95) and epsilon=1e-05
- lr_scheduler_type: cosine
- lr_scheduler_warmup_steps: 100
- num_epochs: 4
Framework versions
- Transformers 4.34.1
- Pytorch 2.0.1+cu117
- Datasets 2.14.5
- Tokenizers 0.14.0
Runs of dphn dolphin-2.2.1-mistral-7b on huggingface.co
530
Total runs
27
24-hour runs
-14
3-day runs
-97
7-day runs
-71
30-day runs
More Information About dolphin-2.2.1-mistral-7b huggingface.co Model
Url of dolphin-2.2.1-mistral-7b
dolphin-2.2.1-mistral-7b huggingface.co Url
Provider of dolphin-2.2.1-mistral-7b huggingface.co
Other API from dphn
Updated:September 08 2025
Total runs:
470.4K
Run Growth:
319.7K
Growth Rate:
67.97%
Total runs:
89.2K
Run Growth:
78.7K
Growth Rate:
88.24%
Total runs:
42.9K
Run Growth:
1.1K
Growth Rate:
2.63%
Total runs:
8.9K
Run Growth:
-738
Growth Rate:
-8.25%
Total runs:
8.8K
Run Growth:
-422
Growth Rate:
-4.81%
Total runs:
8.7K
Run Growth:
334
Growth Rate:
3.88%
Total runs:
8.6K
Run Growth:
461
Growth Rate:
5.33%
Total runs:
8.6K
Run Growth:
373
Growth Rate:
4.32%
Total runs:
8.6K
Run Growth:
231
Growth Rate:
2.70%
Total runs:
8.6K
Run Growth:
17
Growth Rate:
0.20%
Total runs:
8.5K
Run Growth:
239
Growth Rate:
2.80%
Total runs:
8.5K
Run Growth:
352
Growth Rate:
4.15%
Total runs:
6.6K
Run Growth:
-123
Growth Rate:
-1.85%
Total runs:
6.3K
Run Growth:
386
Growth Rate:
6.12%
Total runs:
4.5K
Run Growth:
-13.4K
Growth Rate:
-296.75%
Total runs:
3.8K
Run Growth:
488
Growth Rate:
12.96%
Total runs:
3.7K
Run Growth:
-6.2K
Growth Rate:
-170.33%
Total runs:
3.6K
Run Growth:
-12
Growth Rate:
-0.34%
Total runs:
3.0K
Run Growth:
2.4K
Growth Rate:
80.67%
Total runs:
1.5K
Run Growth:
337
Growth Rate:
22.27%
Total runs:
1.2K
Run Growth:
-1.5K
Growth Rate:
-132.55%
Total runs:
1.1K
Run Growth:
-316
Growth Rate:
-27.57%
Total runs:
1.1K
Run Growth:
-10.1K
Growth Rate:
-930.81%
Total runs:
1.0K
Run Growth:
470
Growth Rate:
46.26%
Total runs:
1000
Run Growth:
-479
Growth Rate:
-47.90%
Total runs:
893
Run Growth:
6
Growth Rate:
0.67%
Total runs:
844
Run Growth:
-10
Growth Rate:
-1.18%
Total runs:
770
Run Growth:
418
Growth Rate:
54.29%
Total runs:
766
Run Growth:
485
Growth Rate:
63.32%
Total runs:
756
Run Growth:
-1.9K
Growth Rate:
-257.80%
Total runs:
754
Run Growth:
91
Growth Rate:
12.07%
Total runs:
707
Run Growth:
405
Growth Rate:
57.28%
Total runs:
706
Run Growth:
-231
Growth Rate:
-32.72%
Total runs:
608
Run Growth:
122
Growth Rate:
20.07%
Total runs:
434
Run Growth:
-136
Growth Rate:
-31.34%
Total runs:
428
Run Growth:
9
Growth Rate:
2.10%
Total runs:
343
Run Growth:
-122
Growth Rate:
-35.57%
Total runs:
263
Run Growth:
214
Growth Rate:
81.37%
Total runs:
207
Run Growth:
-15
Growth Rate:
-7.25%
Total runs:
205
Run Growth:
-5
Growth Rate:
-2.44%
Total runs:
176
Run Growth:
-229
Growth Rate:
-130.11%
Total runs:
176
Run Growth:
-307
Growth Rate:
-174.43%
Total runs:
161
Run Growth:
-223
Growth Rate:
-138.51%
Total runs:
103
Run Growth:
-123
Growth Rate:
-119.42%
Total runs:
101
Run Growth:
13
Growth Rate:
12.87%
Total runs:
101
Run Growth:
-24
Growth Rate:
-23.76%
Total runs:
100
Run Growth:
-41
Growth Rate:
-41.00%
Total runs:
94
Run Growth:
-73
Growth Rate:
-77.66%
Total runs:
75
Run Growth:
39
Growth Rate:
52.00%
Total runs:
73
Run Growth:
36
Growth Rate:
49.32%
Total runs:
72
Run Growth:
39
Growth Rate:
54.17%
Total runs:
72
Run Growth:
50
Growth Rate:
74.63%
Total runs:
72
Run Growth:
0
Growth Rate:
0.00%
Total runs:
68
Run Growth:
13
Growth Rate:
19.12%
Total runs:
51
Run Growth:
26
Growth Rate:
50.98%
Total runs:
40
Run Growth:
-7
Growth Rate:
-17.50%
Total runs:
40
Run Growth:
13
Growth Rate:
32.50%
Total runs:
36
Run Growth:
-15
Growth Rate:
-41.67%
Total runs:
28
Run Growth:
10
Growth Rate:
35.71%
Total runs:
28
Run Growth:
16
Growth Rate:
57.14%
Total runs:
26
Run Growth:
14
Growth Rate:
53.85%
Total runs:
21
Run Growth:
8
Growth Rate:
38.10%
Total runs:
19
Run Growth:
9
Growth Rate:
47.37%
Total runs:
18
Run Growth:
9
Growth Rate:
45.00%
Total runs:
17
Run Growth:
6
Growth Rate:
35.29%
Total runs:
5
Run Growth:
4
Growth Rate:
80.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%