Total runs:
357.6K
Run Growth:
-69.4K
Growth Rate:
-19.40%
Sponsored by
YouArt
mlabonne / Daredevil-8B
Model's Last Updated: January 07 2025
text-generation
Introduction of Daredevil-8B
Model Details of Daredevil-8B
Daredevil-8B
Daredevil-8B is a mega-merge designed to maximize MMLU. On 27 May 24, it is the Llama 3 8B model with the highest MMLU score . From my experience, a high MMLU score is all you need with Llama 3 models.
It is a merge of the following models using LazyMergekit :
- nbeerbower/llama-3-stella-8B
- Hastagaras/llama-3-8b-okay
- nbeerbower/llama-3-gutenberg-8B
- openchat/openchat-3.6-8b-20240522
- Kukedlc/NeuralLLaMa-3-8b-DT-v0.1
- cstr/llama3-8b-spaetzle-v20
- mlabonne/ChimeraLlama-3-8B-v3
- flammenai/Mahou-1.1-llama3-8B
- KingNish/KingNish-Llama3-8b
Thanks to nbeerbower, Hastagaras, openchat, Kukedlc, cstr, flammenai, and KingNish for their merges. Special thanks to Charles Goddard and Arcee.ai for MergeKit.
🔎 Applications
You can use it as an improved version of meta-llama/Meta-Llama-3-8B-Instruct .
This is a censored model. For an uncensored version, see mlabonne/Daredevil-8B-abliterated .
Tested on LM Studio using the "Llama 3" preset.
⚡ Quantization
🏆 Evaluation
Open LLM Leaderboard
Daredevil-8B is the best-performing 8B model on the Open LLM Leaderboard in terms of MMLU score (27 May 24).
Nous
Daredevil-8B is the best-performing 8B model on Nous' benchmark suite (evaluation performed using LLM AutoEval , 27 May 24). See the entire leaderboard here .
| Model | Average | AGIEval | GPT4All | TruthfulQA | Bigbench |
|---|---|---|---|---|---|
| mlabonne/Daredevil-8B 📄 | 55.87 | 44.13 | 73.52 | 59.05 | 46.77 |
| mlabonne/Daredevil-8B-abliterated 📄 | 55.06 | 43.29 | 73.33 | 57.47 | 46.17 |
| mlabonne/Llama-3-8B-Instruct-abliterated-dpomix 📄 | 52.26 | 41.6 | 69.95 | 54.22 | 43.26 |
| meta-llama/Meta-Llama-3-8B-Instruct 📄 | 51.34 | 41.22 | 69.86 | 51.65 | 42.64 |
| failspy/Meta-Llama-3-8B-Instruct-abliterated-v3 📄 | 51.21 | 40.23 | 69.5 | 52.44 | 42.69 |
| mlabonne/OrpoLlama-3-8B 📄 | 48.63 | 34.17 | 70.59 | 52.39 | 37.36 |
| meta-llama/Meta-Llama-3-8B 📄 | 45.42 | 31.1 | 69.95 | 43.91 | 36.7 |
🌳 Model family tree
🧩 Configuration
models:
- model: NousResearch/Meta-Llama-3-8B
# No parameters necessary for base model
- model: nbeerbower/llama-3-stella-8B
parameters:
density: 0.6
weight: 0.16
- model: Hastagaras/llama-3-8b-okay
parameters:
density: 0.56
weight: 0.1
- model: nbeerbower/llama-3-gutenberg-8B
parameters:
density: 0.6
weight: 0.18
- model: openchat/openchat-3.6-8b-20240522
parameters:
density: 0.56
weight: 0.12
- model: Kukedlc/NeuralLLaMa-3-8b-DT-v0.1
parameters:
density: 0.58
weight: 0.18
- model: cstr/llama3-8b-spaetzle-v20
parameters:
density: 0.56
weight: 0.08
- model: mlabonne/ChimeraLlama-3-8B-v3
parameters:
density: 0.56
weight: 0.08
- model: flammenai/Mahou-1.1-llama3-8B
parameters:
density: 0.55
weight: 0.05
- model: KingNish/KingNish-Llama3-8b
parameters:
density: 0.55
weight: 0.05
merge_method: dare_ties
base_model: NousResearch/Meta-Llama-3-8B
dtype: bfloat16
💻 Usage
!pip install -qU transformers accelerate
from transformers import AutoTokenizer
import transformers
import torch
model = "mlabonne/Daredevil-8B"
messages = [{"role": "user", "content": "What is a large language model?"}]
tokenizer = AutoTokenizer.from_pretrained(model)
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
pipeline = transformers.pipeline(
"text-generation",
model=model,
torch_dtype=torch.bfloat16,
device_map="auto",
)
outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
print(outputs[0]["generated_text"])
Runs of mlabonne Daredevil-8B on huggingface.co
196
Total runs
-2
24-hour runs
40
3-day runs
66
7-day runs
121
30-day runs
More Information About Daredevil-8B huggingface.co Model
Url of Daredevil-8B
Daredevil-8B huggingface.co Url
Provider of Daredevil-8B huggingface.co
Other API from mlabonne
Updated:May 19 2025
Total runs:
30.8K
Run Growth:
2.4K
Growth Rate:
7.66%
Total runs:
29.9K
Run Growth:
1.3K
Growth Rate:
4.18%
Total runs:
23.1K
Run Growth:
-8.8K
Growth Rate:
-38.22%
Total runs:
14.8K
Run Growth:
-997
Growth Rate:
-6.75%
Total runs:
11.4K
Run Growth:
-6.3K
Growth Rate:
-54.81%
Total runs:
8.6K
Run Growth:
354
Growth Rate:
4.11%
Total runs:
8.2K
Run Growth:
552
Growth Rate:
6.74%
Total runs:
8.2K
Run Growth:
429
Growth Rate:
5.26%
Total runs:
6.7K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4.9K
Run Growth:
196
Growth Rate:
3.99%
Total runs:
3.4K
Run Growth:
358
Growth Rate:
10.67%
Total runs:
3.0K
Run Growth:
-99
Growth Rate:
-3.35%
Total runs:
2.9K
Run Growth:
232
Growth Rate:
7.88%
Total runs:
2.1K
Run Growth:
-1.0K
Growth Rate:
-49.74%
Total runs:
1.8K
Run Growth:
631
Growth Rate:
35.91%
Total runs:
1.6K
Run Growth:
1.3K
Growth Rate:
78.47%
Total runs:
1.5K
Run Growth:
-97
Growth Rate:
-6.58%
Total runs:
1.4K
Run Growth:
-308
Growth Rate:
-21.54%
Total runs:
1.1K
Run Growth:
601
Growth Rate:
53.66%
Total runs:
976
Run Growth:
435
Growth Rate:
44.57%
Total runs:
936
Run Growth:
-1.4K
Growth Rate:
-151.92%
Total runs:
807
Run Growth:
168
Growth Rate:
20.82%
Total runs:
669
Run Growth:
0
Growth Rate:
0.00%
Total runs:
633
Run Growth:
62
Growth Rate:
9.79%
Total runs:
621
Run Growth:
290
Growth Rate:
46.70%
Total runs:
616
Run Growth:
-564
Growth Rate:
-91.56%
Total runs:
585
Run Growth:
-93
Growth Rate:
-15.90%
Total runs:
402
Run Growth:
-1.6K
Growth Rate:
-409.45%
Total runs:
379
Run Growth:
-118
Growth Rate:
-31.13%
Total runs:
372
Run Growth:
-16
Growth Rate:
-4.30%
Total runs:
358
Run Growth:
0
Growth Rate:
0.00%
Total runs:
354
Run Growth:
12
Growth Rate:
3.39%
Total runs:
324
Run Growth:
-7
Growth Rate:
-2.16%
Total runs:
322
Run Growth:
35
Growth Rate:
10.87%
Total runs:
311
Run Growth:
-198
Growth Rate:
-63.67%
Total runs:
308
Run Growth:
0
Growth Rate:
0.00%
Total runs:
271
Run Growth:
187
Growth Rate:
69.00%
Total runs:
221
Run Growth:
25
Growth Rate:
11.31%
Total runs:
179
Run Growth:
5
Growth Rate:
2.79%
Total runs:
176
Run Growth:
0
Growth Rate:
0.00%
Total runs:
168
Run Growth:
-101
Growth Rate:
-60.12%
Total runs:
162
Run Growth:
80
Growth Rate:
49.38%
Total runs:
159
Run Growth:
84
Growth Rate:
52.83%
Total runs:
158
Run Growth:
64
Growth Rate:
40.51%
Total runs:
157
Run Growth:
-829
Growth Rate:
-528.03%
Total runs:
157
Run Growth:
17
Growth Rate:
10.83%
Total runs:
131
Run Growth:
-354
Growth Rate:
-270.23%
Total runs:
121
Run Growth:
-146
Growth Rate:
-120.66%
Total runs:
116
Run Growth:
63
Growth Rate:
54.31%
Total runs:
111
Run Growth:
-2
Growth Rate:
-1.80%
Total runs:
111
Run Growth:
-49
Growth Rate:
-44.14%
Total runs:
107
Run Growth:
22
Growth Rate:
20.56%
Total runs:
107
Run Growth:
13
Growth Rate:
12.15%
Total runs:
103
Run Growth:
45
Growth Rate:
43.69%
Total runs:
103
Run Growth:
19
Growth Rate:
18.45%
Total runs:
98
Run Growth:
-316
Growth Rate:
-322.45%
Total runs:
93
Run Growth:
-24
Growth Rate:
-25.81%
Total runs:
89
Run Growth:
-178
Growth Rate:
-200.00%
Total runs:
85
Run Growth:
-444
Growth Rate:
-522.35%
Total runs:
72
Run Growth:
51
Growth Rate:
70.83%
Total runs:
69
Run Growth:
-23
Growth Rate:
-33.33%
Total runs:
67
Run Growth:
25
Growth Rate:
37.31%
Total runs:
65
Run Growth:
27
Growth Rate:
41.54%
Total runs:
60
Run Growth:
21
Growth Rate:
35.00%
Total runs:
58
Run Growth:
-40
Growth Rate:
-68.97%
Total runs:
53
Run Growth:
-16
Growth Rate:
-30.19%
Total runs:
49
Run Growth:
0
Growth Rate:
0.00%
Total runs:
46
Run Growth:
18
Growth Rate:
39.13%
Total runs:
45
Run Growth:
0
Growth Rate:
0.00%
Total runs:
39
Run Growth:
0
Growth Rate:
0.00%
Total runs:
39
Run Growth:
12
Growth Rate:
30.77%
Total runs:
37
Run Growth:
0
Growth Rate:
0.00%
Total runs:
37
Run Growth:
0
Growth Rate:
0.00%
Total runs:
36
Run Growth:
10
Growth Rate:
27.78%