Total runs:
357.6K
Run Growth:
-69.4K
Growth Rate:
-19.40%
Sponsored by
AdsCreator.com
mlabonne / NeuralMarcoro14-7B
Model's Last Updated: March 04 2024
text-generation
Introduction of NeuralMarcoro14-7B
Model Details of NeuralMarcoro14-7B
NeuralMarcoro14-7B
This is a DPO fine-tuned version of mlabonne/Marcoro14-7B-slerp using the chatml_dpo_pairs preference dataset. It improves the performance of the model on Nous benchmark suite and the Open LLM Benchmark.
It is currently the best-performing 7B LLM on the Open LLM Leaderboard (08/01/24).
You can try it out in this Space (GGUF Q4_K_M).
⚡ Quantized models
🏆 Evaluation
Open LLM Leaderboard
Nous
| Model | AGIEval | GPT4ALL | TruthfulQA | Bigbench | Average |
|---|---|---|---|---|---|
| NeuralMarcoro14-7B | 44.59 | 76.17 | 65.94 | 46.9 | 58.4 |
| Marcoro14-7B-slerp | 44.66 | 76.24 | 64.15 | 45.64 | 57.67 |
| Change | -0.07 | -0.07 | +1.79 | +1.26 | +0.73 |
🧩 Training hyperparameters
LoRA :
- r=16
- lora_alpha=16
- lora_dropout=0.05
- bias="none"
- task_type="CAUSAL_LM"
- target_modules=['k_proj', 'gate_proj', 'v_proj', 'up_proj', 'q_proj', 'o_proj', 'down_proj']
Training arguments :
- per_device_train_batch_size=4
- gradient_accumulation_steps=4
- gradient_checkpointing=True
- learning_rate=5e-5
- lr_scheduler_type="cosine"
- max_steps=200
- optim="paged_adamw_32bit"
- warmup_steps=100
DPOTrainer :
- beta=0.1
- max_prompt_length=1024
- max_length=1536
💻 Usage
!pip install -qU transformers accelerate
from transformers import AutoTokenizer
import transformers
import torch
model = "mlabonne/NeuralMarcoro14-7B"
messages = [{"role": "user", "content": "What is a large language model?"}]
tokenizer = AutoTokenizer.from_pretrained(model)
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
pipeline = transformers.pipeline(
"text-generation",
model=model,
torch_dtype=torch.float16,
device_map="auto",
)
outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
print(outputs[0]["generated_text"])
Runs of mlabonne NeuralMarcoro14-7B on huggingface.co
157
Total runs
0
24-hour runs
-6
3-day runs
-36
7-day runs
-829
30-day runs
More Information About NeuralMarcoro14-7B huggingface.co Model
Url of NeuralMarcoro14-7B
NeuralMarcoro14-7B huggingface.co Url
Provider of NeuralMarcoro14-7B huggingface.co
Other API from mlabonne
Updated:May 19 2025
Total runs:
29.9K
Run Growth:
1.3K
Growth Rate:
4.18%
Total runs:
28.9K
Run Growth:
-2.7K
Growth Rate:
-9.44%
Total runs:
15.1K
Run Growth:
455
Growth Rate:
3.01%
Total runs:
9.1K
Run Growth:
225
Growth Rate:
2.46%
Total runs:
8.7K
Run Growth:
20
Growth Rate:
0.23%
Total runs:
8.2K
Run Growth:
552
Growth Rate:
6.74%
Total runs:
8.2K
Run Growth:
429
Growth Rate:
5.26%
Total runs:
7.1K
Run Growth:
4.0K
Growth Rate:
54.91%
Total runs:
7.1K
Run Growth:
-4.2K
Growth Rate:
-58.11%
Total runs:
6.7K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.9K
Run Growth:
795
Growth Rate:
19.46%
Total runs:
3.0K
Run Growth:
-99
Growth Rate:
-3.35%
Total runs:
2.9K
Run Growth:
232
Growth Rate:
7.88%
Total runs:
2.1K
Run Growth:
435
Growth Rate:
21.59%
Total runs:
1.8K
Run Growth:
631
Growth Rate:
35.91%
Total runs:
1.6K
Run Growth:
1.4K
Growth Rate:
89.83%
Total runs:
1.6K
Run Growth:
559
Growth Rate:
35.79%
Total runs:
1.5K
Run Growth:
-6
Growth Rate:
-0.41%
Total runs:
1.5K
Run Growth:
-97
Growth Rate:
-6.58%
Total runs:
1.3K
Run Growth:
1.2K
Growth Rate:
98.26%
Total runs:
1.1K
Run Growth:
-186
Growth Rate:
-17.02%
Total runs:
998
Run Growth:
22
Growth Rate:
2.20%
Total runs:
988
Run Growth:
314
Growth Rate:
29.99%
Total runs:
976
Run Growth:
435
Growth Rate:
44.57%
Total runs:
669
Run Growth:
0
Growth Rate:
0.00%
Total runs:
621
Run Growth:
290
Growth Rate:
46.70%
Total runs:
483
Run Growth:
320
Growth Rate:
66.25%
Total runs:
478
Run Growth:
120
Growth Rate:
21.16%
Total runs:
418
Run Growth:
-27
Growth Rate:
-6.54%
Total runs:
402
Run Growth:
-1.6K
Growth Rate:
-409.45%
Total runs:
379
Run Growth:
-118
Growth Rate:
-31.13%
Total runs:
372
Run Growth:
-16
Growth Rate:
-4.30%
Total runs:
358
Run Growth:
0
Growth Rate:
0.00%
Total runs:
354
Run Growth:
12
Growth Rate:
3.39%
Total runs:
324
Run Growth:
-7
Growth Rate:
-2.16%
Total runs:
322
Run Growth:
35
Growth Rate:
10.87%
Total runs:
311
Run Growth:
-198
Growth Rate:
-63.67%
Total runs:
310
Run Growth:
-7
Growth Rate:
-2.24%
Total runs:
308
Run Growth:
0
Growth Rate:
0.00%
Total runs:
278
Run Growth:
101
Growth Rate:
36.86%
Total runs:
271
Run Growth:
187
Growth Rate:
69.00%
Total runs:
226
Run Growth:
136
Growth Rate:
60.71%
Total runs:
177
Run Growth:
-10
Growth Rate:
-5.29%
Total runs:
176
Run Growth:
0
Growth Rate:
0.00%
Total runs:
159
Run Growth:
84
Growth Rate:
52.83%
Total runs:
158
Run Growth:
64
Growth Rate:
40.51%
Total runs:
157
Run Growth:
17
Growth Rate:
10.83%
Total runs:
131
Run Growth:
-354
Growth Rate:
-270.23%
Total runs:
128
Run Growth:
43
Growth Rate:
33.59%
Total runs:
127
Run Growth:
-5
Growth Rate:
-3.94%
Total runs:
116
Run Growth:
63
Growth Rate:
54.31%
Total runs:
111
Run Growth:
-49
Growth Rate:
-44.14%
Total runs:
108
Run Growth:
-67
Growth Rate:
-62.04%
Total runs:
103
Run Growth:
19
Growth Rate:
18.45%
Total runs:
99
Run Growth:
23
Growth Rate:
23.96%
Total runs:
98
Run Growth:
-316
Growth Rate:
-322.45%
Total runs:
93
Run Growth:
-24
Growth Rate:
-25.81%
Total runs:
89
Run Growth:
-178
Growth Rate:
-200.00%
Total runs:
85
Run Growth:
-444
Growth Rate:
-522.35%
Total runs:
76
Run Growth:
-29
Growth Rate:
-38.16%
Total runs:
72
Run Growth:
51
Growth Rate:
70.83%
Total runs:
69
Run Growth:
-23
Growth Rate:
-33.33%
Total runs:
68
Run Growth:
-20
Growth Rate:
-31.25%
Total runs:
67
Run Growth:
-52
Growth Rate:
-77.61%
Total runs:
58
Run Growth:
-40
Growth Rate:
-68.97%
Total runs:
57
Run Growth:
42
Growth Rate:
76.36%
Total runs:
55
Run Growth:
-11
Growth Rate:
-20.37%
Total runs:
53
Run Growth:
-16
Growth Rate:
-30.19%
Total runs:
49
Run Growth:
0
Growth Rate:
0.00%
Total runs:
45
Run Growth:
0
Growth Rate:
0.00%