Total runs:
357.6K
Run Growth:
-69.4K
Growth Rate:
-19.40%
Sponsored by
PoYo.AI
mlabonne / Meta-Llama-3-120B-Instruct
Model's Last Updated: July 10 2026
text-generation
Introduction of Meta-Llama-3-120B-Instruct
Model Details of Meta-Llama-3-120B-Instruct
Meta-Llama-3-120B-Instruct
Meta-Llama-3-120B-Instruct is a meta-llama/Meta-Llama-3-70B-Instruct self-merge made with MergeKit .
It was inspired by large merges like:
- alpindale/goliath-120b
- nsfwthrowitaway69/Venus-120b-v1.0
- cognitivecomputations/MegaDolphin-120b
- wolfram/miquliz-120b-v2.0 .
Special thanks to Eric Hartford for both inspiring and evaluating this model and to Charles Goddard for creating MergeKit.
🔍 Applications
I recommend using this model for creative writing. It uses the Llama 3 chat template with a default context window of 8K (can be extended with rope theta).
Check the examples in the evaluation section to get an idea of its performance. The model is generally quite unhinged but has a good writing style. It sometimes outputs typos and is a big fan of uppercase.
⚡ Quantized models
Thanks to Bartowski , elinas , the mlx-community and others for providing these models.
- GGUF : https://huggingface.co/lmstudio-community/Meta-Llama-3-120B-Instruct-GGUF
- EXL2 : https://huggingface.co/elinas/Meta-Llama-3-120B-Instruct-4.0bpw-exl2
- mlx : https://huggingface.co/mlx-community/Meta-Llama-3-120B-Instruct-4bit
🏆 Evaluation
This model is great for creative writing but struggles in other tasks. I'd say use it with caution and don't expect it to outperform GPT-4 outside of some very specific use cases.
- X thread by Eric Hartford (creative writing) : https://twitter.com/erhartford/status/1787050962114207886
- X thread by Daniel Kaiser (creative writing) : https://twitter.com/spectate_or/status/1787257261309518101
- X thread by Simon (reasoning) : https://twitter.com/NewDigitalEdu/status/1787403266894020893
- r/LocalLLaMa : https://www.reddit.com/r/LocalLLaMA/comments/1cl525q/goliath_lovers_where_is_the_feedback_about/
Creative Writing
Thanks to Sam Paech for evaluating this model and sending me his outputs!
🧩 Configuration
slices:
- sources:
- layer_range: [0, 20]
model: meta-llama/Meta-Llama-3-70B-Instruct
- sources:
- layer_range: [10, 30]
model: meta-llama/Meta-Llama-3-70B-Instruct
- sources:
- layer_range: [20, 40]
model: meta-llama/Meta-Llama-3-70B-Instruct
- sources:
- layer_range: [30, 50]
model: meta-llama/Meta-Llama-3-70B-Instruct
- sources:
- layer_range: [40, 60]
model: meta-llama/Meta-Llama-3-70B-Instruct
- sources:
- layer_range: [50, 70]
model: meta-llama/Meta-Llama-3-70B-Instruct
- sources:
- layer_range: [60, 80]
model: meta-llama/Meta-Llama-3-70B-Instruct
merge_method: passthrough
dtype: float16
💻 Usage
!pip install -qU transformers accelerate
from transformers import AutoTokenizer
import transformers
import torch
model = "mlabonne/Meta-Llama-3-120B-Instruct"
messages = [{"role": "user", "content": "What is a large language model?"}]
tokenizer = AutoTokenizer.from_pretrained(model)
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
pipeline = transformers.pipeline(
"text-generation",
model=model,
torch_dtype=torch.float16,
device_map="auto",
)
outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
print(outputs[0]["generated_text"])
Runs of mlabonne Meta-Llama-3-120B-Instruct on huggingface.co
322
Total runs
0
24-hour runs
0
3-day runs
35
7-day runs
35
30-day runs
More Information About Meta-Llama-3-120B-Instruct huggingface.co Model
Url of Meta-Llama-3-120B-Instruct
Meta-Llama-3-120B-Instruct huggingface.co Url
Provider of Meta-Llama-3-120B-Instruct huggingface.co
Other API from mlabonne
Updated:May 19 2025
Total runs:
29.9K
Run Growth:
1.3K
Growth Rate:
4.18%
Total runs:
26.5K
Run Growth:
-5.2K
Growth Rate:
-19.52%
Total runs:
23.1K
Run Growth:
-8.8K
Growth Rate:
-38.22%
Total runs:
16.1K
Run Growth:
1.8K
Growth Rate:
11.51%
Total runs:
9.1K
Run Growth:
-2.1K
Growth Rate:
-22.74%
Total runs:
9.1K
Run Growth:
225
Growth Rate:
2.46%
Total runs:
8.6K
Run Growth:
60
Growth Rate:
0.70%
Total runs:
8.2K
Run Growth:
552
Growth Rate:
6.74%
Total runs:
8.2K
Run Growth:
429
Growth Rate:
5.26%
Total runs:
6.7K
Run Growth:
3.5K
Growth Rate:
51.66%
Total runs:
6.7K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.4K
Run Growth:
229
Growth Rate:
6.67%
Total runs:
3.0K
Run Growth:
-99
Growth Rate:
-3.35%
Total runs:
2.9K
Run Growth:
232
Growth Rate:
7.88%
Total runs:
1.8K
Run Growth:
631
Growth Rate:
35.91%
Total runs:
1.6K
Run Growth:
410
Growth Rate:
24.49%
Total runs:
1.5K
Run Growth:
-97
Growth Rate:
-6.58%
Total runs:
1.4K
Run Growth:
1.2K
Growth Rate:
88.11%
Total runs:
1.4K
Run Growth:
357
Growth Rate:
26.25%
Total runs:
1.1K
Run Growth:
601
Growth Rate:
53.66%
Total runs:
976
Run Growth:
435
Growth Rate:
44.57%
Total runs:
936
Run Growth:
-1.4K
Growth Rate:
-151.92%
Total runs:
872
Run Growth:
285
Growth Rate:
32.65%
Total runs:
773
Run Growth:
-220
Growth Rate:
-30.81%
Total runs:
669
Run Growth:
0
Growth Rate:
0.00%
Total runs:
621
Run Growth:
290
Growth Rate:
46.70%
Total runs:
585
Run Growth:
-93
Growth Rate:
-15.90%
Total runs:
571
Run Growth:
89
Growth Rate:
15.48%
Total runs:
483
Run Growth:
320
Growth Rate:
66.25%
Total runs:
402
Run Growth:
-1.6K
Growth Rate:
-409.45%
Total runs:
379
Run Growth:
-118
Growth Rate:
-31.13%
Total runs:
372
Run Growth:
-16
Growth Rate:
-4.30%
Total runs:
358
Run Growth:
0
Growth Rate:
0.00%
Total runs:
354
Run Growth:
12
Growth Rate:
3.39%
Total runs:
324
Run Growth:
-7
Growth Rate:
-2.16%
Total runs:
311
Run Growth:
-198
Growth Rate:
-63.67%
Total runs:
308
Run Growth:
0
Growth Rate:
0.00%
Total runs:
288
Run Growth:
116
Growth Rate:
40.28%
Total runs:
271
Run Growth:
187
Growth Rate:
69.00%
Total runs:
252
Run Growth:
57
Growth Rate:
23.55%
Total runs:
252
Run Growth:
174
Growth Rate:
69.60%
Total runs:
176
Run Growth:
0
Growth Rate:
0.00%
Total runs:
162
Run Growth:
80
Growth Rate:
49.38%
Total runs:
159
Run Growth:
84
Growth Rate:
52.83%
Total runs:
158
Run Growth:
64
Growth Rate:
40.51%
Total runs:
157
Run Growth:
-829
Growth Rate:
-528.03%
Total runs:
157
Run Growth:
17
Growth Rate:
10.83%
Total runs:
131
Run Growth:
-354
Growth Rate:
-270.23%
Total runs:
128
Run Growth:
43
Growth Rate:
33.59%
Total runs:
116
Run Growth:
63
Growth Rate:
54.31%
Total runs:
111
Run Growth:
-49
Growth Rate:
-44.14%
Total runs:
103
Run Growth:
19
Growth Rate:
18.45%
Total runs:
100
Run Growth:
39
Growth Rate:
37.50%
Total runs:
98
Run Growth:
-316
Growth Rate:
-322.45%
Total runs:
98
Run Growth:
6
Growth Rate:
5.88%
Total runs:
93
Run Growth:
-24
Growth Rate:
-25.81%
Total runs:
89
Run Growth:
-178
Growth Rate:
-200.00%
Total runs:
85
Run Growth:
-124
Growth Rate:
-127.84%
Total runs:
85
Run Growth:
-444
Growth Rate:
-522.35%
Total runs:
72
Run Growth:
51
Growth Rate:
70.83%
Total runs:
69
Run Growth:
-23
Growth Rate:
-33.33%
Total runs:
63
Run Growth:
-120
Growth Rate:
-166.67%
Total runs:
58
Run Growth:
-40
Growth Rate:
-68.97%
Total runs:
56
Run Growth:
29
Growth Rate:
51.79%
Total runs:
53
Run Growth:
-16
Growth Rate:
-30.19%
Total runs:
53
Run Growth:
7
Growth Rate:
12.50%
Total runs:
49
Run Growth:
0
Growth Rate:
0.00%
Total runs:
46
Run Growth:
18
Growth Rate:
39.13%
Total runs:
45
Run Growth:
0
Growth Rate:
0.00%
Total runs:
40
Run Growth:
32
Growth Rate:
74.42%
Total runs:
39
Run Growth:
0
Growth Rate:
0.00%