Total runs:
8.7K
Run Growth:
619
Growth Rate:
7.11%
Sponsored by
Agentkit
abacusai / Llama-3-Smaug-8B
Model's Last Updated: May 19 2024
text-generation
Introduction of Llama-3-Smaug-8B
Model Details of Llama-3-Smaug-8B
Llama-3-Smaug-8B
Built with Meta Llama 3
This model was built using the Smaug recipe for improving performance on real world multi-turn conversations applied to meta-llama/Meta-Llama-3-8B-Instruct .
Model Description
- Developed by: Abacus.AI
- License: https://llama.meta.com/llama3/license/
- Finetuned from model: meta-llama/Meta-Llama-3-8B-Instruct .
Evaluation
MT-Bench
########## First turn ##########
score
model turn
Llama-3-Smaug-8B 1 8.77500
Meta-Llama-3-8B-Instruct 1 8.31250
########## Second turn ##########
score
model turn
Meta-Llama-3-8B-Instruct 2 7.8875
Llama-3-Smaug-8B 2 7.8875
########## Average ##########
score
model
Llama-3-Smaug-8B 8.331250
Meta-Llama-3-8B-Instruct 8.10
| Model | First turn | Second Turn | Average |
|---|---|---|---|
| Llama-3-Smaug-8B | 8.78 | 7.89 | 8.33 |
| Llama-3-8B-Instruct | 8.31 | 7.89 | 8.10 |
This version of Smaug uses new techniques and new data compared to Smaug-72B , and more information will be released later on. For now, see the previous Smaug paper: https://arxiv.org/abs/2402.13228 .
Runs of abacusai Llama-3-Smaug-8B on huggingface.co
8.6K
Total runs
-3
24-hour runs
24
3-day runs
100
7-day runs
595
30-day runs
More Information About Llama-3-Smaug-8B huggingface.co Model
Url of Llama-3-Smaug-8B
Llama-3-Smaug-8B huggingface.co Url
Provider of Llama-3-Smaug-8B huggingface.co
Other API from abacusai
Updated:February 22 2024
Total runs:
8.7K
Run Growth:
388
Growth Rate:
4.44%
Total runs:
8.6K
Run Growth:
693
Growth Rate:
8.03%
Total runs:
8.6K
Run Growth:
501
Growth Rate:
5.81%
Total runs:
8.5K
Run Growth:
527
Growth Rate:
6.21%
Total runs:
8.4K
Run Growth:
461
Growth Rate:
5.47%
Total runs:
305
Run Growth:
245
Growth Rate:
76.32%
Total runs:
153
Run Growth:
64
Growth Rate:
42.67%
Total runs:
125
Run Growth:
37
Growth Rate:
30.08%
Total runs:
123
Run Growth:
94
Growth Rate:
80.34%
Total runs:
121
Run Growth:
53
Growth Rate:
44.54%
Total runs:
101
Run Growth:
20
Growth Rate:
20.00%
Total runs:
92
Run Growth:
22
Growth Rate:
25.00%
Total runs:
84
Run Growth:
11
Growth Rate:
13.92%
Total runs:
80
Run Growth:
30
Growth Rate:
37.97%
Total runs:
77
Run Growth:
29
Growth Rate:
37.66%
Total runs:
75
Run Growth:
21
Growth Rate:
29.17%
Total runs:
72
Run Growth:
26
Growth Rate:
36.11%
Total runs:
69
Run Growth:
21
Growth Rate:
30.88%
Total runs:
68
Run Growth:
15
Growth Rate:
22.73%
Total runs:
42
Run Growth:
13
Growth Rate:
33.33%
Total runs:
35
Run Growth:
16
Growth Rate:
47.06%
Total runs:
33
Run Growth:
19
Growth Rate:
59.38%
Total runs:
31
Run Growth:
14
Growth Rate:
46.67%
Total runs:
27
Run Growth:
15
Growth Rate:
57.69%
Total runs:
25
Run Growth:
15
Growth Rate:
62.50%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%