Total runs:
2.5K
Run Growth:
220
Growth Rate:
8.86%
Sponsored by
iMean AI Trip Planner
Locutusque / llama-3-neural-chat-v2.2-8B
Model's Last Updated: May 12 2024
text-generation
Introduction of llama-3-neural-chat-v2.2-8B
Model Details of llama-3-neural-chat-v2.2-8B
llama-3-neural-chat-v2.2-8b
Model Details
Model Description
I fine-tuned llama-3 8B on an approach similar to Intel's neural chat language model. I have slightly modified the data sources so it is stronger in coding, math, and writing. I use both SFT and DPO-Positive. DPO-Positive dramatically improves performance over DPO.
- Developed by: Locutusque
- Model type: Built with Meta Llama 3
- Language(s) (NLP): Many?
- License: Llama 3 license https://huggingface.co/meta-llama/Meta-Llama-3-8B/blob/main/LICENSE
Quants
GGUF: https://huggingface.co/bartowski/llama-3-neural-chat-v2.2-8B-GGUF
ExLlamaV2: https://huggingface.co/bartowski/llama-3-neural-chat-v2.2-8B-exl2
Uses
This model has great performance in writing, coding, and math.
Training Data
Recipe information will be coming soon. This language model's recipe is similar to Intel's Neural Chat.
Direct Use
Conversational AI. This model is also very uncensored, it will respond to pretty much any request regardless of the system prompt, use at your own risk.
Evaluations
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | |
|---|---|---|---|---|---|---|---|
| truthfulqa_mc2 | 2 | none | 0 | acc | 0.5232 | ± | 0.0151 |
| gsm8k | 3 | strict-match | 5 | exact_match | 0.5974 | ± | 0.0135 |
| flexible-extract | 5 | exact_match | 0.5974 | ± | 0.0135 | ||
| agieval_nous | N/A | none | 0 | acc_norm | 0.3841 | ± | 0.0094 |
| none | 0 | acc | 0.3802 | ± | 0.0094 | ||
| - agieval_aqua_rat | 1 | none | 0 | acc | 0.2598 | ± | 0.0276 |
| none | 0 | acc_norm | 0.2520 | ± | 0.0273 | ||
| - agieval_logiqa_en | 1 | none | 0 | acc | 0.3441 | ± | 0.0186 |
| none | 0 | acc_norm | 0.3687 | ± | 0.0189 | ||
| - agieval_lsat_ar | 1 | none | 0 | acc | 0.2217 | ± | 0.0275 |
| none | 0 | acc_norm | 0.2348 | ± | 0.0280 | ||
| - agieval_lsat_lr | 1 | none | 0 | acc | 0.3882 | ± | 0.0216 |
| none | 0 | acc_norm | 0.3824 | ± | 0.0215 | ||
| - agieval_lsat_rc | 1 | none | 0 | acc | 0.4944 | ± | 0.0305 |
| none | 0 | acc_norm | 0.5019 | ± | 0.0305 | ||
| - agieval_sat_en | 1 | none | 0 | acc | 0.6650 | ± | 0.0330 |
| none | 0 | acc_norm | 0.6553 | ± | 0.0332 | ||
| - agieval_sat_en_without_passage | 1 | none | 0 | acc | 0.3981 | ± | 0.0342 |
| none | 0 | acc_norm | 0.3981 | ± | 0.0342 | ||
| - agieval_sat_math | 1 | none | 0 | acc | 0.3500 | ± | 0.0322 |
| none | 0 | acc_norm | 0.3318 | ± | 0.0318 |
Runs of Locutusque llama-3-neural-chat-v2.2-8B on huggingface.co
7
Total runs
0
24-hour runs
0
3-day runs
-1
7-day runs
-22
30-day runs
More Information About llama-3-neural-chat-v2.2-8B huggingface.co Model
Url of llama-3-neural-chat-v2.2-8B
llama-3-neural-chat-v2.2-8B huggingface.co Url
Provider of llama-3-neural-chat-v2.2-8B huggingface.co
Other API from Locutusque
Updated:August 01 2023
Total runs:
1.1K
Run Growth:
25
Growth Rate:
2.33%
Total runs:
1.1K
Run Growth:
82
Growth Rate:
7.72%
Total runs:
1.1K
Run Growth:
-1.0K
Growth Rate:
-96.40%
Total runs:
1.0K
Run Growth:
-240
Growth Rate:
-22.90%
Total runs:
1.0K
Run Growth:
85
Growth Rate:
8.24%
Total runs:
1.0K
Run Growth:
60
Growth Rate:
5.90%
Total runs:
995
Run Growth:
-1.3K
Growth Rate:
-125.73%
Total runs:
866
Run Growth:
287
Growth Rate:
33.14%
Total runs:
845
Run Growth:
288
Growth Rate:
34.08%
Total runs:
832
Run Growth:
789
Growth Rate:
94.83%
Total runs:
247
Run Growth:
-55
Growth Rate:
-22.27%
Total runs:
229
Run Growth:
156
Growth Rate:
68.12%
Total runs:
157
Run Growth:
148
Growth Rate:
94.27%
Total runs:
145
Run Growth:
0
Growth Rate:
0.00%
Total runs:
111
Run Growth:
27
Growth Rate:
24.32%
Total runs:
108
Run Growth:
-250
Growth Rate:
-231.48%
Total runs:
101
Run Growth:
31
Growth Rate:
30.69%
Total runs:
99
Run Growth:
8
Growth Rate:
8.08%
Total runs:
96
Run Growth:
30
Growth Rate:
32.61%
Total runs:
88
Run Growth:
4
Growth Rate:
4.55%
Total runs:
77
Run Growth:
22
Growth Rate:
28.57%
Total runs:
75
Run Growth:
25
Growth Rate:
33.33%
Total runs:
74
Run Growth:
17
Growth Rate:
22.97%
Total runs:
73
Run Growth:
15
Growth Rate:
20.55%
Total runs:
73
Run Growth:
15
Growth Rate:
20.55%
Total runs:
72
Run Growth:
16
Growth Rate:
22.22%
Total runs:
71
Run Growth:
13
Growth Rate:
18.31%
Total runs:
69
Run Growth:
11
Growth Rate:
15.94%
Total runs:
68
Run Growth:
32
Growth Rate:
47.06%
Total runs:
67
Run Growth:
13
Growth Rate:
19.40%
Total runs:
66
Run Growth:
9
Growth Rate:
13.64%
Total runs:
66
Run Growth:
9
Growth Rate:
13.64%
Total runs:
66
Run Growth:
18
Growth Rate:
27.27%
Total runs:
60
Run Growth:
11
Growth Rate:
18.33%
Total runs:
60
Run Growth:
6
Growth Rate:
10.00%
Total runs:
56
Run Growth:
2
Growth Rate:
3.57%
Total runs:
55
Run Growth:
46
Growth Rate:
83.64%
Total runs:
40
Run Growth:
22
Growth Rate:
55.00%
Total runs:
40
Run Growth:
10
Growth Rate:
25.00%
Total runs:
38
Run Growth:
34
Growth Rate:
89.47%
Total runs:
38
Run Growth:
11
Growth Rate:
28.95%
Total runs:
38
Run Growth:
15
Growth Rate:
39.47%
Total runs:
36
Run Growth:
26
Growth Rate:
72.22%
Total runs:
36
Run Growth:
15
Growth Rate:
41.67%
Total runs:
35
Run Growth:
17
Growth Rate:
48.57%
Total runs:
34
Run Growth:
19
Growth Rate:
55.88%
Total runs:
32
Run Growth:
13
Growth Rate:
40.63%
Total runs:
26
Run Growth:
0
Growth Rate:
0.00%
Total runs:
25
Run Growth:
12
Growth Rate:
48.00%
Total runs:
25
Run Growth:
11
Growth Rate:
44.00%
Total runs:
23
Run Growth:
6
Growth Rate:
26.09%
Total runs:
22
Run Growth:
15
Growth Rate:
68.18%
Total runs:
21
Run Growth:
10
Growth Rate:
47.62%
Total runs:
21
Run Growth:
14
Growth Rate:
66.67%
Total runs:
21
Run Growth:
8
Growth Rate:
38.10%
Total runs:
16
Run Growth:
12
Growth Rate:
75.00%
Total runs:
16
Run Growth:
-1
Growth Rate:
-6.25%
Total runs:
15
Run Growth:
4
Growth Rate:
26.67%
Total runs:
14
Run Growth:
-4
Growth Rate:
-28.57%
Total runs:
12
Run Growth:
8
Growth Rate:
66.67%
Total runs:
11
Run Growth:
11
Growth Rate:
100.00%
Total runs:
11
Run Growth:
4
Growth Rate:
36.36%
Total runs:
11
Run Growth:
-4
Growth Rate:
-36.36%
Total runs:
10
Run Growth:
7
Growth Rate:
70.00%
Total runs:
10
Run Growth:
2
Growth Rate:
20.00%
Total runs:
10
Run Growth:
-4
Growth Rate:
-40.00%
Total runs:
10
Run Growth:
2
Growth Rate:
20.00%
Total runs:
9
Run Growth:
-20
Growth Rate:
-222.22%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
7
Run Growth:
-1
Growth Rate:
-14.29%
Total runs:
6
Run Growth:
-18
Growth Rate:
-300.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
4
Growth Rate:
100.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
-1
Growth Rate:
-33.33%
Total runs:
3
Run Growth:
-1
Growth Rate:
-33.33%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
3
Run Growth:
3
Growth Rate:
100.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
1
Growth Rate:
50.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%