Sponsored by
Vmake Labs Video Enhancer
chargoddard / llama3-42b-v0
Model's Last Updated: May 30 2025
text-generation
Introduction of llama3-42b-v0
Model Details of llama3-42b-v0
🚨 THIS IS A BASE MODEL 🚨
This model is pruned from the base Llama 3 70B, which has no instruction tuning and randomly initialized special tokens.
Using this with the Llama 3 instruction format is injecting random noise into latent space and will give you deranged results. (It's pretty funny actually.) Treat this as the untrained foundation model this is and use appropriate prompts.
Meta's Llama 3 70B pruned to 42B parameters using the methodology described in The Unreasonable Ineffectiveness of the Deeper Layers . Post-pruning trained using QLoRA for ~100M tokens from JeanKaddour/minipile .
Layers to prune selected using PruneMe .
Still evaluating, don't get too excited! Might be incredibly dumb. Check out these numbers though:
| Groups | Version | Filter | n-shot | Metric | Value | Stderr | |
|---|---|---|---|---|---|---|---|
| mmlu | N/A | none | 0 | acc | 0.7669 | ± | 0.0034 |
| - humanities | N/A | none | 5 | acc | 0.7296 | ± | 0.0062 |
| - other | N/A | none | 5 | acc | 0.8101 | ± | 0.0067 |
| - social_sciences | N/A | none | 5 | acc | 0.8668 | ± | 0.0060 |
| - stem | N/A | none | 5 | acc | 0.6825 | ± | 0.0079 |
| winogrande | 1 | none | 5 | acc | 0.8027 | ± | 0.0112 |
| hellaswag | 1 | none | 10 | acc_norm | 0.8025 | ± | 0.0040 |
Runs of chargoddard llama3-42b-v0 on huggingface.co
42
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About llama3-42b-v0 huggingface.co Model
Url of llama3-42b-v0
llama3-42b-v0 huggingface.co Url
Provider of llama3-42b-v0 huggingface.co
Other API from chargoddard
Total runs:
1.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
877
Run Growth:
-1.5K
Growth Rate:
-174.46%
Total runs:
771
Run Growth:
380
Growth Rate:
49.29%
Total runs:
757
Run Growth:
-68
Growth Rate:
-8.98%
Total runs:
737
Run Growth:
-106
Growth Rate:
-14.38%
Total runs:
645
Run Growth:
-269
Growth Rate:
-41.71%
Total runs:
620
Run Growth:
-137
Growth Rate:
-22.10%
Total runs:
618
Run Growth:
-155
Growth Rate:
-25.08%
Total runs:
548
Run Growth:
-168
Growth Rate:
-30.66%
Total runs:
386
Run Growth:
42
Growth Rate:
10.88%
Total runs:
216
Run Growth:
-185
Growth Rate:
-85.65%
Total runs:
188
Run Growth:
-339
Growth Rate:
-180.32%
Total runs:
184
Run Growth:
-329
Growth Rate:
-178.80%
Total runs:
183
Run Growth:
-321
Growth Rate:
-175.41%
Total runs:
144
Run Growth:
0
Growth Rate:
0.00%
Total runs:
133
Run Growth:
-100
Growth Rate:
-75.19%
Total runs:
111
Run Growth:
0
Growth Rate:
0.00%
Total runs:
103
Run Growth:
-358
Growth Rate:
-347.57%
Total runs:
80
Run Growth:
-54
Growth Rate:
-67.50%
Total runs:
75
Run Growth:
6
Growth Rate:
7.89%
Total runs:
75
Run Growth:
5
Growth Rate:
6.67%
Total runs:
74
Run Growth:
8
Growth Rate:
10.81%
Total runs:
67
Run Growth:
-65
Growth Rate:
-97.01%
Total runs:
65
Run Growth:
-8
Growth Rate:
-12.31%
Total runs:
63
Run Growth:
-29
Growth Rate:
-48.33%
Total runs:
59
Run Growth:
-40
Growth Rate:
-72.73%
Total runs:
41
Run Growth:
24
Growth Rate:
58.54%
Total runs:
35
Run Growth:
15
Growth Rate:
42.86%
Total runs:
34
Run Growth:
24
Growth Rate:
70.59%
Total runs:
31
Run Growth:
10
Growth Rate:
32.26%
Total runs:
23
Run Growth:
0
Growth Rate:
0.00%
Total runs:
23
Run Growth:
0
Growth Rate:
0.00%
Total runs:
21
Run Growth:
7
Growth Rate:
33.33%
Total runs:
20
Run Growth:
-1
Growth Rate:
-5.00%
Total runs:
19
Run Growth:
0
Growth Rate:
0.00%
Total runs:
17
Run Growth:
4
Growth Rate:
23.53%
Total runs:
17
Run Growth:
11
Growth Rate:
64.71%
Total runs:
16
Run Growth:
0
Growth Rate:
0.00%
Total runs:
15
Run Growth:
5
Growth Rate:
45.45%
Total runs:
15
Run Growth:
-1
Growth Rate:
-6.67%
Total runs:
14
Run Growth:
3
Growth Rate:
21.43%
Total runs:
13
Run Growth:
0
Growth Rate:
0.00%
Total runs:
11
Run Growth:
1
Growth Rate:
9.09%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
7
Run Growth:
-1
Growth Rate:
-14.29%
Total runs:
6
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5
Run Growth:
4
Growth Rate:
80.00%
Total runs:
5
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-1
Growth Rate:
-25.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
2
Growth Rate:
66.67%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
1
Growth Rate:
100.00%
Total runs:
1
Run Growth:
-2
Growth Rate:
-200.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%