Sponsored by
Vmake Labs Video Enhancer
crumb / cramped-94m-8btok
Model's Last Updated: October 11 2023
text-generation
Introduction of cramped-94m-8btok
Model Details of cramped-94m-8btok
A modified GPT-2 model with ScaledSinusoidal position embeddings, no biases, embedding layernorm, and one shared MLP layer, with 94 million non-embedding params, that beats most similarly sized and slightly larger models (GPT-2-124m, Pythia-70/160m, Cerebras-111m) on the Open LLM Leaderboard suite of benchmarks. All while only being trained on 8 billion tokens of text from SlimPajama .
You have to
pip install einops
before using this model!
| avg | arc | hellaswag | mmlu | truthfulqa |
|---|---|---|---|---|
| 30.76 | 22.18 | 29.75 | 26.24 | 44.88 |
Runs of crumb cramped-94m-8btok on huggingface.co
29
Total runs
2
24-hour runs
3
3-day runs
3
7-day runs
15
30-day runs
More Information About cramped-94m-8btok huggingface.co Model
Url of cramped-94m-8btok
cramped-94m-8btok huggingface.co Url
Provider of cramped-94m-8btok huggingface.co
Other API from crumb
Total runs:
475
Run Growth:
281
Growth Rate:
62.17%
Total runs:
209
Run Growth:
-10
Growth Rate:
-4.78%
Total runs:
169
Run Growth:
54
Growth Rate:
31.95%
Total runs:
153
Run Growth:
91
Growth Rate:
59.48%
Total runs:
136
Run Growth:
-224
Growth Rate:
-164.71%
Total runs:
104
Run Growth:
-13
Growth Rate:
-12.50%
Total runs:
38
Run Growth:
18
Growth Rate:
47.37%
Total runs:
31
Run Growth:
147
Growth Rate:
89.63%
Total runs:
30
Run Growth:
14
Growth Rate:
46.67%
Total runs:
28
Run Growth:
15
Growth Rate:
53.57%
Total runs:
25
Run Growth:
5
Growth Rate:
20.00%
Total runs:
23
Run Growth:
-35
Growth Rate:
-140.00%
Total runs:
23
Run Growth:
7
Growth Rate:
30.43%
Total runs:
22
Run Growth:
7
Growth Rate:
31.82%
Total runs:
22
Run Growth:
6
Growth Rate:
27.27%
Total runs:
21
Run Growth:
6
Growth Rate:
28.57%
Total runs:
20
Run Growth:
10
Growth Rate:
50.00%
Total runs:
20
Run Growth:
6
Growth Rate:
30.00%
Total runs:
19
Run Growth:
5
Growth Rate:
26.32%
Total runs:
18
Run Growth:
3
Growth Rate:
15.79%
Total runs:
16
Run Growth:
-1
Growth Rate:
-6.25%
Total runs:
16
Run Growth:
-1
Growth Rate:
-6.25%
Total runs:
13
Run Growth:
3
Growth Rate:
23.08%
Total runs:
13
Run Growth:
3
Growth Rate:
23.08%
Total runs:
13
Run Growth:
-3
Growth Rate:
-23.08%
Total runs:
12
Run Growth:
-1
Growth Rate:
-8.33%
Total runs:
12
Run Growth:
-3
Growth Rate:
-25.00%
Total runs:
12
Run Growth:
-7
Growth Rate:
-63.64%