Sponsored by
ThumbnailCreator.com
appvoid / palmer-004-original
Model's Last Updated: June 18 2024
text-generation
Introduction of palmer-004-original
Model Details of palmer-004-original
Introducing palmer-004
We are thrilled to unveil palmer-004, the fourth iteration in our esteemed palmer series, designed to push the boundaries of performance and context window capacity. Merging the best of palmer-003 with the expansive capabilities of palmer-002-32k, palmer-004 is a testament to the power of merging similar trained models, think of it as palmer-003 with 32k context with minimal performance degradation.
| Model | MMLU | ARC-C | HellaSwag | PIQA | Winogrande |
|---|---|---|---|---|---|
| tinyllama-3t | 0.2577 | 0.3029 | 0.5935 | 0.7329 | 0.5959 |
| palmer-003 | 0.2523 | 0.3439 | 0.6208 | 0.7524 | 0.6590 |
| palmer-004 | 0.2601 | 0.3456 | 0.6138 | 0.7443 | 0.6511 |
Crafted using the TIES merge method, palmer-004 elevates its predecessor's prowess to a remarkable 32k context window without needing to train on additional data. This model doesn't just aim to match; it surpasses, outperforming the current state-of-the-art coven_tiny_1.1b_32k_orpo_alpha on several benchmarks. As of June 1, 2024, palmer-004 stands as the 2nd best 1b overall model as well as the best 32k 1B model to fine-tune from on Hugging Face, setting a new standard for excellence in the open-source AI community.
If you are using Windows, you can now support me by purchasing a copy of quark, a cool text editor that uses language models. Still in beta but super cool still.
Runs of appvoid palmer-004-original on huggingface.co
19
Total runs
6
24-hour runs
5
3-day runs
5
7-day runs
4
30-day runs
More Information About palmer-004-original huggingface.co Model
Url of palmer-004-original
palmer-004-original huggingface.co Url
Provider of palmer-004-original huggingface.co
Other API from appvoid
Total runs:
122
Run Growth:
20
Growth Rate:
16.39%
Total runs:
63
Run Growth:
12
Growth Rate:
19.05%
Total runs:
37
Run Growth:
-103
Growth Rate:
-278.38%
Total runs:
32
Run Growth:
22
Growth Rate:
68.75%
Total runs:
31
Run Growth:
18
Growth Rate:
58.06%
Total runs:
29
Run Growth:
17
Growth Rate:
58.62%
Total runs:
27
Run Growth:
3
Growth Rate:
11.11%
Total runs:
24
Run Growth:
8
Growth Rate:
33.33%
Total runs:
24
Run Growth:
7
Growth Rate:
29.17%
Total runs:
23
Run Growth:
-11
Growth Rate:
-47.83%
Total runs:
23
Run Growth:
15
Growth Rate:
65.22%
Total runs:
23
Run Growth:
15
Growth Rate:
65.22%
Total runs:
23
Run Growth:
-3
Growth Rate:
-13.04%
Total runs:
22
Run Growth:
-3
Growth Rate:
-13.64%
Total runs:
22
Run Growth:
6
Growth Rate:
27.27%
Total runs:
22
Run Growth:
5
Growth Rate:
22.73%
Total runs:
21
Run Growth:
10
Growth Rate:
47.62%
Total runs:
21
Run Growth:
17
Growth Rate:
80.95%
Total runs:
20
Run Growth:
10
Growth Rate:
50.00%
Total runs:
20
Run Growth:
2
Growth Rate:
9.52%
Total runs:
19
Run Growth:
8
Growth Rate:
42.11%
Total runs:
18
Run Growth:
7
Growth Rate:
38.89%
Total runs:
18
Run Growth:
9
Growth Rate:
50.00%
Total runs:
17
Run Growth:
2
Growth Rate:
11.76%