Sponsored by
APIMart
appvoid / palmer-004
Model's Last Updated: July 22 2024
text-generation
Introduction of palmer-004
Model Details of palmer-004
june update
This model has improved overall performance at the expense of small degradation on winogrande. As all palmer models, the model is biased to respond to answers without using any specific prompt, feel free to further fine-tune it for your specific use case.
| Model | MMLU | ARC-C | HellaSwag | PIQA | Winogrande | Average |
|---|---|---|---|---|---|---|
| tinyllama-3t | 0.2577 | 0.3029 | 0.5935 | 0.7329 | 0.5959 | 0.4966 |
| palmer-004-old | 0.2601 | 0.3456 | 0.6138 | 0.7443 | 0.6511 | 0.5229 |
| palmer-004 | 0.2661 | 0.3490 | 0.6173 | 0.7481 | 0.6417 | 0.5244 |
note
Even though palmer-003 is only 2k context size, it's 0.5257 on average so if you don't need that much context size (32k) you are better off with the former one.
Runs of appvoid palmer-004 on huggingface.co
13
Total runs
1
24-hour runs
0
3-day runs
-5
7-day runs
-10
30-day runs
More Information About palmer-004 huggingface.co Model
Url of palmer-004
palmer-004 huggingface.co Url
Provider of palmer-004 huggingface.co
Other API from appvoid
Total runs:
27
Run Growth:
3
Growth Rate:
11.11%
Total runs:
10
Run Growth:
7
Growth Rate:
70.00%
Total runs:
10
Run Growth:
-2
Growth Rate:
-20.00%
Total runs:
9
Run Growth:
6
Growth Rate:
66.67%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
9
Run Growth:
4
Growth Rate:
44.44%
Total runs:
8
Run Growth:
-15
Growth Rate:
-187.50%
Total runs:
8
Run Growth:
7
Growth Rate:
87.50%
Total runs:
8
Run Growth:
-3
Growth Rate:
-37.50%
Total runs:
7
Run Growth:
5
Growth Rate:
71.43%
Total runs:
7
Run Growth:
5
Growth Rate:
71.43%
Total runs:
7
Run Growth:
4
Growth Rate:
57.14%
Total runs:
7
Run Growth:
7
Growth Rate:
100.00%
Total runs:
6
Run Growth:
4
Growth Rate:
66.67%
Total runs:
6
Run Growth:
6
Growth Rate:
100.00%
Total runs:
6
Run Growth:
3
Growth Rate:
50.00%
Total runs:
5
Run Growth:
4
Growth Rate:
80.00%
Total runs:
5
Run Growth:
4
Growth Rate:
80.00%
Total runs:
5
Run Growth:
3
Growth Rate:
60.00%
Total runs:
5
Run Growth:
4
Growth Rate:
80.00%
Total runs:
4
Run Growth:
3
Growth Rate:
75.00%
Total runs:
4
Run Growth:
2
Growth Rate:
50.00%
Total runs:
4
Run Growth:
3
Growth Rate:
75.00%
Total runs:
4
Run Growth:
2
Growth Rate:
50.00%
Total runs:
4
Run Growth:
2
Growth Rate:
50.00%
Total runs:
4
Run Growth:
4
Growth Rate:
100.00%