This model has improved overall performance at the expense of small degradation on winogrande. As all palmer models, the model is biased to respond to answers without using any specific prompt, feel free to further fine-tune it for your specific use case.
Model
MMLU
ARC-C
HellaSwag
PIQA
Winogrande
Average
tinyllama-3t
0.2577
0.3029
0.5935
0.7329
0.5959
0.4966
palmer-004-old
0.2601
0.3456
0.6138
0.7443
0.6511
0.5229
palmer-004
0.2661
0.3490
0.6173
0.7481
0.6417
0.5244
note
Even though palmer-003 is only 2k context size, it's
0.5257
on average so if you don't need that much context size (32k) you are better off with the former one.
Runs of appvoid palmer-004 on huggingface.co
13
Total runs
1
24-hour runs
0
3-day runs
-5
7-day runs
-10
30-day runs
More Information About palmer-004 huggingface.co Model
palmer-004 huggingface.co is an AI model on huggingface.co that provides palmer-004's model effect (), which can be used instantly with this appvoid palmer-004 model. huggingface.co supports a free trial of the palmer-004 model, and also provides paid use of the palmer-004. Support call palmer-004 model through api, including Node.js, Python, http.
palmer-004 huggingface.co is an online trial and call api platform, which integrates palmer-004's modeling effects, including api services, and provides a free online trial of palmer-004, you can try palmer-004 online for free by clicking the link below.
appvoid palmer-004 online free url in huggingface.co:
palmer-004 is an open source model from GitHub that offers a free installation service, and any user can find palmer-004 on GitHub to install. At the same time, huggingface.co provides the effect of palmer-004 install, users can directly use palmer-004 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.