We celebrate three years of experiments with the release of
palmer-006
, our flagship and extremely small language model for local experimentation, edge hardware, small SBCs, and low-power devices. Note that this model serves primarily as a language model and has not been validated nor finetuned as a general-purpose chat assistant. Thus further finetuning is required to properly work as an instruction-tuned model.
We first lightly fine-tuned the base model on a diverse set of highly curated data points. We then “palmerized” it by merging models, followed by another light fine-tuning round. Finally, we adjusted Mamba for maximum token speed. With only 90M parameters, this turned the model into a competitive baseline against models above 125M parameters.
As seen in the benchmark, we are getting closer to the performance of bigger models with our current technique, even on models of this size. Note: We used
acc_norm
whenever available.
● quick test
You can load
model.gguf
model into a llama-server, then run the script inside this repo as follows:
python completion.py prompt.txt
● license
Open research, education, hobby use, modification, and redistribution are permitted. Commercial deployment, internal business use, paid products, hosted APIs, and client work require a separate commercial license from appvoid. For commercial licensing:
[email protected]
👋 But hey! If you already have a
donation subscription
, you can claim access to a free commercial license through the email above. You will keep the rights as long as the subscription is active.
● upstream attribution
palmer-006 is built using artificial intelligence technology from the Technology Innovation Institute.
● fun facts
the new logo represents palmer's eye, pointing how small this new model is
palmer models still exists to some extent due to inspiration from Karpathy's idea of a self-contained "cognitive core".
we just like light finetuning because we prefer starting "real" experiments with the strongest baseline possible
Runs of appvoid palmer-006 on huggingface.co
216
Total runs
0
24-hour runs
4
3-day runs
97
7-day runs
172
30-day runs
More Information About palmer-006 huggingface.co Model
palmer-006 huggingface.co is an AI model on huggingface.co that provides palmer-006's model effect (), which can be used instantly with this appvoid palmer-006 model. huggingface.co supports a free trial of the palmer-006 model, and also provides paid use of the palmer-006. Support call palmer-006 model through api, including Node.js, Python, http.
palmer-006 huggingface.co is an online trial and call api platform, which integrates palmer-006's modeling effects, including api services, and provides a free online trial of palmer-006, you can try palmer-006 online for free by clicking the link below.
appvoid palmer-006 online free url in huggingface.co:
palmer-006 is an open source model from GitHub that offers a free installation service, and any user can find palmer-006 on GitHub to install. At the same time, huggingface.co provides the effect of palmer-006 install, users can directly use palmer-006 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.