In this repository, we propose the next iteration of
arco
, a new meta-learner small language model. Now with
qwen
as the base architecture for improvements.
During previous research, we first noticed a dramatic underpeformance on fewshot prompting from previous
arco
series (regardless of benchmark improvements on arc) so we decided that the main concept to work on was making a more robust fewshot learning by focusing directly on tasks that improve that skill with a stronger baseline model like
qwen
family.
After several merging iterations with some openly available models, we finally achieved a strong baseline for a meta-learner model which we called
arco-3
. This model will serve as the starting point for future fewshot finetunings and experiments.
prompt
There is no prompt intentionally set.
benchmarks
meta arena
We tested around 65 models against each other with fewshot tasks and used
gemini-2.5-pro
to chose the best answers from each one. Currently, it ranks 13th in
meta-arena
.
language modeling
To our surprise, this model also improved some language modeling tasks over the base model on several well-known benchmarks.
Parameters
Model
MMLU
ARC-C
HellaSwag
PIQA
Winogrande
Average
0.6b
qwen 3
40.31
34.47
47.38
67.46
56.04
49.13
0.6b
arco 3
43.34
36.01
49.56
68.17
58.09
51.03
limitations
The model also comes with several limitations that shares with its base model:
Lack of creative outputs
Poor causality understanding
Extremely bad summarization skills
Hallucinations
We have a plan to tackle each one of these issues and are already planned to be corrected in the future.
supporters
trivia
arco
means "bow" in spanish, which is just another way to say that hits its target fast and accurately.
Note
: the model has not been tested as a chat assistant and it might not work as intended, use with caution.
Runs of appvoid arco-3 on huggingface.co
29
Total runs
0
24-hour runs
0
3-day runs
4
7-day runs
6
30-day runs
More Information About arco-3 huggingface.co Model
arco-3 huggingface.co is an AI model on huggingface.co that provides arco-3's model effect (), which can be used instantly with this appvoid arco-3 model. huggingface.co supports a free trial of the arco-3 model, and also provides paid use of the arco-3. Support call arco-3 model through api, including Node.js, Python, http.
arco-3 huggingface.co is an online trial and call api platform, which integrates arco-3's modeling effects, including api services, and provides a free online trial of arco-3, you can try arco-3 online for free by clicking the link below.
arco-3 is an open source model from GitHub that offers a free installation service, and any user can find arco-3 on GitHub to install. At the same time, huggingface.co provides the effect of arco-3 install, users can directly use arco-3 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.