blockblockblock / smol_llama-220M-GQA-bpw2.5

huggingface.co
Total runs: 23
24-hour runs: 0
7-day runs: -1
30-day runs: 8
Model's Last Updated: March 13 2024
text-generation

Introduction of smol_llama-220M-GQA-bpw2.5

Model Details of smol_llama-220M-GQA-bpw2.5

smol_llama: 220M GQA

model card WIP, more details to come

A small 220M param (total) decoder model. This is the first version of the model.

  • 1024 hidden size, 10 layers
  • GQA (32 heads, 8 key-value), context length 2048
  • train-from-scratch on one GPU :)
Links

Here are some fine-tunes we did, but there are many more possibilities out there!


Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 29.44
AI2 Reasoning Challenge (25-Shot) 24.83
HellaSwag (10-Shot) 29.76
MMLU (5-Shot) 25.85
TruthfulQA (0-shot) 44.55
Winogrande (5-shot) 50.99
GSM8k (5-shot) 0.68

Runs of blockblockblock smol_llama-220M-GQA-bpw2.5 on huggingface.co

23
Total runs
0
24-hour runs
0
3-day runs
-1
7-day runs
8
30-day runs

More Information About smol_llama-220M-GQA-bpw2.5 huggingface.co Model

More smol_llama-220M-GQA-bpw2.5 license Visit here:

https://choosealicense.com/licenses/apache-2.0

smol_llama-220M-GQA-bpw2.5 huggingface.co

smol_llama-220M-GQA-bpw2.5 huggingface.co is an AI model on huggingface.co that provides smol_llama-220M-GQA-bpw2.5's model effect (), which can be used instantly with this blockblockblock smol_llama-220M-GQA-bpw2.5 model. huggingface.co supports a free trial of the smol_llama-220M-GQA-bpw2.5 model, and also provides paid use of the smol_llama-220M-GQA-bpw2.5. Support call smol_llama-220M-GQA-bpw2.5 model through api, including Node.js, Python, http.

smol_llama-220M-GQA-bpw2.5 huggingface.co Url

https://huggingface.co/blockblockblock/smol_llama-220M-GQA-bpw2.5

blockblockblock smol_llama-220M-GQA-bpw2.5 online free

smol_llama-220M-GQA-bpw2.5 huggingface.co is an online trial and call api platform, which integrates smol_llama-220M-GQA-bpw2.5's modeling effects, including api services, and provides a free online trial of smol_llama-220M-GQA-bpw2.5, you can try smol_llama-220M-GQA-bpw2.5 online for free by clicking the link below.

blockblockblock smol_llama-220M-GQA-bpw2.5 online free url in huggingface.co:

https://huggingface.co/blockblockblock/smol_llama-220M-GQA-bpw2.5

smol_llama-220M-GQA-bpw2.5 install

smol_llama-220M-GQA-bpw2.5 is an open source model from GitHub that offers a free installation service, and any user can find smol_llama-220M-GQA-bpw2.5 on GitHub to install. At the same time, huggingface.co provides the effect of smol_llama-220M-GQA-bpw2.5 install, users can directly use smol_llama-220M-GQA-bpw2.5 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

smol_llama-220M-GQA-bpw2.5 install url in huggingface.co:

https://huggingface.co/blockblockblock/smol_llama-220M-GQA-bpw2.5

Url of smol_llama-220M-GQA-bpw2.5

smol_llama-220M-GQA-bpw2.5 huggingface.co Url

Provider of smol_llama-220M-GQA-bpw2.5 huggingface.co

blockblockblock
ORGANIZATIONS

Other API from blockblockblock