Sponsored by Vmake Labs Video Enhancer
Toolify Toolify logo
AI Models
SOLAR-KOEN-10.8B

beomi / SOLAR-KOEN-10.8B

Run on huggingface.co
huggingface.co
Total runs: 30
24-hour runs: 3
7-day runs: -1
30-day runs: 7
Model's Last Updated: February 20 2024
text-generation

Introduction of SOLAR-KOEN-10.8B

Model Details of SOLAR-KOEN-10.8B

Update Log

  • 2024.02.19: Initial Test version Release of SOLAR-KOEN-10.8B

SOLAR-KOEN-10.8B ⭐🇰🇷🇺🇸

Solar-KoEn represents an advanced iteration of the upstage/SOLAR-10.7B-v1.0 model, featuring an expanded vocabulary and the inclusion of a Korean+English corpus for enhanced pretraining.

Model Details

Model Developers: Junbum Lee (Beomi) & Taekyoon Choi (Taekyoon)

Variations: Solar-KoEn is available with one parameter sizes — 10.8B with Continual Pretrained version.

Input: The model accepts only text input.

Output: The model produces text output exclusively.

Model Architecture:

SOLAR-KOEN-10.8B is an auto-regressive language model that leverages an optimized transformer architecture derived from Llama-2.

Training Data Parameters Content Length GQA Tokens Learning Rate
SOLAR-KOEN-10.8B A curated mix of Korean+English Corpora 10.8B 4k O >60B* 5e -5

Vocab Expansion

Model Name Vocabulary Size Description
Original Solar 32000 Sentencepiece BPE
Expanded SOLAR-KOEN-10.8B 46336 Sentencepiece BPE. Added Korean vocab and merges

Tokenizing "안녕하세요, 오늘은 날씨가 좋네요."

  • SOLAR-10.7B: 26 tokens
  • SOLAR-KO-10.7b: 10 tokens
Model Tokens
SOLAR-10.7B ['▁', '안', '<0xEB>', '<0x85>', '<0x95>', '하', '세', '요', ',', '▁', '오', '<0xEB>', '<0x8A>', '<0x98>', '은', '▁', '날', '<0xEC>', '<0x94>', '<0xA8>', '가', '▁', '좋', '네', '요', '.']
SOLAR-KOEN-10.8B ['▁안', '녕', '하세요', ',', '▁오늘', '은', '▁날', '씨가', '▁좋네요', '.']

Tokenizing "Meet 10.7B Solar: Elevating Performance with Upstage Depth UP Scaling!"

  • SOLAR-10.7B: 22 tokens
  • SOLAR-KO-10.7b: 22 tokens
Model Tokens
SOLAR-10.7B ['▁Meet', '▁', '1', '0', '.', '7', 'B', '▁Solar', ':', '▁E', 'lev', 'ating', '▁Performance', '▁with', '▁Up', 'stage', '▁Dep', 'th', '▁UP', '▁Scal', 'ing', '!']
SOLAR-KOEN-10.8B ['▁Meet', '▁', '1', '0', '.', '7', 'B', '▁Solar', ':', '▁E', 'lev', 'ating', '▁Performance', '▁with', '▁Up', 'stage', '▁Dep', 'th', '▁UP', '▁Scal', 'ing', '!']

LICENSE

CC-BY-NC-SA-4.0

Model Benchmark

LM Eval Harness - Korean (polyglot branch)
Task Version Metric Value Stderr
klue_mrc 0 exact 50.2140
f1 54.0330
HasAns_exact 73.1786
HasAns_f1 78.7442
best_exact 56.9594
best_f1 60.3743
korquad 1 exact_match 81.0530
f1 87.6418
klue_nli 0 acc 0.4540 ± 0.0091
klue_sts 0 acc 0.3410 ± 0.0208
f1 0.4896 ± 0.0237
klue_ynat 0 acc 0.6308 ± 0.0051
macro_f1 0.6086 ± 0.0057
kobest_boolq 0 acc 0.8711 ± 0.0089
macro_f1 0.8705 ± 0.0090
kobest_copa 0 acc 0.8500 ± 0.0113
macro_f1 0.8498 ± 0.0113
kobest_hellaswag 0 acc 0.5180 ± 0.0224
acc_norm 0.6180 ± 0.0218
macro_f1 0.5138 ± 0.0224
kobest_sentineg 0 acc 0.9723 ± 0.0082
macro_f1 0.9723 ± 0.0083
kobest_wic 0 acc 0.5825 ± 0.0139
macro_f1 0.4952 ± 0.0140
kohatespeech_apeach 0 acc 0.7034 ± 0.0074
macro_f1 0.7033 ± 0.0074
nsmc 0 acc 0.8738 ± 0.0015
pawsx_ko 0 acc 0.5510 ± 0.0111
kmmlu_direct 0 exact_match 0.4220 ± 0.0909
Citation 
@misc {solar_koen_junbum_taekyoon_2024,
    author       = { {L. Junbum, Taekyoon Choi} },
    title        = { SOLAR-KOEN-10.8B },
    year         = 2024,
    url          = { https://huggingface.co/beomi/SOLAR-KOEN-10.8B },
    publisher    = { Hugging Face }
}
Acknowledgements

Runs of beomi SOLAR-KOEN-10.8B on huggingface.co

30
Total runs
3
24-hour runs
-1
3-day runs
-1
7-day runs
7
30-day runs

More Information About SOLAR-KOEN-10.8B huggingface.co Model

More SOLAR-KOEN-10.8B license Visit here:

https://choosealicense.com/licenses/cc-by-nc-sa-4.0

SOLAR-KOEN-10.8B huggingface.co

SOLAR-KOEN-10.8B huggingface.co is an AI model on huggingface.co that provides SOLAR-KOEN-10.8B's model effect (), which can be used instantly with this beomi SOLAR-KOEN-10.8B model. huggingface.co supports a free trial of the SOLAR-KOEN-10.8B model, and also provides paid use of the SOLAR-KOEN-10.8B. Support call SOLAR-KOEN-10.8B model through api, including Node.js, Python, http.

SOLAR-KOEN-10.8B huggingface.co Url

https://huggingface.co/beomi/SOLAR-KOEN-10.8B

beomi SOLAR-KOEN-10.8B online free

SOLAR-KOEN-10.8B huggingface.co is an online trial and call api platform, which integrates SOLAR-KOEN-10.8B's modeling effects, including api services, and provides a free online trial of SOLAR-KOEN-10.8B, you can try SOLAR-KOEN-10.8B online for free by clicking the link below.

beomi SOLAR-KOEN-10.8B online free url in huggingface.co:

https://huggingface.co/beomi/SOLAR-KOEN-10.8B

SOLAR-KOEN-10.8B install

SOLAR-KOEN-10.8B is an open source model from GitHub that offers a free installation service, and any user can find SOLAR-KOEN-10.8B on GitHub to install. At the same time, huggingface.co provides the effect of SOLAR-KOEN-10.8B install, users can directly use SOLAR-KOEN-10.8B installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

SOLAR-KOEN-10.8B install url in huggingface.co:

https://huggingface.co/beomi/SOLAR-KOEN-10.8B

Url of SOLAR-KOEN-10.8B

SOLAR-KOEN-10.8B huggingface.co Url

Provider of SOLAR-KOEN-10.8B huggingface.co

beomi
ORGANIZATIONS
huggingface.co

Other API from beomi

 huggingface.co
beomi/kcbert-base

Total runs: 3.7K
Run Growth: 274
Growth Rate: 7.45%
Updated:March 30 2023
huggingface.co
beomi/KcELECTRA-base

Total runs: 3.5K
Run Growth: -2.7K
Growth Rate: -77.19%
Updated:May 23 2024
huggingface.co
beomi/Yi-Ko-6B

Total runs: 545
Run Growth: -49
Growth Rate: -8.99%
Updated:July 08 2024
huggingface.co
beomi/llama-2-ko-7b

Total runs: 513
Run Growth: -153
Growth Rate: -29.82%
Updated:December 27 2023
huggingface.co
beomi/kcbert-large

Total runs: 374
Run Growth: -201
Growth Rate: -53.74%
Updated:March 30 2023
huggingface.co
beomi/kcgpt2

Total runs: 324
Run Growth: 190
Growth Rate: 58.64%
Updated:November 23 2021
huggingface.co
beomi/KoRWKV-6B

Total runs: 309
Run Growth: 128
Growth Rate: 41.42%
Updated:July 20 2023
huggingface.co
beomi/kollama-13b

Total runs: 227
Run Growth: 53
Growth Rate: 23.35%
Updated:June 28 2023
huggingface.co
beomi/Yi-Ko-DUS-9B

Total runs: 199
Run Growth: -136
Growth Rate: -68.34%
Updated:July 08 2024
huggingface.co
beomi/gemma-ko-7b

Total runs: 136
Run Growth: 13
Growth Rate: 9.35%
Updated:March 26 2024
huggingface.co
beomi/KoRWKV-1.5B

Total runs: 98
Run Growth: 42
Growth Rate: 42.86%
Updated:November 13 2023
huggingface.co
beomi/gemma-ko-2b

Total runs: 66
Run Growth: -113
Growth Rate: -182.26%
Updated:March 26 2024
huggingface.co
beomi/kobert

Total runs: 55
Run Growth: 25
Growth Rate: 45.45%
Updated:September 15 2023
huggingface.co
beomi/gemma-mling-7b

Total runs: 52
Run Growth: -6
Growth Rate: -11.54%
Updated:August 21 2024
huggingface.co
beomi/kollama-7b

Total runs: 36
Run Growth: -80
Growth Rate: -222.22%
Updated:July 11 2023
huggingface.co
beomi/Yi-Ko-34B

Total runs: 33
Run Growth: -8
Growth Rate: -24.24%
Updated:July 08 2024
huggingface.co
beomi/qwen3-8b-dmax

Total runs: 31
Run Growth: 24
Growth Rate: 77.42%
Updated:May 04 2026
huggingface.co
beomi/exKcBERT-paws

Total runs: 15
Run Growth: 2
Growth Rate: 14.29%
Updated:June 11 2021
huggingface.co
beomi/kcgpt2-dev

Total runs: 13
Run Growth: -1
Growth Rate: -7.69%
Updated:May 21 2021
huggingface.co
beomi/kollama-33b

Total runs: 12
Run Growth: 2
Growth Rate: 16.67%
Updated:June 29 2023
huggingface.co
beomi/KcT5-dev

Total runs: 10
Run Growth: -22
Growth Rate: -220.00%
Updated:March 01 2022
huggingface.co
beomi/KcRoBERTa-dev

Total runs: 9
Run Growth: 0
Growth Rate: 0.00%
Updated:March 08 2023
huggingface.co
beomi/KcBERT-v2023

Total runs: 7
Run Growth: -5
Growth Rate: -71.43%
Updated:May 07 2023
huggingface.co
beomi/llama-2-ko-70b

Total runs: 1
Run Growth: 1
Growth Rate: 100.00%
Updated:November 03 2023
huggingface.co
beomi/KcT5

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:February 10 2022
huggingface.co
beomi/exKcBERT

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:June 10 2021