cjvt / sleng-bert

huggingface.co
Total runs: 11
24-hour runs: -1
7-day runs: -3
30-day runs: -26
Model's Last Updated: January 08 2023
fill-mask

Introduction of sleng-bert

Model Details of sleng-bert

SlEng-bert

SlEng-bert is a bilingual, Slovene-English masked language model.

SlEng-bert was trained from scratch on Slovene and English, conversational, non-standard, and slang language. The model has 12 transformer layers, and is roughly equal in size to BERT and RoBERTa base models. The pre-training task used was masked language modeling, with no other tasks (like NSP).

The tokenizer and corpora used to train SlEng-bert were also used for training the SloBERTa-SlEng model. The difference between the two is: SlEng-bert was trained from scratch for 40 epochs; SloBERTa-SlEng is SloBERTa further pre-trained for 2 epochs on new corpora.

Training corpora

The model was trained on English and Slovene tweets, Slovene corpora MaCoCu and Frenk , and a small subset of English Oscar corpus. We tried to keep the sizes of English and Slovene corpora as equal as possible. Training corpora had in total about 2.7 billion words.

Runs of cjvt sleng-bert on huggingface.co

11
Total runs
-1
24-hour runs
-2
3-day runs
-3
7-day runs
-26
30-day runs

More Information About sleng-bert huggingface.co Model

sleng-bert huggingface.co

sleng-bert huggingface.co is an AI model on huggingface.co that provides sleng-bert's model effect (), which can be used instantly with this cjvt sleng-bert model. huggingface.co supports a free trial of the sleng-bert model, and also provides paid use of the sleng-bert. Support call sleng-bert model through api, including Node.js, Python, http.

sleng-bert huggingface.co Url

https://huggingface.co/cjvt/sleng-bert

cjvt sleng-bert online free

sleng-bert huggingface.co is an online trial and call api platform, which integrates sleng-bert's modeling effects, including api services, and provides a free online trial of sleng-bert, you can try sleng-bert online for free by clicking the link below.

cjvt sleng-bert online free url in huggingface.co:

https://huggingface.co/cjvt/sleng-bert

sleng-bert install

sleng-bert is an open source model from GitHub that offers a free installation service, and any user can find sleng-bert on GitHub to install. At the same time, huggingface.co provides the effect of sleng-bert install, users can directly use sleng-bert installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

sleng-bert install url in huggingface.co:

https://huggingface.co/cjvt/sleng-bert

Url of sleng-bert

sleng-bert huggingface.co Url

Provider of sleng-bert huggingface.co

cjvt
ORGANIZATIONS

Other API from cjvt

huggingface.co

Total runs: 2.0K
Run Growth: -1.0K
Growth Rate: -50.94%
Updated:June 02 2025
huggingface.co

Total runs: 122
Run Growth: -109
Growth Rate: -89.34%
Updated:January 28 2025
huggingface.co

Total runs: 63
Run Growth: -50
Growth Rate: -79.37%
Updated:January 20 2026
huggingface.co

Total runs: 49
Run Growth: -50
Growth Rate: -102.04%
Updated:March 21 2025
huggingface.co

Total runs: 46
Run Growth: 30
Growth Rate: 65.22%
Updated:January 28 2025
huggingface.co

Total runs: 41
Run Growth: 34
Growth Rate: 82.93%
Updated:November 08 2022
huggingface.co

Total runs: 27
Run Growth: 23
Growth Rate: 85.19%
Updated:March 21 2025
huggingface.co

Total runs: 25
Run Growth: -25
Growth Rate: -100.00%
Updated:March 20 2025
huggingface.co

Total runs: 18
Run Growth: 11
Growth Rate: 61.11%
Updated:April 04 2025
huggingface.co

Total runs: 17
Run Growth: -26
Growth Rate: -152.94%
Updated:January 08 2023
huggingface.co

Total runs: 7
Run Growth: 0
Growth Rate: 0.00%
Updated:September 28 2022
huggingface.co

Total runs: 7
Run Growth: 1
Growth Rate: 14.29%
Updated:November 11 2022
huggingface.co

Total runs: 3
Run Growth: -6
Growth Rate: -200.00%
Updated:January 02 2023