Sponsored by
Vmake Labs Video Enhancer
ai-forever / mGPT-1.3B-belorussian
Model's Last Updated: August 11 2023
text-generation
Introduction of mGPT-1.3B-belorussian
Model Details of mGPT-1.3B-belorussian
๐ง๐พ Belorussian mGPT 1.3B
Language model for Belorussian. Model has 1.3B parameters as you can guess from it's name.
Belorussian belongs to Indo-European language family. It's a very rhythmic language with approximately 6.8 million speakers. Here are some facts about it:
- One of the East Slavic languages, alongside Russian and Ukrainian.
- It uses a variant of the Cyrillic script.
- It has a strong cultural connection with literature and folklore.
Technical details
It's one of the models derived from the base mGPT-XL (1.3B) model (see the list below) which was originally trained on the 61 languages from 25 language families using Wikipedia and C4 corpus.
We've found additional data for 23 languages most of which are considered as minor and decided to further tune the base model. Belorussian mGPT 1.3B was trained for another 10000 steps with batch_size=4 and context window of 2048 tokens on 1 A100.
Final perplexity for this model on validation is 27.65 .
Chart of the training loss and perplexity:
Other mGPT-1.3B models
- ๐ฆ๐ฒ mGPT-1.3B Armenian
- ๐ฆ๐ฟ mGPT-1.3B Azerbaijan
- ๐ฏ mGPT-1.3B Bashkir
- ๐ง๐ฌ mGPT-1.3B Bulgarian
- ๐ mGPT-1.3B Buryat
- ๐ณ mGPT-1.3B Chuvash
- ๐ฌ๐ช mGPT-1.3B Georgian
- ๐ธ mGPT-1.3B Kalmyk
- ๐ฐ๐ฟ mGPT-1.3B Kazakh
- ๐ฐ๐ฌ mGPT-1.3B Kirgiz
- ๐ป mGPT-1.3B Mari
- ๐ฒ๐ณ mGPT-1.3B Mongol
- ๐ mGPT-1.3B Ossetian
- ๐ฎ๐ท mGPT-1.3B Persian
- ๐ท๐ด mGPT-1.3B Romanian
- ๐น๐ฏ mGPT-1.3B Tajik
- โ mGPT-1.3B Tatar
- ๐น๐ฒ mGPT-1.3B Turkmen
- ๐ mGPT-1.3B Tuvan
- ๐บ๐ฆ mGPT-1.3B Ukranian
- ๐บ๐ฟ mGPT-1.3B Uzbek
- ๐ mGPT-1.3B Yakut
Feedback
If you'll found a bug of have additional data to train model on your language โ please, give us feedback.
Model will be improved over time. Stay tuned!
Runs of ai-forever mGPT-1.3B-belorussian on huggingface.co
92
Total runs
-1
24-hour runs
-5
3-day runs
-7
7-day runs
1
30-day runs
More Information About mGPT-1.3B-belorussian huggingface.co Model
Url of mGPT-1.3B-belorussian
mGPT-1.3B-belorussian huggingface.co Url
Provider of mGPT-1.3B-belorussian huggingface.co
Other API from ai-forever
Total runs:
134.7K
Run Growth:
23.8K
Growth Rate:
17.26%
Total runs:
119.8K
Run Growth:
76.0K
Growth Rate:
59.44%
Total runs:
51.7K
Run Growth:
-3.5K
Growth Rate:
-6.83%
Total runs:
8.4K
Run Growth:
-1.7K
Growth Rate:
-19.66%
Total runs:
8.4K
Run Growth:
-4.9K
Growth Rate:
-57.69%
Total runs:
8.2K
Run Growth:
6.5K
Growth Rate:
84.31%
Total runs:
5.7K
Run Growth:
1.2K
Growth Rate:
21.29%
Total runs:
2.9K
Run Growth:
-744
Growth Rate:
-24.73%
Total runs:
2.5K
Run Growth:
1.3K
Growth Rate:
54.15%
Total runs:
2.5K
Run Growth:
206
Growth Rate:
8.20%
Total runs:
1.6K
Run Growth:
2.8K
Growth Rate:
87.07%
Total runs:
1.6K
Run Growth:
1.5K
Growth Rate:
90.71%
Total runs:
1.5K
Run Growth:
-313
Growth Rate:
-18.22%
Total runs:
1.1K
Run Growth:
1.0K
Growth Rate:
100.00%
Total runs:
780
Run Growth:
460
Growth Rate:
58.97%
Total runs:
721
Run Growth:
105
Growth Rate:
14.69%
Total runs:
665
Run Growth:
177
Growth Rate:
26.54%
Total runs:
659
Run Growth:
-1.4K
Growth Rate:
-203.34%
Total runs:
602
Run Growth:
425
Growth Rate:
70.60%
Total runs:
505
Run Growth:
188
Growth Rate:
37.68%
Total runs:
404
Run Growth:
-229
Growth Rate:
-57.97%
Total runs:
402
Run Growth:
253
Growth Rate:
61.71%
Total runs:
385
Run Growth:
-224
Growth Rate:
-57.29%
Total runs:
359
Run Growth:
-202
Growth Rate:
-57.39%
Total runs:
335
Run Growth:
116
Growth Rate:
34.94%
Total runs:
332
Run Growth:
-20.4K
Growth Rate:
-6397.81%
Total runs:
298
Run Growth:
89
Growth Rate:
30.27%
Total runs:
290
Run Growth:
-73
Growth Rate:
-24.25%
Total runs:
274
Run Growth:
12
Growth Rate:
4.17%
Total runs:
185
Run Growth:
36
Growth Rate:
19.35%
Total runs:
176
Run Growth:
-113
Growth Rate:
-64.20%
Total runs:
174
Run Growth:
-62
Growth Rate:
-35.23%
Total runs:
171
Run Growth:
7
Growth Rate:
4.09%
Total runs:
170
Run Growth:
-6
Growth Rate:
-3.59%
Total runs:
163
Run Growth:
50
Growth Rate:
31.06%
Total runs:
162
Run Growth:
11
Growth Rate:
6.83%
Total runs:
113
Run Growth:
23
Growth Rate:
20.91%
Total runs:
113
Run Growth:
25
Growth Rate:
22.73%
Total runs:
111
Run Growth:
18
Growth Rate:
16.36%
Total runs:
110
Run Growth:
25
Growth Rate:
23.15%
Total runs:
106
Run Growth:
14
Growth Rate:
13.73%
Total runs:
103
Run Growth:
15
Growth Rate:
15.00%
Total runs:
102
Run Growth:
-1
Growth Rate:
-1.00%
Total runs:
101
Run Growth:
-11
Growth Rate:
-11.22%
Total runs:
100
Run Growth:
-5
Growth Rate:
-5.10%
Total runs:
97
Run Growth:
9
Growth Rate:
9.57%
Total runs:
97
Run Growth:
-141
Growth Rate:
-150.00%
Total runs:
97
Run Growth:
-10
Growth Rate:
-10.53%
Total runs:
96
Run Growth:
10
Growth Rate:
10.64%
Total runs:
95
Run Growth:
5
Growth Rate:
5.43%
Total runs:
93
Run Growth:
-17
Growth Rate:
-18.89%
Total runs:
92
Run Growth:
22
Growth Rate:
23.91%
Total runs:
88
Run Growth:
12
Growth Rate:
13.95%
Total runs:
86
Run Growth:
-109
Growth Rate:
-126.74%
Total runs:
83
Run Growth:
-53
Growth Rate:
-67.95%
Total runs:
82
Run Growth:
53
Growth Rate:
64.63%
Total runs:
67
Run Growth:
3
Growth Rate:
4.48%
Total runs:
59
Run Growth:
30
Growth Rate:
50.85%
Total runs:
45
Run Growth:
19
Growth Rate:
42.22%
Total runs:
44
Run Growth:
21
Growth Rate:
47.73%
Total runs:
43
Run Growth:
20
Growth Rate:
46.51%
Total runs:
39
Run Growth:
8
Growth Rate:
20.51%
Total runs:
39
Run Growth:
19
Growth Rate:
48.72%
Total runs:
38
Run Growth:
-8
Growth Rate:
-21.05%
Total runs:
38
Run Growth:
-16
Growth Rate:
-42.11%
Total runs:
38
Run Growth:
8
Growth Rate:
21.05%
Total runs:
36
Run Growth:
0
Growth Rate:
0.00%
Total runs:
32
Run Growth:
-1
Growth Rate:
-3.13%
Total runs:
31
Run Growth:
-4
Growth Rate:
-12.90%
Total runs:
30
Run Growth:
0
Growth Rate:
0.00%
Total runs:
19
Run Growth:
9
Growth Rate:
47.37%
Total runs:
19
Run Growth:
19
Growth Rate:
100.00%
Total runs:
16
Run Growth:
-16
Growth Rate:
-100.00%
Total runs:
13
Run Growth:
-6
Growth Rate:
-54.55%