Goal is to create a strong language generation model for Mongolian
Since initial code and data is pretty much written by @patrickvonplaten and other huggingface members, it should not be so hard to get the first sense.
Model
Randomly initialized GPT2 model
Datasets
We can use OSCAR which is available through datasets
Datasets
A causal language modeling script for Flax is available here 1. It can be used pretty much without any required code changes.
If there is time left, I’d love to try some private crawling and integrate it datasets.
Expected Outcome
Understandable Mongolian text generation model
Challenges
Lack of data → OSCAR Mongolian is just 2.2G. Maybe we need to research ways to acquire more data with this.
Runs of flax-community mongolian-gpt2 on huggingface.co
43
Total runs
0
24-hour runs
1
3-day runs
2
7-day runs
26
30-day runs
More Information About mongolian-gpt2 huggingface.co Model
mongolian-gpt2 huggingface.co
mongolian-gpt2 huggingface.co is an AI model on huggingface.co that provides mongolian-gpt2's model effect (), which can be used instantly with this flax-community mongolian-gpt2 model. huggingface.co supports a free trial of the mongolian-gpt2 model, and also provides paid use of the mongolian-gpt2. Support call mongolian-gpt2 model through api, including Node.js, Python, http.
mongolian-gpt2 huggingface.co is an online trial and call api platform, which integrates mongolian-gpt2's modeling effects, including api services, and provides a free online trial of mongolian-gpt2, you can try mongolian-gpt2 online for free by clicking the link below.
flax-community mongolian-gpt2 online free url in huggingface.co:
mongolian-gpt2 is an open source model from GitHub that offers a free installation service, and any user can find mongolian-gpt2 on GitHub to install. At the same time, huggingface.co provides the effect of mongolian-gpt2 install, users can directly use mongolian-gpt2 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.