The total size of the corpus after document-level deduplication and filtering was 14.82B tokens, split equally between the four languages. The model was trained using a WordPiece tokenizer with a vocabulary size of 96,105 for one million steps with a batch size of 256, and otherwise with default settings.
Acknowledgments
This research was supported with Cloud TPUs from Google's TPU Research Cloud (TRC).
This project was funded by the Language Technology Programme for Icelandic 2019-2023. The programme, which is managed and coordinated by
Almannarómur
, is funded by the Icelandic Ministry of Education, Science and Culture.
Runs of jonfd electra-small-nordic on huggingface.co
7.3K
Total runs
0
24-hour runs
-1.6K
3-day runs
-20.4K
7-day runs
-25.5K
30-day runs
More Information About electra-small-nordic huggingface.co Model
electra-small-nordic huggingface.co is an AI model on huggingface.co that provides electra-small-nordic's model effect (), which can be used instantly with this jonfd electra-small-nordic model. huggingface.co supports a free trial of the electra-small-nordic model, and also provides paid use of the electra-small-nordic. Support call electra-small-nordic model through api, including Node.js, Python, http.
electra-small-nordic huggingface.co is an online trial and call api platform, which integrates electra-small-nordic's modeling effects, including api services, and provides a free online trial of electra-small-nordic, you can try electra-small-nordic online for free by clicking the link below.
jonfd electra-small-nordic online free url in huggingface.co:
electra-small-nordic is an open source model from GitHub that offers a free installation service, and any user can find electra-small-nordic on GitHub to install. At the same time, huggingface.co provides the effect of electra-small-nordic install, users can directly use electra-small-nordic installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
electra-small-nordic install url in huggingface.co: