The total size of the corpus after document-level deduplication and filtering was 7.41B tokens, split equally between the two languages. The model was trained using a WordPiece tokenizer with a vocabulary size of 64,105 for 1.1 million steps, and otherwise with default settings.
Acknowledgments
This research was supported with Cloud TPUs from Google's TPU Research Cloud (TRC).
This project was funded by the Language Technology Programme for Icelandic 2019-2023. The programme, which is managed and coordinated by
Almannarómur
, is funded by the Icelandic Ministry of Education, Science and Culture.
Runs of jonfd electra-small-is-no on huggingface.co
14
Total runs
0
24-hour runs
0
3-day runs
-2
7-day runs
6
30-day runs
More Information About electra-small-is-no huggingface.co Model
electra-small-is-no huggingface.co is an AI model on huggingface.co that provides electra-small-is-no's model effect (), which can be used instantly with this jonfd electra-small-is-no model. huggingface.co supports a free trial of the electra-small-is-no model, and also provides paid use of the electra-small-is-no. Support call electra-small-is-no model through api, including Node.js, Python, http.
electra-small-is-no huggingface.co is an online trial and call api platform, which integrates electra-small-is-no's modeling effects, including api services, and provides a free online trial of electra-small-is-no, you can try electra-small-is-no online for free by clicking the link below.
jonfd electra-small-is-no online free url in huggingface.co:
electra-small-is-no is an open source model from GitHub that offers a free installation service, and any user can find electra-small-is-no on GitHub to install. At the same time, huggingface.co provides the effect of electra-small-is-no install, users can directly use electra-small-is-no installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
electra-small-is-no install url in huggingface.co: