This Icelandic GPT-2 language model was pretrained on the
Icelandic Gigaword Corpus
(IGC, 2020 version), which contains approximately 1.532 million running words. The model was trained for 20 epochs on a TPU v3-8, with a total training time of 3 days and 21 hours. The hyperparameters used for training can be found in the
JAX/Flax documentation
for the Transformers library. The model uses a byte-level BPE tokenizer with a vocabulary size of 51,000.
Note
: This model was pretrained on a tokenized and sentence-segmentized version of the IGC, which is reflected by the generated text. A new version of this model, trained on a pre-tokenized version of IGC (2022 version), is forthcoming.
Acknowledgments
This research was supported with Cloud TPUs from Google's TPU Research Cloud (TRC).
Runs of jonfd gpt2-igc-is on huggingface.co
40
Total runs
0
24-hour runs
0
3-day runs
17
7-day runs
20
30-day runs
More Information About gpt2-igc-is huggingface.co Model
gpt2-igc-is huggingface.co is an AI model on huggingface.co that provides gpt2-igc-is's model effect (), which can be used instantly with this jonfd gpt2-igc-is model. huggingface.co supports a free trial of the gpt2-igc-is model, and also provides paid use of the gpt2-igc-is. Support call gpt2-igc-is model through api, including Node.js, Python, http.
gpt2-igc-is huggingface.co is an online trial and call api platform, which integrates gpt2-igc-is's modeling effects, including api services, and provides a free online trial of gpt2-igc-is, you can try gpt2-igc-is online for free by clicking the link below.
jonfd gpt2-igc-is online free url in huggingface.co:
gpt2-igc-is is an open source model from GitHub that offers a free installation service, and any user can find gpt2-igc-is on GitHub to install. At the same time, huggingface.co provides the effect of gpt2-igc-is install, users can directly use gpt2-igc-is installed effect in huggingface.co for debugging and trial. It also supports api for free installation.