This is a pre-release checkpoint for a Nordic generative language model currently in training.
This preliminary release is provided for HPLT (
https://hplt-project.org/
) deliverable 4.1 (“First language models trained”)(
https://hplt-project.org/deliverables
). Consult the HPLT website for further details.
More documentation will be provided soon.
UPDATE: our Nordic model is now called Viking!
Viking 7B, 13B and 33B
NOTE:
These are
research checkpoint
of a model for which
training has not been completed.
It is being provided in its current state for research and testing purposes.
Care should be taken when using the outputs of the model.
Once pretraining has completed we intend to release additional instruction-tuned and chat-tuned varieties.
Viking 7B, 13B and 13B are a 7B, 13B and 33B parameter decoder-only transformers pretrained on Finnish,
English, Swedish, Danish, Norwegian, Icelandic and code. They are being trained
on 2 trillion tokens (1.3 trillion as of this release).
Viking is a fully open source model and is made available under the Apache 2.0 License.
This project is part of an ongoing effort to create open source large language models for non-English and especially low resource languages like Finnish. The mode is fluent in Finnish, English, the Scandinavian languages and capable of basic translation between them. It is also able to understand and generate code.
gpt-13b-nordic-prerelease huggingface.co is an AI model on huggingface.co that provides gpt-13b-nordic-prerelease's model effect (), which can be used instantly with this HPLT gpt-13b-nordic-prerelease model. huggingface.co supports a free trial of the gpt-13b-nordic-prerelease model, and also provides paid use of the gpt-13b-nordic-prerelease. Support call gpt-13b-nordic-prerelease model through api, including Node.js, Python, http.
gpt-13b-nordic-prerelease huggingface.co is an online trial and call api platform, which integrates gpt-13b-nordic-prerelease's modeling effects, including api services, and provides a free online trial of gpt-13b-nordic-prerelease, you can try gpt-13b-nordic-prerelease online for free by clicking the link below.
HPLT gpt-13b-nordic-prerelease online free url in huggingface.co:
gpt-13b-nordic-prerelease is an open source model from GitHub that offers a free installation service, and any user can find gpt-13b-nordic-prerelease on GitHub to install. At the same time, huggingface.co provides the effect of gpt-13b-nordic-prerelease install, users can directly use gpt-13b-nordic-prerelease installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
gpt-13b-nordic-prerelease install url in huggingface.co: