Sponsored by
Designkit Free Background Remover
-Designkit offers free AI background removal for up to 100 images daily, with batch processing, custom backgrounds, and resizing.
This model is a Slovene GPT model, based on the
bigscience workshop
fork of the Megatron. GPT-sl-base was trained on large Slovene corpora: Gigafida, KAS, slWaC, and MaCoCu.
Model architecture
GPT-sl-base has about 110 million parameters. It consists of 12 transformer layers with a dimension of 768. It has 16 attention heads and can process sequences up to 1024 tokens in length.
The tokenizer was trained on a smaller subset of the corpora, and has the vocabulary of 60k tokens.
Training
The model was trained for about 20 epochs, a total of 390k steps or 102B tokens seen during training.
Step
Validation Perplexity
50000
26.801
100000
25.574
150000
24.773
200000
24.099
250000
23.336
300000
22.607
350000
22.329
390000
22.293
Runs of cjvt gpt-sl-base on huggingface.co
27
Total runs
0
24-hour runs
0
3-day runs
-1
7-day runs
3
30-day runs
More Information About gpt-sl-base huggingface.co Model
gpt-sl-base huggingface.co is an AI model on huggingface.co that provides gpt-sl-base's model effect (), which can be used instantly with this cjvt gpt-sl-base model. huggingface.co supports a free trial of the gpt-sl-base model, and also provides paid use of the gpt-sl-base. Support call gpt-sl-base model through api, including Node.js, Python, http.
gpt-sl-base huggingface.co is an online trial and call api platform, which integrates gpt-sl-base's modeling effects, including api services, and provides a free online trial of gpt-sl-base, you can try gpt-sl-base online for free by clicking the link below.
cjvt gpt-sl-base online free url in huggingface.co:
gpt-sl-base is an open source model from GitHub that offers a free installation service, and any user can find gpt-sl-base on GitHub to install. At the same time, huggingface.co provides the effect of gpt-sl-base install, users can directly use gpt-sl-base installed effect in huggingface.co for debugging and trial. It also supports api for free installation.