KBLab / megatron-bert-base-swedish-cased-600k

huggingface.co
Total runs: 102
24-hour runs: 28
7-day runs: 57
30-day runs: -43
Model's Last Updated: March 21 2023
fill-mask

Introduction of megatron-bert-base-swedish-cased-600k

Model Details of megatron-bert-base-swedish-cased-600k

Megatron-BERT-base Swedish 600k

This BERT model was trained using the Megatron-LM library. The size of the model is a regular BERT-base with 110M parameters. The model was trained on about 70GB of data, consisting mostly of OSCAR and Swedish newspaper text curated by the National Library of Sweden.

Training was done for 600k training steps. Its sister model used the same setup, but was instead trained for only 125k steps.

The model has three sister models trained on the same dataset:

Acknowledgements

We gratefully acknowledge the HPC RIVR consortium ( https://www.hpc-rivr.si ) and EuroHPC JU ( https://eurohpc-ju.europa.eu ) for funding this research by providing computing resources of the HPC system Vega at the Institute of Information Science ( https://www.izum.si ).

Runs of KBLab megatron-bert-base-swedish-cased-600k on huggingface.co

102
Total runs
28
24-hour runs
48
3-day runs
57
7-day runs
-43
30-day runs

More Information About megatron-bert-base-swedish-cased-600k huggingface.co Model

megatron-bert-base-swedish-cased-600k huggingface.co

megatron-bert-base-swedish-cased-600k huggingface.co is an AI model on huggingface.co that provides megatron-bert-base-swedish-cased-600k's model effect (), which can be used instantly with this KBLab megatron-bert-base-swedish-cased-600k model. huggingface.co supports a free trial of the megatron-bert-base-swedish-cased-600k model, and also provides paid use of the megatron-bert-base-swedish-cased-600k. Support call megatron-bert-base-swedish-cased-600k model through api, including Node.js, Python, http.

megatron-bert-base-swedish-cased-600k huggingface.co Url

https://huggingface.co/KBLab/megatron-bert-base-swedish-cased-600k

KBLab megatron-bert-base-swedish-cased-600k online free

megatron-bert-base-swedish-cased-600k huggingface.co is an online trial and call api platform, which integrates megatron-bert-base-swedish-cased-600k's modeling effects, including api services, and provides a free online trial of megatron-bert-base-swedish-cased-600k, you can try megatron-bert-base-swedish-cased-600k online for free by clicking the link below.

KBLab megatron-bert-base-swedish-cased-600k online free url in huggingface.co:

https://huggingface.co/KBLab/megatron-bert-base-swedish-cased-600k

megatron-bert-base-swedish-cased-600k install

megatron-bert-base-swedish-cased-600k is an open source model from GitHub that offers a free installation service, and any user can find megatron-bert-base-swedish-cased-600k on GitHub to install. At the same time, huggingface.co provides the effect of megatron-bert-base-swedish-cased-600k install, users can directly use megatron-bert-base-swedish-cased-600k installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

megatron-bert-base-swedish-cased-600k install url in huggingface.co:

https://huggingface.co/KBLab/megatron-bert-base-swedish-cased-600k

Url of megatron-bert-base-swedish-cased-600k

megatron-bert-base-swedish-cased-600k huggingface.co Url

Provider of megatron-bert-base-swedish-cased-600k huggingface.co

KBLab
ORGANIZATIONS

Other API from KBLab

huggingface.co

Total runs: 9.8K
Run Growth: -12.7K
Growth Rate: -129.27%
Updated:August 27 2025
huggingface.co

Total runs: 952
Run Growth: -4.0K
Growth Rate: -422.48%
Updated:August 27 2025