This is one of the decoder-only language models trained on
HPLT2.0_cleaned
.
All the HPLT decoder-only models use the same hyper-parameters, roughly following the llama architecture with 2.15B parameters in total:
hidden size: 2048
attention heads: 32
layers: 24
sequence length: 2048
Intermediate checkpoints
We are releasing intermediate checkpoints for each model at intervals of every 1000 training steps in separate branches. The naming convention is
checkpoint_00xxxx00
: for example,
checkpoint_0005000
. The checkpoints range from checkpoint_0001000 to checkpoint_0047684 and the latter is in the main branch.
Cite us
@misc{burchell2025expandedmassivemultilingualdataset,
title={An Expanded Massive Multilingual Dataset for High-Performance Language Technologies},
author={Laurie Burchell and Ona de Gibert and Nikolay Arefyev and Mikko Aulamo and Marta Bañón and Pinzhen Chen and Mariia Fedorova and Liane Guillou and Barry Haddow and Jan Hajič and Jindřich Helcl and Erik Henriksson and Mateusz Klimaszewski and Ville Komulainen and Andrey Kutuzov and Joona Kytöniemi and Veronika Laippala and Petter Mæhlum and Bhavitvya Malik and Farrokh Mehryary and Vladislav Mikhailov and Nikita Moghe and Amanda Myntti and Dayyán O'Brien and Stephan Oepen and Proyag Pal and Jousia Piha and Sampo Pyysalo and Gema Ramírez-Sánchez and David Samuel and Pavel Stepachev and Jörg Tiedemann and Dušan Variš and Tereza Vojtěchová and Jaume Zaragoza-Bernabeu},
year={2025},
eprint={2503.10267},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2503.10267},
}
Runs of HPLT hplt2c_spa_checkpoints on huggingface.co
2.4K
Total runs
0
24-hour runs
22
3-day runs
64
7-day runs
2.4K
30-day runs
More Information About hplt2c_spa_checkpoints huggingface.co Model
hplt2c_spa_checkpoints huggingface.co is an AI model on huggingface.co that provides hplt2c_spa_checkpoints's model effect (), which can be used instantly with this HPLT hplt2c_spa_checkpoints model. huggingface.co supports a free trial of the hplt2c_spa_checkpoints model, and also provides paid use of the hplt2c_spa_checkpoints. Support call hplt2c_spa_checkpoints model through api, including Node.js, Python, http.
hplt2c_spa_checkpoints huggingface.co is an online trial and call api platform, which integrates hplt2c_spa_checkpoints's modeling effects, including api services, and provides a free online trial of hplt2c_spa_checkpoints, you can try hplt2c_spa_checkpoints online for free by clicking the link below.
HPLT hplt2c_spa_checkpoints online free url in huggingface.co:
hplt2c_spa_checkpoints is an open source model from GitHub that offers a free installation service, and any user can find hplt2c_spa_checkpoints on GitHub to install. At the same time, huggingface.co provides the effect of hplt2c_spa_checkpoints install, users can directly use hplt2c_spa_checkpoints installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
hplt2c_spa_checkpoints install url in huggingface.co: