bertin-project / bertin-base-stepwise-exp-512seqlen

huggingface.co
Total runs: 41
24-hour runs: 0
7-day runs: 0
30-day runs: 17
Model's Last Updated: February 17 2025
fill-mask

Introduction of bertin-base-stepwise-exp-512seqlen

Model Details of bertin-base-stepwise-exp-512seqlen

This is a RoBERTa-base model trained from scratch in Spanish.

The training dataset is mc4 subsampling documents to a total of about 50 million examples. Sampling is biased towards average perplexity values (using a Gaussian function), discarding more often documents with very large values (poor quality) of very small values (short, repetitive texts).

This model takes the one using sequence length 128 and trains during 25.000 steps using sequence length 512.

Please see our main card for more information.

This is part of the Flax/Jax Community Week , organised by HuggingFace and TPU usage sponsored by Google.

Team members

Runs of bertin-project bertin-base-stepwise-exp-512seqlen on huggingface.co

41
Total runs
0
24-hour runs
-4
3-day runs
0
7-day runs
17
30-day runs

More Information About bertin-base-stepwise-exp-512seqlen huggingface.co Model

More bertin-base-stepwise-exp-512seqlen license Visit here:

https://choosealicense.com/licenses/cc-by-4.0

bertin-base-stepwise-exp-512seqlen huggingface.co

bertin-base-stepwise-exp-512seqlen huggingface.co is an AI model on huggingface.co that provides bertin-base-stepwise-exp-512seqlen's model effect (), which can be used instantly with this bertin-project bertin-base-stepwise-exp-512seqlen model. huggingface.co supports a free trial of the bertin-base-stepwise-exp-512seqlen model, and also provides paid use of the bertin-base-stepwise-exp-512seqlen. Support call bertin-base-stepwise-exp-512seqlen model through api, including Node.js, Python, http.

bertin-base-stepwise-exp-512seqlen huggingface.co Url

https://huggingface.co/bertin-project/bertin-base-stepwise-exp-512seqlen

bertin-project bertin-base-stepwise-exp-512seqlen online free

bertin-base-stepwise-exp-512seqlen huggingface.co is an online trial and call api platform, which integrates bertin-base-stepwise-exp-512seqlen's modeling effects, including api services, and provides a free online trial of bertin-base-stepwise-exp-512seqlen, you can try bertin-base-stepwise-exp-512seqlen online for free by clicking the link below.

bertin-project bertin-base-stepwise-exp-512seqlen online free url in huggingface.co:

https://huggingface.co/bertin-project/bertin-base-stepwise-exp-512seqlen

bertin-base-stepwise-exp-512seqlen install

bertin-base-stepwise-exp-512seqlen is an open source model from GitHub that offers a free installation service, and any user can find bertin-base-stepwise-exp-512seqlen on GitHub to install. At the same time, huggingface.co provides the effect of bertin-base-stepwise-exp-512seqlen install, users can directly use bertin-base-stepwise-exp-512seqlen installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

bertin-base-stepwise-exp-512seqlen install url in huggingface.co:

https://huggingface.co/bertin-project/bertin-base-stepwise-exp-512seqlen

Url of bertin-base-stepwise-exp-512seqlen

bertin-base-stepwise-exp-512seqlen huggingface.co Url

Provider of bertin-base-stepwise-exp-512seqlen huggingface.co

bertin-project
ORGANIZATIONS

Other API from bertin-project

huggingface.co

Total runs: 17
Run Growth: 6
Growth Rate: 35.29%
Updated:October 20 2025