Introduction of bertin-base-stepwise-exp-512seqlen
Model Details of bertin-base-stepwise-exp-512seqlen
This is a
RoBERTa-base
model trained from scratch in Spanish.
The training dataset is
mc4
subsampling documents to a total of about 50 million examples. Sampling is biased towards average perplexity values (using a Gaussian function), discarding more often documents with very large values (poor quality) of very small values (short, repetitive texts).
This model takes the one using
sequence length 128
and trains during 25.000 steps using sequence length 512.
bertin-base-stepwise-exp-512seqlen huggingface.co is an AI model on huggingface.co that provides bertin-base-stepwise-exp-512seqlen's model effect (), which can be used instantly with this bertin-project bertin-base-stepwise-exp-512seqlen model. huggingface.co supports a free trial of the bertin-base-stepwise-exp-512seqlen model, and also provides paid use of the bertin-base-stepwise-exp-512seqlen. Support call bertin-base-stepwise-exp-512seqlen model through api, including Node.js, Python, http.
bertin-base-stepwise-exp-512seqlen huggingface.co is an online trial and call api platform, which integrates bertin-base-stepwise-exp-512seqlen's modeling effects, including api services, and provides a free online trial of bertin-base-stepwise-exp-512seqlen, you can try bertin-base-stepwise-exp-512seqlen online for free by clicking the link below.
bertin-project bertin-base-stepwise-exp-512seqlen online free url in huggingface.co:
bertin-base-stepwise-exp-512seqlen is an open source model from GitHub that offers a free installation service, and any user can find bertin-base-stepwise-exp-512seqlen on GitHub to install. At the same time, huggingface.co provides the effect of bertin-base-stepwise-exp-512seqlen install, users can directly use bertin-base-stepwise-exp-512seqlen installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
bertin-base-stepwise-exp-512seqlen install url in huggingface.co: