Sponsored by
iMean AI Trip Planner
IIC / RigoBERTa-2.0
Model's Last Updated: November 21 2025
fill-mask
Introduction of RigoBERTa-2.0
Model Details of RigoBERTa-2.0
RigoBERTa 2.0
RigoBERTa 2.0 is a state-of-the-art encoder language model for Spanish, developed through language-adaptive pretraining. This model significantly improves performance on every previous Spanish encoder model offering robust language understanding.
Model Details
Model Description
RigoBERTa 2.0 was built by further pretraining the general-purpose FacebookAI/xlm-roberta-large on a meticulously curated Spanish corpus. The pretraining leverages masked language modeling (MLM) to adapt the model’s linguistic knowledge to the Spanish language.
- Developed by: IIC
- Model type: Encoder
- Language(s) (NLP): Spanish
- License: rigoberta-nc (permissive Non Commercial)
- Finetuned from model: FacebookAI/xlm-roberta-large
Intended Use & Limitations
Intended Use
RigoBERTa 2.0 is designed for:
- General text understanding in Spanish.
- Applications in NLP tasks such as text classification, named entity recognition, and related downstream tasks.
- Research and development purposes, including benchmarking and further model adaptation.
Note that the license is non-commercial . For a commercial use, please contact us.
Limitations & Caveats
- Data Biases: While we used a highly curated dataset, it may contain biases due to source selection and the inherent limitations of public data.
- Operational Cost: Despite being an encoder-based model with relatively lower computational costs compared to generative LLMs, deployment in resource-constrained settings should be carefully evaluated.
Training Details
Training Procedure
Preprocessing
- Tokenizer: Uses the tokenizer from FacebookAI/xlm-roberta-large to ensure consistency with the base model.
- Handling Long Sequences: Sequences exceeding 512 tokens are segmented with a stride of 128 tokens; shorter sequences are padded as necessary.
- OOV Handling: Out-of-vocabulary words are managed using subword tokenization, maintaining robust handling any kind of text.
Evaluation
RigoBERTa 2.0 was evaluated on several Spanish NLP tasks. Evaluation metrics indicate that the model outperforms previous multi-language models and general Spanish language models.
Key Results:
- Achieves top performance on most of the tested datasets.
Breakdown of the results:
Citation
If you use RigoBERTa 2.0 in your research, please cite the associated paper:
BibTeX:
@misc{rigoberta2,
author = { Instituto de Ingeniería del Conocimiento },
title = { RigoBERTa-2.0 },
year = 2025,
url = { https://huggingface.co/IIC/RigoBERTa-2.0 },
doi = { 10.57967/hf/7048 },
publisher = { Hugging Face }
}
Runs of IIC RigoBERTa-2.0 on huggingface.co
429
Total runs
0
24-hour runs
-36
3-day runs
-122
7-day runs
-227
30-day runs
More Information About RigoBERTa-2.0 huggingface.co Model
Url of RigoBERTa-2.0
RigoBERTa-2.0 huggingface.co Url
Provider of RigoBERTa-2.0 huggingface.co
Other API from IIC
Total runs:
390
Run Growth:
346
Growth Rate:
88.72%
Total runs:
32
Run Growth:
19
Growth Rate:
59.38%
Total runs:
25
Run Growth:
20
Growth Rate:
80.00%
Total runs:
20
Run Growth:
4
Growth Rate:
20.00%
Total runs:
20
Run Growth:
-10
Growth Rate:
-50.00%
Total runs:
20
Run Growth:
10
Growth Rate:
50.00%
Total runs:
19
Run Growth:
8
Growth Rate:
42.11%
Total runs:
19
Run Growth:
7
Growth Rate:
36.84%
Total runs:
19
Run Growth:
7
Growth Rate:
36.84%
Total runs:
19
Run Growth:
2
Growth Rate:
10.53%
Total runs:
19
Run Growth:
0
Growth Rate:
0.00%
Total runs:
19
Run Growth:
5
Growth Rate:
26.32%
Total runs:
19
Run Growth:
-37
Growth Rate:
-194.74%
Total runs:
18
Run Growth:
11
Growth Rate:
61.11%
Total runs:
18
Run Growth:
1
Growth Rate:
5.56%
Total runs:
18
Run Growth:
0
Growth Rate:
0.00%
Total runs:
18
Run Growth:
5
Growth Rate:
27.78%
Total runs:
17
Run Growth:
9
Growth Rate:
52.94%
Total runs:
17
Run Growth:
5
Growth Rate:
29.41%
Total runs:
17
Run Growth:
-3
Growth Rate:
-17.65%
Total runs:
17
Run Growth:
10
Growth Rate:
58.82%
Total runs:
17
Run Growth:
10
Growth Rate:
58.82%
Total runs:
16
Run Growth:
-2
Growth Rate:
-12.50%
Total runs:
16
Run Growth:
3
Growth Rate:
18.75%
Total runs:
16
Run Growth:
-2
Growth Rate:
-12.50%
Total runs:
15
Run Growth:
7
Growth Rate:
46.67%
Total runs:
15
Run Growth:
5
Growth Rate:
33.33%
Total runs:
15
Run Growth:
-2
Growth Rate:
-13.33%
Total runs:
15
Run Growth:
9
Growth Rate:
60.00%
Total runs:
15
Run Growth:
8
Growth Rate:
53.33%
Total runs:
15
Run Growth:
-2
Growth Rate:
-13.33%
Total runs:
14
Run Growth:
-2
Growth Rate:
-14.29%
Total runs:
14
Run Growth:
1
Growth Rate:
7.14%
Total runs:
14
Run Growth:
1
Growth Rate:
7.14%
Total runs:
13
Run Growth:
7
Growth Rate:
53.85%
Total runs:
13
Run Growth:
6
Growth Rate:
46.15%
Total runs:
13
Run Growth:
5
Growth Rate:
38.46%
Total runs:
13
Run Growth:
-17
Growth Rate:
-130.77%
Total runs:
13
Run Growth:
3
Growth Rate:
23.08%
Total runs:
12
Run Growth:
3
Growth Rate:
25.00%
Total runs:
12
Run Growth:
-3
Growth Rate:
-25.00%
Total runs:
12
Run Growth:
-1
Growth Rate:
-8.33%
Total runs:
12
Run Growth:
4
Growth Rate:
33.33%
Total runs:
11
Run Growth:
5
Growth Rate:
45.45%
Total runs:
11
Run Growth:
3
Growth Rate:
25.00%
Total runs:
11
Run Growth:
-3
Growth Rate:
-27.27%
Total runs:
10
Run Growth:
-6
Growth Rate:
-60.00%
Total runs:
10
Run Growth:
-6
Growth Rate:
-60.00%
Total runs:
9
Run Growth:
-7
Growth Rate:
-77.78%
Total runs:
8
Run Growth:
1
Growth Rate:
12.50%
Total runs:
8
Run Growth:
-2
Growth Rate:
-25.00%
Total runs:
7
Run Growth:
-1
Growth Rate:
-14.29%