immisoBETO is a domain adaptation of a
Spanish BERT
language model, specifically adapted to the immigrant and misogyny domain.
It was adapted using a guided lexical masking strategy during masked language model (MLM) pretraining.
Instead of randomly masking tokens, we prioritized masking words appearing in a
immigrant
and
misogyny
-specific lexicon.
The base corpus used for domain adaptation was the
Spanish Hate Speech Superset
.
For training the model we used a batch size of 8, with a learning rate of 2e-5. We trained the model for four epochs using a NVIDIA GeForce RTX 5090 GPU.
Usage
from transformers import pipeline
pipe = pipeline("fill-mask", model="citiusLTL/immisoBETO")
text = pipe("Los [MASK] son los causantes del aumento del desempleo")
print(text)
Load model directly
from transformers import AutoTokenizer, AutoModelForMaskedLM
tokenizer = AutoTokenizer.from_pretrained("citiusLTL/immisoBETO")
model = AutoModelForMaskedLM.from_pretrained("citiusLTL/immisoBETO")
Runs of citiusLTL immisoBETO on huggingface.co
9
Total runs
0
24-hour runs
0
3-day runs
-1
7-day runs
7
30-day runs
More Information About immisoBETO huggingface.co Model
immisoBETO huggingface.co is an AI model on huggingface.co that provides immisoBETO's model effect (), which can be used instantly with this citiusLTL immisoBETO model. huggingface.co supports a free trial of the immisoBETO model, and also provides paid use of the immisoBETO. Support call immisoBETO model through api, including Node.js, Python, http.
immisoBETO huggingface.co is an online trial and call api platform, which integrates immisoBETO's modeling effects, including api services, and provides a free online trial of immisoBETO, you can try immisoBETO online for free by clicking the link below.
citiusLTL immisoBETO online free url in huggingface.co:
immisoBETO is an open source model from GitHub that offers a free installation service, and any user can find immisoBETO on GitHub to install. At the same time, huggingface.co provides the effect of immisoBETO install, users can directly use immisoBETO installed effect in huggingface.co for debugging and trial. It also supports api for free installation.