Bert-based classifier (finetuned from
Conversational Rubert
) trained on merge of Russian Language Toxic Comments
dataset
collected from 2ch.hk and Toxic Russian Comments
dataset
collected from ok.ru.
The datasets were merged, shuffled, and split into train, dev, test splits in 80-10-10 proportion.
The metrics obtained from test dataset is as follows
precision
recall
f1-score
support
0
0.98
0.99
0.98
21384
1
0.94
0.92
0.93
4886
accuracy
0.97
26270
macro avg
0.96
0.96
0.96
26270
weighted avg
0.97
0.97
0.97
26270
How to use
from transformers import BertTokenizer, BertForSequenceClassification
# load tokenizer and model weights
tokenizer = BertTokenizer.from_pretrained('SkolkovoInstitute/russian_toxicity_classifier')
model = BertForSequenceClassification.from_pretrained('SkolkovoInstitute/russian_toxicity_classifier')
# prepare the input
batch = tokenizer.encode('ты супер', return_tensors='pt')
# inference
model(batch)
russian_toxicity_classifier huggingface.co is an AI model on huggingface.co that provides russian_toxicity_classifier's model effect (), which can be used instantly with this s-nlp russian_toxicity_classifier model. huggingface.co supports a free trial of the russian_toxicity_classifier model, and also provides paid use of the russian_toxicity_classifier. Support call russian_toxicity_classifier model through api, including Node.js, Python, http.
russian_toxicity_classifier huggingface.co is an online trial and call api platform, which integrates russian_toxicity_classifier's modeling effects, including api services, and provides a free online trial of russian_toxicity_classifier, you can try russian_toxicity_classifier online for free by clicking the link below.
s-nlp russian_toxicity_classifier online free url in huggingface.co:
russian_toxicity_classifier is an open source model from GitHub that offers a free installation service, and any user can find russian_toxicity_classifier on GitHub to install. At the same time, huggingface.co provides the effect of russian_toxicity_classifier install, users can directly use russian_toxicity_classifier installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
russian_toxicity_classifier install url in huggingface.co: