Total runs:
131.9K
Run Growth:
-126.3K
Growth Rate:
-95.81%
Sponsored by
APIMart
s-nlp / roberta-base-formality-ranker
Model's Last Updated: September 08 2023
text-classification
Introduction of roberta-base-formality-ranker
Model Details of roberta-base-formality-ranker
The model has been trained to predict for English sentences, whether they are formal or informal.
Base model:
roberta-base
Datasets: GYAFC from Rao and Tetreault, 2018 and online formality corpus from Pavlick and Tetreault, 2016 .
Data augmentation: changing texts to upper or lower case; removing all punctuation, adding dot at the end of a sentence. It was applied because otherwise the model is over-reliant on punctuation and capitalization and does not pay enough attention to other features.
Loss: binary classification (on GYAFC), in-batch ranking (on PT data).
Performance metrics on the test data:
| dataset | ROC AUC | precision | recall | fscore | accuracy | Spearman |
|---|---|---|---|---|---|---|
| GYAFC | 0.9779 | 0.90 | 0.91 | 0.90 | 0.9087 | 0.8233 |
| GYAFC normalized (lowercase + remove punct.) | 0.9234 | 0.85 | 0.81 | 0.82 | 0.8218 | 0.7294 |
| P&T subset | Spearman R |
|---|---|
| news | 0.4003 |
| answers | 0.7500 |
| blog | 0.7334 |
| 0.7606 |
Citation
If you are using the model in your research, please cite the following paper where it was introduced:
@InProceedings{10.1007/978-3-031-35320-8_4,
author="Babakov, Nikolay
and Dale, David
and Gusev, Ilya
and Krotova, Irina
and Panchenko, Alexander",
editor="M{\'e}tais, Elisabeth
and Meziane, Farid
and Sugumaran, Vijayan
and Manning, Warren
and Reiff-Marganiec, Stephan",
title="Don't Lose the Message While Paraphrasing: A Study on Content Preserving Style Transfer",
booktitle="Natural Language Processing and Information Systems",
year="2023",
publisher="Springer Nature Switzerland",
address="Cham",
pages="47--61",
isbn="978-3-031-35320-8"
}
Licensing Information
Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License .
Runs of s-nlp roberta-base-formality-ranker on huggingface.co
73.5K
Total runs
0
24-hour runs
2.7K
3-day runs
1.8K
7-day runs
-92.1K
30-day runs
More Information About roberta-base-formality-ranker huggingface.co Model
Url of roberta-base-formality-ranker
roberta-base-formality-ranker huggingface.co Url
Provider of roberta-base-formality-ranker huggingface.co
Other API from s-nlp
Updated:November 08 2024
Total runs:
2.4K
Run Growth:
567
Growth Rate:
23.90%
Total runs:
2.2K
Run Growth:
-2.2K
Growth Rate:
-100.05%
Total runs:
578
Run Growth:
0
Growth Rate:
0.00%
Total runs:
504
Run Growth:
1
Growth Rate:
0.20%
Total runs:
198
Run Growth:
-253
Growth Rate:
-127.78%
Total runs:
195
Run Growth:
26
Growth Rate:
13.33%
Total runs:
169
Run Growth:
155
Growth Rate:
91.72%
Total runs:
155
Run Growth:
0
Growth Rate:
0.00%
Total runs:
154
Run Growth:
-97
Growth Rate:
-62.99%
Total runs:
152
Run Growth:
1
Growth Rate:
0.66%
Total runs:
107
Run Growth:
107
Growth Rate:
100.00%
Total runs:
59
Run Growth:
31
Growth Rate:
52.54%
Total runs:
55
Run Growth:
29
Growth Rate:
52.73%
Total runs:
37
Run Growth:
8
Growth Rate:
21.62%
Total runs:
31
Run Growth:
17
Growth Rate:
54.84%
Total runs:
28
Run Growth:
-7
Growth Rate:
-25.00%
Total runs:
22
Run Growth:
-30
Growth Rate:
-136.36%
Total runs:
20
Run Growth:
1
Growth Rate:
5.00%
Total runs:
17
Run Growth:
6
Growth Rate:
35.29%
Total runs:
14
Run Growth:
1
Growth Rate:
7.14%
Total runs:
10
Run Growth:
-4
Growth Rate:
-40.00%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
8
Run Growth:
4
Growth Rate:
50.00%
Total runs:
4
Run Growth:
-4
Growth Rate:
-100.00%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
-4
Growth Rate:
-133.33%
Total runs:
3
Run Growth:
-3
Growth Rate:
-100.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
1
Growth Rate:
50.00%
Total runs:
1
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%