We use four Nvidia Tesla v100 GPUs to train the two language models. We set the batch size to 8 per GPU, evaluate every 1,000 steps, and train for 312,000 iterations.
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("AIMH/mental-roberta-large")
model = AutoModel.from_pretrained("AIMH/mental-roberta-large")
To minimize the influence of worrying mask predictions, this model is gated. To download a gated model, you’ll need to be authenticated.
Know more about
gated models
.
@inproceedings{ji2022mentalbert,
title = {{MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcare}},
author = {Shaoxiong Ji and Tianlin Zhang and Luna Ansari and Jie Fu and Prayag Tiwari and Erik Cambria},
year = {2022},
booktitle = {Proceedings of LREC}
}
Runs of AIMH mental-roberta-large on huggingface.co
275
Total runs
0
24-hour runs
16
3-day runs
-10
7-day runs
111
30-day runs
More Information About mental-roberta-large huggingface.co Model
mental-roberta-large huggingface.co is an AI model on huggingface.co that provides mental-roberta-large's model effect (), which can be used instantly with this AIMH mental-roberta-large model. huggingface.co supports a free trial of the mental-roberta-large model, and also provides paid use of the mental-roberta-large. Support call mental-roberta-large model through api, including Node.js, Python, http.
mental-roberta-large huggingface.co is an online trial and call api platform, which integrates mental-roberta-large's modeling effects, including api services, and provides a free online trial of mental-roberta-large, you can try mental-roberta-large online for free by clicking the link below.
AIMH mental-roberta-large online free url in huggingface.co:
mental-roberta-large is an open source model from GitHub that offers a free installation service, and any user can find mental-roberta-large on GitHub to install. At the same time, huggingface.co provides the effect of mental-roberta-large install, users can directly use mental-roberta-large installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
mental-roberta-large install url in huggingface.co: