AIMH / mental-roberta-large

huggingface.co
Total runs: 275
24-hour runs: 0
7-day runs: -10
30-day runs: 111
Model's Last Updated: February 28 2023
fill-mask

Introduction of mental-roberta-large

Model Details of mental-roberta-large

MentalBERT is a model initialized with RoBERTa-large ( uncased_L-24_H-1024_A-16 ) and trained with mental health-related posts collected from Reddit.

We follow the standard pretraining protocols of BERT and RoBERTa with Huggingface’s Transformers library .

We use four Nvidia Tesla v100 GPUs to train the two language models. We set the batch size to 8 per GPU, evaluate every 1,000 steps, and train for 312,000 iterations.

Usage

Load the model via Huggingface’s Transformers library :

from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("AIMH/mental-roberta-large")
model = AutoModel.from_pretrained("AIMH/mental-roberta-large")

To minimize the influence of worrying mask predictions, this model is gated. To download a gated model, you’ll need to be authenticated. Know more about gated models .

Paper

MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcare .

@inproceedings{ji2022mentalbert,
  title     = {{MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcare}},
  author    = {Shaoxiong Ji and Tianlin Zhang and Luna Ansari and Jie Fu and Prayag Tiwari and Erik Cambria},
  year      = {2022},
  booktitle = {Proceedings of LREC}
}

Runs of AIMH mental-roberta-large on huggingface.co

275
Total runs
0
24-hour runs
16
3-day runs
-10
7-day runs
111
30-day runs

More Information About mental-roberta-large huggingface.co Model

More mental-roberta-large license Visit here:

https://choosealicense.com/licenses/cc-by-nc-4.0

mental-roberta-large huggingface.co

mental-roberta-large huggingface.co is an AI model on huggingface.co that provides mental-roberta-large's model effect (), which can be used instantly with this AIMH mental-roberta-large model. huggingface.co supports a free trial of the mental-roberta-large model, and also provides paid use of the mental-roberta-large. Support call mental-roberta-large model through api, including Node.js, Python, http.

mental-roberta-large huggingface.co Url

https://huggingface.co/AIMH/mental-roberta-large

AIMH mental-roberta-large online free

mental-roberta-large huggingface.co is an online trial and call api platform, which integrates mental-roberta-large's modeling effects, including api services, and provides a free online trial of mental-roberta-large, you can try mental-roberta-large online for free by clicking the link below.

AIMH mental-roberta-large online free url in huggingface.co:

https://huggingface.co/AIMH/mental-roberta-large

mental-roberta-large install

mental-roberta-large is an open source model from GitHub that offers a free installation service, and any user can find mental-roberta-large on GitHub to install. At the same time, huggingface.co provides the effect of mental-roberta-large install, users can directly use mental-roberta-large installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

mental-roberta-large install url in huggingface.co:

https://huggingface.co/AIMH/mental-roberta-large

Url of mental-roberta-large

mental-roberta-large huggingface.co Url

Provider of mental-roberta-large huggingface.co

AIMH
ORGANIZATIONS

Other API from AIMH

huggingface.co

Total runs: 9
Run Growth: 9
Growth Rate: 100.00%
Updated:October 29 2025