mesolitica / roberta-base-bahasa-cased

huggingface.co
Total runs: 351
24-hour runs: 16
7-day runs: 186
30-day runs: 139
Model's Last Updated: September 07 2022
fill-mask

Introduction of roberta-base-bahasa-cased

Model Details of roberta-base-bahasa-cased

roberta-base-bahasa-cased

Pretrained RoBERTa base language model for Malay.

Pretraining Corpus

roberta-base-bahasa-cased model was pretrained on ~400 miliion words. Below is list of data we trained on,

  1. IIUM confession, https://github.com/huseinzol05/malay-dataset/tree/master/dumping/clean
  2. local Instagram, https://github.com/huseinzol05/malay-dataset/tree/master/dumping/clean
  3. local news, https://github.com/huseinzol05/malay-dataset/tree/master/dumping/clean
  4. local parliament hansards, https://github.com/huseinzol05/malay-dataset/tree/master/dumping/clean
  5. local research papers related to kebudayaan , keagaaman and etnik , https://github.com/huseinzol05/malay-dataset/tree/master/dumping/clean
  6. local twitter, https://github.com/huseinzol05/malay-dataset/tree/master/dumping/clean
  7. Malay Wattpad, https://github.com/huseinzol05/malay-dataset/tree/master/dumping/clean
  8. Malay Wikipedia, https://github.com/huseinzol05/malay-dataset/tree/master/dumping/clean
Pretraining details
Example using AutoModelWithLMHead
from transformers import AutoTokenizer, AutoModelForMaskedLM, pipeline

model = AutoModelForMaskedLM.from_pretrained('mesolitica/roberta-base-bahasa-cased')
tokenizer = AutoTokenizer.from_pretrained(
    'mesolitica/roberta-base-bahasa-cased',
    do_lower_case = False,
)
fill_mask = pipeline('fill-mask', model=model, tokenizer=tokenizer)
fill_mask('Permohonan Najib, anak untuk dengar isu perlembagaan <mask> .')

Output is,

[{'score': 0.3368818759918213,
  'token': 746,
  'token_str': ' negara',
  'sequence': 'Permohonan Najib, anak untuk dengar isu perlembagaan negara.'},
 {'score': 0.09646568447351456,
  'token': 598,
  'token_str': ' Malaysia',
  'sequence': 'Permohonan Najib, anak untuk dengar isu perlembagaan Malaysia.'},
 {'score': 0.029483484104275703,
  'token': 3265,
  'token_str': ' UMNO',
  'sequence': 'Permohonan Najib, anak untuk dengar isu perlembagaan UMNO.'},
 {'score': 0.026470622047781944,
  'token': 2562,
  'token_str': ' parti',
  'sequence': 'Permohonan Najib, anak untuk dengar isu perlembagaan parti.'},
 {'score': 0.023237623274326324,
  'token': 391,
  'token_str': ' ini',
  'sequence': 'Permohonan Najib, anak untuk dengar isu perlembagaan ini.'}]

Runs of mesolitica roberta-base-bahasa-cased on huggingface.co

351
Total runs
16
24-hour runs
99
3-day runs
186
7-day runs
139
30-day runs

More Information About roberta-base-bahasa-cased huggingface.co Model

roberta-base-bahasa-cased huggingface.co

roberta-base-bahasa-cased huggingface.co is an AI model on huggingface.co that provides roberta-base-bahasa-cased's model effect (), which can be used instantly with this mesolitica roberta-base-bahasa-cased model. huggingface.co supports a free trial of the roberta-base-bahasa-cased model, and also provides paid use of the roberta-base-bahasa-cased. Support call roberta-base-bahasa-cased model through api, including Node.js, Python, http.

roberta-base-bahasa-cased huggingface.co Url

https://huggingface.co/mesolitica/roberta-base-bahasa-cased

mesolitica roberta-base-bahasa-cased online free

roberta-base-bahasa-cased huggingface.co is an online trial and call api platform, which integrates roberta-base-bahasa-cased's modeling effects, including api services, and provides a free online trial of roberta-base-bahasa-cased, you can try roberta-base-bahasa-cased online for free by clicking the link below.

mesolitica roberta-base-bahasa-cased online free url in huggingface.co:

https://huggingface.co/mesolitica/roberta-base-bahasa-cased

roberta-base-bahasa-cased install

roberta-base-bahasa-cased is an open source model from GitHub that offers a free installation service, and any user can find roberta-base-bahasa-cased on GitHub to install. At the same time, huggingface.co provides the effect of roberta-base-bahasa-cased install, users can directly use roberta-base-bahasa-cased installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

roberta-base-bahasa-cased install url in huggingface.co:

https://huggingface.co/mesolitica/roberta-base-bahasa-cased

Url of roberta-base-bahasa-cased

roberta-base-bahasa-cased huggingface.co Url

Provider of roberta-base-bahasa-cased huggingface.co

mesolitica
ORGANIZATIONS

Other API from mesolitica

huggingface.co

Total runs: 295
Run Growth: -69
Growth Rate: -23.39%
Updated:February 05 2025
huggingface.co

Total runs: 232
Run Growth: -9
Growth Rate: -3.88%
Updated:September 18 2022