ibm-research / ia-multilingual-original-script-roberta

huggingface.co
Total runs: 49
24-hour runs: 0
7-day runs: -3
30-day runs: -16
Model's Last Updated: February 03 2023
fill-mask

Introduction of ia-multilingual-original-script-roberta

Model Details of ia-multilingual-original-script-roberta

IA-Original

IA-Original is a multilingual RoBERTa model pre-trained exclusively on 11 Indian languages from the Indo-Aryan language family. It is pre-trained on the monolingual corpora of these languages and subsequently evaluated on a set of diverse tasks.

The 11 languages covered by IA-Original are: Bhojpuri, Bengali, Gujarati, Hindi, Magahi, Marathi, Nepali, Oriya, Punjabi, Sanskrit, Urdu.

The code can be found here . For more information, check-out our paper .

Pretraining Corpus

We pre-trained IA-Original on the publicly available monolingual corpus. The corpus has the following distribution of languages:

Language # Sentences # Tokens
# Total # Unique
Hindi (hi) 1552.89 20,098.73 25.01
Bengali (bn) 353.44 4,021.30 6.5
Sanskrit (sa) 165.35 1,381.04 11.13
Urdu (ur) 153.27 2,465.48 4.61
Marathi (mr) 132.93 1,752.43 4.92
Gujarati (gu) 131.22 1,565.08 4.73
Nepali (ne) 84.21 1,139.54 3.43
Punjabi (pa) 68.02 945.68 2.00
Oriya (or) 17.88 274.99 1.10
Bhojpuri (bh) 10.25 134.37 1.13
Magahi (mag) 0.36 3.47 0.15
Evaluation Results

IA-Original is evaluated on IndicGLUE and some additional tasks. For more details about the tasks, refer to the paper .

Downloads

You can also download it from Huggingface .

Citing

If you are using any of the resources, please cite the following article:

@inproceedings{dhamecha-etal-2021-role,
    title = "Role of {L}anguage {R}elatedness in {M}ultilingual {F}ine-tuning of {L}anguage {M}odels: {A} {C}ase {S}tudy in {I}ndo-{A}ryan {L}anguages",
    author = "Dhamecha, Tejas  and
      Murthy, Rudra  and
      Bharadwaj, Samarth  and
      Sankaranarayanan, Karthik  and
      Bhattacharyya, Pushpak",
    booktitle = "Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing",
    month = nov,
    year = "2021",
    address = "Online and Punta Cana, Dominican Republic",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2021.emnlp-main.675",
    doi = "10.18653/v1/2021.emnlp-main.675",
    pages = "8584--8595",
}
Contributors
  • Tejas Dhamecha
  • Rudra Murthy
  • Samarth Bharadwaj
  • Karthik Sankaranarayanan
  • Pushpak Bhattacharyya
Contact

Runs of ibm-research ia-multilingual-original-script-roberta on huggingface.co

49
Total runs
0
24-hour runs
-1
3-day runs
-3
7-day runs
-16
30-day runs

More Information About ia-multilingual-original-script-roberta huggingface.co Model

ia-multilingual-original-script-roberta huggingface.co

ia-multilingual-original-script-roberta huggingface.co is an AI model on huggingface.co that provides ia-multilingual-original-script-roberta's model effect (), which can be used instantly with this ibm-research ia-multilingual-original-script-roberta model. huggingface.co supports a free trial of the ia-multilingual-original-script-roberta model, and also provides paid use of the ia-multilingual-original-script-roberta. Support call ia-multilingual-original-script-roberta model through api, including Node.js, Python, http.

ia-multilingual-original-script-roberta huggingface.co Url

https://huggingface.co/ibm-research/ia-multilingual-original-script-roberta

ibm-research ia-multilingual-original-script-roberta online free

ia-multilingual-original-script-roberta huggingface.co is an online trial and call api platform, which integrates ia-multilingual-original-script-roberta's modeling effects, including api services, and provides a free online trial of ia-multilingual-original-script-roberta, you can try ia-multilingual-original-script-roberta online for free by clicking the link below.

ibm-research ia-multilingual-original-script-roberta online free url in huggingface.co:

https://huggingface.co/ibm-research/ia-multilingual-original-script-roberta

ia-multilingual-original-script-roberta install

ia-multilingual-original-script-roberta is an open source model from GitHub that offers a free installation service, and any user can find ia-multilingual-original-script-roberta on GitHub to install. At the same time, huggingface.co provides the effect of ia-multilingual-original-script-roberta install, users can directly use ia-multilingual-original-script-roberta installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

ia-multilingual-original-script-roberta install url in huggingface.co:

https://huggingface.co/ibm-research/ia-multilingual-original-script-roberta

Url of ia-multilingual-original-script-roberta

ia-multilingual-original-script-roberta huggingface.co Url

Provider of ia-multilingual-original-script-roberta huggingface.co

ibm-research
ORGANIZATIONS

Other API from ibm-research

huggingface.co

Total runs: 16.5K
Run Growth: -31.2K
Growth Rate: -189.61%
Updated:September 16 2024
huggingface.co

Total runs: 3.5K
Run Growth: -2.8K
Growth Rate: -80.61%
Updated:March 24 2026
huggingface.co

Total runs: 3.3K
Run Growth: -9.5K
Growth Rate: -284.25%
Updated:January 18 2025
huggingface.co

Total runs: 1.2K
Run Growth: -1.2K
Growth Rate: -99.75%
Updated:October 12 2022