jamesdborin / ct2-int8-mt5-xl

huggingface.co
Total runs: 21
24-hour runs: 0
7-day runs: 2
30-day runs: 1
Model's Last Updated: July 26 2023
text-generation

Introduction of ct2-int8-mt5-xl

Model Details of ct2-int8-mt5-xl

Google's mT5

mT5 is pretrained on the mC4 corpus, covering 101 languages:

Afrikaans, Albanian, Amharic, Arabic, Armenian, Azerbaijani, Basque, Belarusian, Bengali, Bulgarian, Burmese, Catalan, Cebuano, Chichewa, Chinese, Corsican, Czech, Danish, Dutch, English, Esperanto, Estonian, Filipino, Finnish, French, Galician, Georgian, German, Greek, Gujarati, Haitian Creole, Hausa, Hawaiian, Hebrew, Hindi, Hmong, Hungarian, Icelandic, Igbo, Indonesian, Irish, Italian, Japanese, Javanese, Kannada, Kazakh, Khmer, Korean, Kurdish, Kyrgyz, Lao, Latin, Latvian, Lithuanian, Luxembourgish, Macedonian, Malagasy, Malay, Malayalam, Maltese, Maori, Marathi, Mongolian, Nepali, Norwegian, Pashto, Persian, Polish, Portuguese, Punjabi, Romanian, Russian, Samoan, Scottish Gaelic, Serbian, Shona, Sindhi, Sinhala, Slovak, Slovenian, Somali, Sotho, Spanish, Sundanese, Swahili, Swedish, Tajik, Tamil, Telugu, Thai, Turkish, Ukrainian, Urdu, Uzbek, Vietnamese, Welsh, West Frisian, Xhosa, Yiddish, Yoruba, Zulu.

Note : mT5 was only pre-trained on mC4 excluding any supervised training. Therefore, this model has to be fine-tuned before it is useable on a downstream task.

Pretraining Dataset: mC4

Other Community Checkpoints: here

Paper: mT5: A massively multilingual pre-trained text-to-text transformer

Authors: Linting Xue, Noah Constant, Adam Roberts, Mihir Kale, Rami Al-Rfou, Aditya Siddhant, Aditya Barua, Colin Raffel

Abstract

The recent "Text-to-Text Transfer Transformer" (T5) leveraged a unified text-to-text format and scale to attain state-of-the-art results on a wide variety of English-language NLP tasks. In this paper, we introduce mT5, a multilingual variant of T5 that was pre-trained on a new Common Crawl-based dataset covering 101 languages. We describe the design and modified training of mT5 and demonstrate its state-of-the-art performance on many multilingual benchmarks. All of the code and model checkpoints used in this work are publicly available.

Runs of jamesdborin ct2-int8-mt5-xl on huggingface.co

21
Total runs
0
24-hour runs
0
3-day runs
2
7-day runs
1
30-day runs

More Information About ct2-int8-mt5-xl huggingface.co Model

More ct2-int8-mt5-xl license Visit here:

https://choosealicense.com/licenses/apache-2.0

ct2-int8-mt5-xl huggingface.co

ct2-int8-mt5-xl huggingface.co is an AI model on huggingface.co that provides ct2-int8-mt5-xl's model effect (), which can be used instantly with this jamesdborin ct2-int8-mt5-xl model. huggingface.co supports a free trial of the ct2-int8-mt5-xl model, and also provides paid use of the ct2-int8-mt5-xl. Support call ct2-int8-mt5-xl model through api, including Node.js, Python, http.

jamesdborin ct2-int8-mt5-xl online free

ct2-int8-mt5-xl huggingface.co is an online trial and call api platform, which integrates ct2-int8-mt5-xl's modeling effects, including api services, and provides a free online trial of ct2-int8-mt5-xl, you can try ct2-int8-mt5-xl online for free by clicking the link below.

jamesdborin ct2-int8-mt5-xl online free url in huggingface.co:

https://huggingface.co/jamesdborin/ct2-int8-mt5-xl

ct2-int8-mt5-xl install

ct2-int8-mt5-xl is an open source model from GitHub that offers a free installation service, and any user can find ct2-int8-mt5-xl on GitHub to install. At the same time, huggingface.co provides the effect of ct2-int8-mt5-xl install, users can directly use ct2-int8-mt5-xl installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

ct2-int8-mt5-xl install url in huggingface.co:

https://huggingface.co/jamesdborin/ct2-int8-mt5-xl

Url of ct2-int8-mt5-xl

ct2-int8-mt5-xl huggingface.co Url

Provider of ct2-int8-mt5-xl huggingface.co

jamesdborin
ORGANIZATIONS

Other API from jamesdborin