moussaKam / mbarthez

huggingface.co
Total runs: 80.6K
24-hour runs: 0
7-day runs: -7.6K
30-day runs: -21.0K
Model's Last Updated: February 20 2024
fill-mask

Introduction of mbarthez

Model Details of mbarthez

A french sequence to sequence pretrained model based on BART .
BARThez is pretrained by learning to reconstruct a corrupted input sentence. A corpus of 66GB of french raw text is used to carry out the pretraining.
Unlike already existing BERT-based French language models such as CamemBERT and FlauBERT, BARThez is particularly well-suited for generative tasks (such as abstractive summarization), since not only its encoder but also its decoder is pretrained.

In addition to BARThez that is pretrained from scratch, we continue the pretraining of a multilingual BART mBART which boosted its performance in both discriminative and generative tasks. We call the french adapted version mBARThez .

Model Architecture #layers #params
BARThez BASE 12 165M
mBARThez LARGE 24 458M

paper: https://arxiv.org/abs/2010.12321
github: https://github.com/moussaKam/BARThez

@article{eddine2020barthez,
  title={BARThez: a Skilled Pretrained French Sequence-to-Sequence Model},
  author={Eddine, Moussa Kamal and Tixier, Antoine J-P and Vazirgiannis, Michalis},
  journal={arXiv preprint arXiv:2010.12321},
  year={2020}
}

Runs of moussaKam mbarthez on huggingface.co

80.6K
Total runs
0
24-hour runs
-461
3-day runs
-7.6K
7-day runs
-21.0K
30-day runs

More Information About mbarthez huggingface.co Model

More mbarthez license Visit here:

https://choosealicense.com/licenses/apache-2.0

mbarthez huggingface.co

mbarthez huggingface.co is an AI model on huggingface.co that provides mbarthez's model effect (), which can be used instantly with this moussaKam mbarthez model. huggingface.co supports a free trial of the mbarthez model, and also provides paid use of the mbarthez. Support call mbarthez model through api, including Node.js, Python, http.

moussaKam mbarthez online free

mbarthez huggingface.co is an online trial and call api platform, which integrates mbarthez's modeling effects, including api services, and provides a free online trial of mbarthez, you can try mbarthez online for free by clicking the link below.

moussaKam mbarthez online free url in huggingface.co:

https://huggingface.co/moussaKam/mbarthez

mbarthez install

mbarthez is an open source model from GitHub that offers a free installation service, and any user can find mbarthez on GitHub to install. At the same time, huggingface.co provides the effect of mbarthez install, users can directly use mbarthez installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

mbarthez install url in huggingface.co:

https://huggingface.co/moussaKam/mbarthez

Url of mbarthez

Provider of mbarthez huggingface.co

moussaKam
ORGANIZATIONS

Other API from moussaKam

huggingface.co

Total runs: 1.8K
Run Growth: -1.1K
Growth Rate: -57.47%
Updated:February 20 2024
huggingface.co

Total runs: 734
Run Growth: -615
Growth Rate: -83.79%
Updated:May 05 2022