moussaKam / barthez

huggingface.co
Total runs: 1.9K
24-hour runs: -9
7-day runs: -118
30-day runs: -1.0K
Model's Last Updated: February 20 2024
fill-mask

Introduction of barthez

Model Details of barthez

A french sequence to sequence pretrained model based on BART .
BARThez is pretrained by learning to reconstruct a corrupted input sentence. A corpus of 66GB of french raw text is used to carry out the pretraining.
Unlike already existing BERT-based French language models such as CamemBERT and FlauBERT, BARThez is particularly well-suited for generative tasks (such as abstractive summarization), since not only its encoder but also its decoder is pretrained.

In addition to BARThez that is pretrained from scratch, we continue the pretraining of a multilingual BART mBART which boosted its performance in both discriminative and generative tasks. We call the french adapted version mBARThez .

Model Architecture #layers #params
BARThez BASE 12 165M
mBARThez LARGE 24 458M

paper: https://arxiv.org/abs/2010.12321
github: https://github.com/moussaKam/BARThez

@article{eddine2020barthez,
  title={BARThez: a Skilled Pretrained French Sequence-to-Sequence Model},
  author={Eddine, Moussa Kamal and Tixier, Antoine J-P and Vazirgiannis, Michalis},
  journal={arXiv preprint arXiv:2010.12321},
  year={2020}
}

Runs of moussaKam barthez on huggingface.co

1.9K
Total runs
-9
24-hour runs
79
3-day runs
-118
7-day runs
-1.0K
30-day runs

More Information About barthez huggingface.co Model

More barthez license Visit here:

https://choosealicense.com/licenses/apache-2.0

barthez huggingface.co

barthez huggingface.co is an AI model on huggingface.co that provides barthez's model effect (), which can be used instantly with this moussaKam barthez model. huggingface.co supports a free trial of the barthez model, and also provides paid use of the barthez. Support call barthez model through api, including Node.js, Python, http.

moussaKam barthez online free

barthez huggingface.co is an online trial and call api platform, which integrates barthez's modeling effects, including api services, and provides a free online trial of barthez, you can try barthez online for free by clicking the link below.

moussaKam barthez online free url in huggingface.co:

https://huggingface.co/moussaKam/barthez

barthez install

barthez is an open source model from GitHub that offers a free installation service, and any user can find barthez on GitHub to install. At the same time, huggingface.co provides the effect of barthez install, users can directly use barthez installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

barthez install url in huggingface.co:

https://huggingface.co/moussaKam/barthez

Url of barthez

Provider of barthez huggingface.co

moussaKam
ORGANIZATIONS

Other API from moussaKam

huggingface.co

Total runs: 80.6K
Run Growth: -21.0K
Growth Rate: -26.10%
Updated:February 20 2024
huggingface.co

Total runs: 716
Run Growth: -595
Growth Rate: -83.10%
Updated:May 05 2022