kamalkraj / deberta-base

huggingface.co
Total runs: 70
24-hour runs: -1
7-day runs: -25
30-day runs: -285
Model's Last Updated: August 08 2021
feature-extraction

Introduction of deberta-base

Model Details of deberta-base

DeBERTa: Decoding-enhanced BERT with Disentangled Attention

DeBERTa improves the BERT and RoBERTa models using disentangled attention and enhanced mask decoder. It outperforms BERT and RoBERTa on majority of NLU tasks with 80GB training data.

Please check the official repository for more details and updates.

Fine-tuning on NLU tasks

We present the dev results on SQuAD 1.1/2.0 and MNLI tasks.

Model SQuAD 1.1 SQuAD 2.0 MNLI-m
RoBERTa-base 91.5/84.6 83.7/80.5 87.6
XLNet-Large -/- -/80.2 86.8
DeBERTa-base 93.1/87.2 86.2/83.1 88.8
Citation

If you find DeBERTa useful for your work, please cite the following paper:

@inproceedings{
he2021deberta,
title={DEBERTA: DECODING-ENHANCED BERT WITH DISENTANGLED ATTENTION},
author={Pengcheng He and Xiaodong Liu and Jianfeng Gao and Weizhu Chen},
booktitle={International Conference on Learning Representations},
year={2021},
url={https://openreview.net/forum?id=XPZIaotutsD}
}

Runs of kamalkraj deberta-base on huggingface.co

70
Total runs
-1
24-hour runs
0
3-day runs
-25
7-day runs
-285
30-day runs

More Information About deberta-base huggingface.co Model

More deberta-base license Visit here:

https://choosealicense.com/licenses/mit

deberta-base huggingface.co

deberta-base huggingface.co is an AI model on huggingface.co that provides deberta-base's model effect (), which can be used instantly with this kamalkraj deberta-base model. huggingface.co supports a free trial of the deberta-base model, and also provides paid use of the deberta-base. Support call deberta-base model through api, including Node.js, Python, http.

kamalkraj deberta-base online free

deberta-base huggingface.co is an online trial and call api platform, which integrates deberta-base's modeling effects, including api services, and provides a free online trial of deberta-base, you can try deberta-base online for free by clicking the link below.

kamalkraj deberta-base online free url in huggingface.co:

https://huggingface.co/kamalkraj/deberta-base

deberta-base install

deberta-base is an open source model from GitHub that offers a free installation service, and any user can find deberta-base on GitHub to install. At the same time, huggingface.co provides the effect of deberta-base install, users can directly use deberta-base installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

deberta-base install url in huggingface.co:

https://huggingface.co/kamalkraj/deberta-base

Url of deberta-base

deberta-base huggingface.co Url

Provider of deberta-base huggingface.co

kamalkraj
ORGANIZATIONS

Other API from kamalkraj

huggingface.co

Total runs: 5
Run Growth: 1
Growth Rate: 20.00%
Updated:September 08 2021
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:February 01 2022