huawei-noah / TinyBERT_General_4L_312D

huggingface.co
Total runs: 156.7K
24-hour runs: 0
7-day runs: 14.3K
30-day runs: -409.7K
Model's Last Updated: May 20 2021

Introduction of TinyBERT_General_4L_312D

Model Details of TinyBERT_General_4L_312D

TinyBERT: Distilling BERT for Natural Language Understanding

TinyBERT is 7.5x smaller and 9.4x faster on inference than BERT-base and achieves competitive performances in the tasks of natural language understanding. It performs a novel transformer distillation at both the pre-training and task-specific learning stages. In general distillation, we use the original BERT-base without fine-tuning as the teacher and a large-scale text corpus as the learning data. By performing the Transformer distillation on the text from general domain, we obtain a general TinyBERT which provides a good initialization for the task-specific distillation. We here provide the general TinyBERT for your tasks at hand.

For more details about the techniques of TinyBERT, refer to our paper: TinyBERT: Distilling BERT for Natural Language Understanding

Citation

If you find TinyBERT useful in your research, please cite the following paper:

@article{jiao2019tinybert,
  title={Tinybert: Distilling bert for natural language understanding},
  author={Jiao, Xiaoqi and Yin, Yichun and Shang, Lifeng and Jiang, Xin and Chen, Xiao and Li, Linlin and Wang, Fang and Liu, Qun},
  journal={arXiv preprint arXiv:1909.10351},
  year={2019}
}

Runs of huawei-noah TinyBERT_General_4L_312D on huggingface.co

156.7K
Total runs
0
24-hour runs
3.9K
3-day runs
14.3K
7-day runs
-409.7K
30-day runs

More Information About TinyBERT_General_4L_312D huggingface.co Model

TinyBERT_General_4L_312D huggingface.co

TinyBERT_General_4L_312D huggingface.co is an AI model on huggingface.co that provides TinyBERT_General_4L_312D's model effect (), which can be used instantly with this huawei-noah TinyBERT_General_4L_312D model. huggingface.co supports a free trial of the TinyBERT_General_4L_312D model, and also provides paid use of the TinyBERT_General_4L_312D. Support call TinyBERT_General_4L_312D model through api, including Node.js, Python, http.

TinyBERT_General_4L_312D huggingface.co Url

https://huggingface.co/huawei-noah/TinyBERT_General_4L_312D

huawei-noah TinyBERT_General_4L_312D online free

TinyBERT_General_4L_312D huggingface.co is an online trial and call api platform, which integrates TinyBERT_General_4L_312D's modeling effects, including api services, and provides a free online trial of TinyBERT_General_4L_312D, you can try TinyBERT_General_4L_312D online for free by clicking the link below.

huawei-noah TinyBERT_General_4L_312D online free url in huggingface.co:

https://huggingface.co/huawei-noah/TinyBERT_General_4L_312D

TinyBERT_General_4L_312D install

TinyBERT_General_4L_312D is an open source model from GitHub that offers a free installation service, and any user can find TinyBERT_General_4L_312D on GitHub to install. At the same time, huggingface.co provides the effect of TinyBERT_General_4L_312D install, users can directly use TinyBERT_General_4L_312D installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

TinyBERT_General_4L_312D install url in huggingface.co:

https://huggingface.co/huawei-noah/TinyBERT_General_4L_312D

Url of TinyBERT_General_4L_312D

TinyBERT_General_4L_312D huggingface.co Url

Provider of TinyBERT_General_4L_312D huggingface.co

huawei-noah
ORGANIZATIONS

Other API from huawei-noah

huggingface.co

Total runs: 35
Run Growth: 26
Growth Rate: 74.29%
Updated:January 18 2024
huggingface.co

Total runs: 20
Run Growth: 15
Growth Rate: 75.00%
Updated:January 18 2024
huggingface.co

Total runs: 19
Run Growth: 9
Growth Rate: 47.37%
Updated:December 22 2022
huggingface.co

Total runs: 16
Run Growth: 7
Growth Rate: 43.75%
Updated:December 22 2022
huggingface.co

Total runs: 13
Run Growth: 10
Growth Rate: 76.92%
Updated:January 18 2024
huggingface.co

Total runs: 1
Run Growth: 1
Growth Rate: 100.00%
Updated:January 05 2022
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:September 27 2023