huawei-noah / DynaBERT_SST-2

huggingface.co
Total runs: 12
24-hour runs: 0
7-day runs: 0
30-day runs: -4
Model's Last Updated: May 20 2021

Introduction of DynaBERT_SST-2

Model Details of DynaBERT_SST-2

DynaBERT: Dynamic BERT with Adaptive Width and Depth
  • DynaBERT can flexibly adjust the size and latency by selecting adaptive width and depth, and the subnetworks of it have competitive performances as other similar-sized compressed models. The training process of DynaBERT includes first training a width-adaptive BERT and then allowing both adaptive width and depth using knowledge distillation.

  • This code is modified based on the repository developed by Hugging Face: Transformers v2.1.1 , and is released in GitHub .

Reference

Lu Hou, Zhiqi Huang, Lifeng Shang, Xin Jiang, Xiao Chen, Qun Liu. DynaBERT: Dynamic BERT with Adaptive Width and Depth .

@inproceedings{hou2020dynabert,
  title = {DynaBERT: Dynamic BERT with Adaptive Width and Depth},
  author = {Lu Hou, Zhiqi Huang, Lifeng Shang, Xin Jiang, Xiao Chen, Qun Liu},  
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2020}
}

Runs of huawei-noah DynaBERT_SST-2 on huggingface.co

12
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
-4
30-day runs

More Information About DynaBERT_SST-2 huggingface.co Model

DynaBERT_SST-2 huggingface.co

DynaBERT_SST-2 huggingface.co is an AI model on huggingface.co that provides DynaBERT_SST-2's model effect (), which can be used instantly with this huawei-noah DynaBERT_SST-2 model. huggingface.co supports a free trial of the DynaBERT_SST-2 model, and also provides paid use of the DynaBERT_SST-2. Support call DynaBERT_SST-2 model through api, including Node.js, Python, http.

huawei-noah DynaBERT_SST-2 online free

DynaBERT_SST-2 huggingface.co is an online trial and call api platform, which integrates DynaBERT_SST-2's modeling effects, including api services, and provides a free online trial of DynaBERT_SST-2, you can try DynaBERT_SST-2 online for free by clicking the link below.

huawei-noah DynaBERT_SST-2 online free url in huggingface.co:

https://huggingface.co/huawei-noah/DynaBERT_SST-2

DynaBERT_SST-2 install

DynaBERT_SST-2 is an open source model from GitHub that offers a free installation service, and any user can find DynaBERT_SST-2 on GitHub to install. At the same time, huggingface.co provides the effect of DynaBERT_SST-2 install, users can directly use DynaBERT_SST-2 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

DynaBERT_SST-2 install url in huggingface.co:

https://huggingface.co/huawei-noah/DynaBERT_SST-2

Url of DynaBERT_SST-2

DynaBERT_SST-2 huggingface.co Url

Provider of DynaBERT_SST-2 huggingface.co

huawei-noah
ORGANIZATIONS

Other API from huawei-noah

huggingface.co

Total runs: 33
Run Growth: 27
Growth Rate: 60.00%
Updated:January 18 2024
huggingface.co

Total runs: 18
Run Growth: 10
Growth Rate: 55.56%
Updated:January 18 2024
huggingface.co

Total runs: 13
Run Growth: 1
Growth Rate: 6.67%
Updated:December 22 2022
huggingface.co

Total runs: 12
Run Growth: -1
Growth Rate: -8.33%
Updated:December 22 2022
huggingface.co

Total runs: 10
Run Growth: -2
Growth Rate: -20.00%
Updated:January 18 2024
huggingface.co

Total runs: 1
Run Growth: 1
Growth Rate: 100.00%
Updated:January 05 2022
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:September 27 2023