huawei-noah / AutoTinyBERT-KD-S2

huggingface.co
Total runs: 13
24-hour runs: 0
7-day runs: -9
30-day runs: -1
Model's Last Updated: May 16 2022

Introduction of AutoTinyBERT-KD-S2

Model Details of AutoTinyBERT-KD-S2

Pre-trained language models (PLMs) have achieved great success in natural language processing. Most of PLMs follow the default setting of architecture hyper-parameters (e.g., the hidden dimension is a quarter of the intermediate dimension in feed-forward sub-networks) in BERT. In this paper, we adopt the one-shot Neural Architecture Search (NAS) to automatically search architecture hyper-parameters for efficient pre-trained language models (at least 6x faster than BERT-base).

AutoTinyBERT provides a model zoo that can meet different latency requirements.

Runs of huawei-noah AutoTinyBERT-KD-S2 on huggingface.co

13
Total runs
0
24-hour runs
-8
3-day runs
-9
7-day runs
-1
30-day runs

More Information About AutoTinyBERT-KD-S2 huggingface.co Model

AutoTinyBERT-KD-S2 huggingface.co

AutoTinyBERT-KD-S2 huggingface.co is an AI model on huggingface.co that provides AutoTinyBERT-KD-S2's model effect (), which can be used instantly with this huawei-noah AutoTinyBERT-KD-S2 model. huggingface.co supports a free trial of the AutoTinyBERT-KD-S2 model, and also provides paid use of the AutoTinyBERT-KD-S2. Support call AutoTinyBERT-KD-S2 model through api, including Node.js, Python, http.

AutoTinyBERT-KD-S2 huggingface.co Url

https://huggingface.co/huawei-noah/AutoTinyBERT-KD-S2

huawei-noah AutoTinyBERT-KD-S2 online free

AutoTinyBERT-KD-S2 huggingface.co is an online trial and call api platform, which integrates AutoTinyBERT-KD-S2's modeling effects, including api services, and provides a free online trial of AutoTinyBERT-KD-S2, you can try AutoTinyBERT-KD-S2 online for free by clicking the link below.

huawei-noah AutoTinyBERT-KD-S2 online free url in huggingface.co:

https://huggingface.co/huawei-noah/AutoTinyBERT-KD-S2

AutoTinyBERT-KD-S2 install

AutoTinyBERT-KD-S2 is an open source model from GitHub that offers a free installation service, and any user can find AutoTinyBERT-KD-S2 on GitHub to install. At the same time, huggingface.co provides the effect of AutoTinyBERT-KD-S2 install, users can directly use AutoTinyBERT-KD-S2 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

AutoTinyBERT-KD-S2 install url in huggingface.co:

https://huggingface.co/huawei-noah/AutoTinyBERT-KD-S2

Url of AutoTinyBERT-KD-S2

AutoTinyBERT-KD-S2 huggingface.co Url

Provider of AutoTinyBERT-KD-S2 huggingface.co

huawei-noah
ORGANIZATIONS

Other API from huawei-noah

huggingface.co

Total runs: 35
Run Growth: 24
Growth Rate: 70.59%
Updated:January 18 2024
huggingface.co

Total runs: 20
Run Growth: 15
Growth Rate: 75.00%
Updated:January 18 2024
huggingface.co

Total runs: 18
Run Growth: 9
Growth Rate: 47.37%
Updated:December 22 2022
huggingface.co

Total runs: 14
Run Growth: 5
Growth Rate: 33.33%
Updated:December 22 2022
huggingface.co

Total runs: 11
Run Growth: 10
Growth Rate: 76.92%
Updated:January 18 2024
huggingface.co

Total runs: 1
Run Growth: 1
Growth Rate: 100.00%
Updated:January 05 2022
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:September 27 2023