huawei-noah / AutoTinyBERT-KD-S4

huggingface.co
Total runs: 15
24-hour runs: 0
7-day runs: 2
30-day runs: 8
Model's Last Updated: May 16 2022

Introduction of AutoTinyBERT-KD-S4

Model Details of AutoTinyBERT-KD-S4

Pre-trained language models (PLMs) have achieved great success in natural language processing. Most of PLMs follow the default setting of architecture hyper-parameters (e.g., the hidden dimension is a quarter of the intermediate dimension in feed-forward sub-networks) in BERT. In this paper, we adopt the one-shot Neural Architecture Search (NAS) to automatically search architecture hyper-parameters for efficient pre-trained language models (at least 6x faster than BERT-base).

AutoTinyBERT provides a model zoo that can meet different latency requirements.

Runs of huawei-noah AutoTinyBERT-KD-S4 on huggingface.co

15
Total runs
0
24-hour runs
2
3-day runs
2
7-day runs
8
30-day runs

More Information About AutoTinyBERT-KD-S4 huggingface.co Model

More AutoTinyBERT-KD-S4 license Visit here:

https://choosealicense.com/licenses/other

AutoTinyBERT-KD-S4 huggingface.co

AutoTinyBERT-KD-S4 huggingface.co is an AI model on huggingface.co that provides AutoTinyBERT-KD-S4's model effect (), which can be used instantly with this huawei-noah AutoTinyBERT-KD-S4 model. huggingface.co supports a free trial of the AutoTinyBERT-KD-S4 model, and also provides paid use of the AutoTinyBERT-KD-S4. Support call AutoTinyBERT-KD-S4 model through api, including Node.js, Python, http.

AutoTinyBERT-KD-S4 huggingface.co Url

https://huggingface.co/huawei-noah/AutoTinyBERT-KD-S4

huawei-noah AutoTinyBERT-KD-S4 online free

AutoTinyBERT-KD-S4 huggingface.co is an online trial and call api platform, which integrates AutoTinyBERT-KD-S4's modeling effects, including api services, and provides a free online trial of AutoTinyBERT-KD-S4, you can try AutoTinyBERT-KD-S4 online for free by clicking the link below.

huawei-noah AutoTinyBERT-KD-S4 online free url in huggingface.co:

https://huggingface.co/huawei-noah/AutoTinyBERT-KD-S4

AutoTinyBERT-KD-S4 install

AutoTinyBERT-KD-S4 is an open source model from GitHub that offers a free installation service, and any user can find AutoTinyBERT-KD-S4 on GitHub to install. At the same time, huggingface.co provides the effect of AutoTinyBERT-KD-S4 install, users can directly use AutoTinyBERT-KD-S4 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

AutoTinyBERT-KD-S4 install url in huggingface.co:

https://huggingface.co/huawei-noah/AutoTinyBERT-KD-S4

Url of AutoTinyBERT-KD-S4

AutoTinyBERT-KD-S4 huggingface.co Url

Provider of AutoTinyBERT-KD-S4 huggingface.co

huawei-noah
ORGANIZATIONS

Other API from huawei-noah

huggingface.co

Total runs: 10
Run Growth: -46
Growth Rate: -575.00%
Updated:January 18 2024
huggingface.co

Total runs: 10
Run Growth: 2
Growth Rate: 20.00%
Updated:January 18 2024
huggingface.co

Total runs: 9
Run Growth: 0
Growth Rate: 0.00%
Updated:December 22 2022
huggingface.co

Total runs: 9
Run Growth: -1
Growth Rate: -11.11%
Updated:December 22 2022
huggingface.co

Total runs: 5
Run Growth: -3
Growth Rate: -60.00%
Updated:January 18 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:September 27 2023
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:January 05 2022