huawei-noah / AutoTinyBERT-S4

huggingface.co
Total runs: 9
24-hour runs: 0
7-day runs: -1
30-day runs: -5
Model's Last Updated: May 16 2022

Introduction of AutoTinyBERT-S4

Model Details of AutoTinyBERT-S4

Pre-trained language models (PLMs) have achieved great success in natural language processing. Most of PLMs follow the default setting of architecture hyper-parameters (e.g., the hidden dimension is a quarter of the intermediate dimension in feed-forward sub-networks) in BERT. In this paper, we adopt the one-shot Neural Architecture Search (NAS) to automatically search architecture hyper-parameters for efficient pre-trained language models (at least 6x faster than BERT-base).

AutoTinyBERT provides a model zoo that can meet different latency requirements.

Runs of huawei-noah AutoTinyBERT-S4 on huggingface.co

9
Total runs
0
24-hour runs
-1
3-day runs
-1
7-day runs
-5
30-day runs

More Information About AutoTinyBERT-S4 huggingface.co Model

More AutoTinyBERT-S4 license Visit here:

https://choosealicense.com/licenses/other

AutoTinyBERT-S4 huggingface.co

AutoTinyBERT-S4 huggingface.co is an AI model on huggingface.co that provides AutoTinyBERT-S4's model effect (), which can be used instantly with this huawei-noah AutoTinyBERT-S4 model. huggingface.co supports a free trial of the AutoTinyBERT-S4 model, and also provides paid use of the AutoTinyBERT-S4. Support call AutoTinyBERT-S4 model through api, including Node.js, Python, http.

huawei-noah AutoTinyBERT-S4 online free

AutoTinyBERT-S4 huggingface.co is an online trial and call api platform, which integrates AutoTinyBERT-S4's modeling effects, including api services, and provides a free online trial of AutoTinyBERT-S4, you can try AutoTinyBERT-S4 online for free by clicking the link below.

huawei-noah AutoTinyBERT-S4 online free url in huggingface.co:

https://huggingface.co/huawei-noah/AutoTinyBERT-S4

AutoTinyBERT-S4 install

AutoTinyBERT-S4 is an open source model from GitHub that offers a free installation service, and any user can find AutoTinyBERT-S4 on GitHub to install. At the same time, huggingface.co provides the effect of AutoTinyBERT-S4 install, users can directly use AutoTinyBERT-S4 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

AutoTinyBERT-S4 install url in huggingface.co:

https://huggingface.co/huawei-noah/AutoTinyBERT-S4

Url of AutoTinyBERT-S4

AutoTinyBERT-S4 huggingface.co Url

Provider of AutoTinyBERT-S4 huggingface.co

huawei-noah
ORGANIZATIONS

Other API from huawei-noah

huggingface.co

Total runs: 45
Run Growth: 36
Growth Rate: 78.26%
Updated:January 18 2024
huggingface.co

Total runs: 17
Run Growth: 15
Growth Rate: 75.00%
Updated:January 18 2024
huggingface.co

Total runs: 16
Run Growth: 10
Growth Rate: 52.63%
Updated:December 22 2022
huggingface.co

Total runs: 13
Run Growth: 5
Growth Rate: 35.71%
Updated:December 22 2022
huggingface.co

Total runs: 7
Run Growth: -1
Growth Rate: -11.11%
Updated:January 18 2024
huggingface.co

Total runs: 1
Run Growth: 1
Growth Rate: 100.00%
Updated:January 05 2022
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:September 27 2023