huawei-noah / AutoTinyBERT-S1

huggingface.co
Total runs: 11
24-hour runs: 0
7-day runs: -1
30-day runs: -9
Model's Last Updated: May 16 2022

Introduction of AutoTinyBERT-S1

Model Details of AutoTinyBERT-S1

Pre-trained language models (PLMs) have achieved great success in natural language processing. Most of PLMs follow the default setting of architecture hyper-parameters (e.g., the hidden dimension is a quarter of the intermediate dimension in feed-forward sub-networks) in BERT. In this paper, we adopt the one-shot Neural Architecture Search (NAS) to automatically search architecture hyper-parameters for efficient pre-trained language models (at least 6x faster than BERT-base).

AutoTinyBERT provides a model zoo that can meet different latency requirements.

Runs of huawei-noah AutoTinyBERT-S1 on huggingface.co

11
Total runs
0
24-hour runs
0
3-day runs
-1
7-day runs
-9
30-day runs

More Information About AutoTinyBERT-S1 huggingface.co Model

More AutoTinyBERT-S1 license Visit here:

https://choosealicense.com/licenses/other

AutoTinyBERT-S1 huggingface.co

AutoTinyBERT-S1 huggingface.co is an AI model on huggingface.co that provides AutoTinyBERT-S1's model effect (), which can be used instantly with this huawei-noah AutoTinyBERT-S1 model. huggingface.co supports a free trial of the AutoTinyBERT-S1 model, and also provides paid use of the AutoTinyBERT-S1. Support call AutoTinyBERT-S1 model through api, including Node.js, Python, http.

huawei-noah AutoTinyBERT-S1 online free

AutoTinyBERT-S1 huggingface.co is an online trial and call api platform, which integrates AutoTinyBERT-S1's modeling effects, including api services, and provides a free online trial of AutoTinyBERT-S1, you can try AutoTinyBERT-S1 online for free by clicking the link below.

huawei-noah AutoTinyBERT-S1 online free url in huggingface.co:

https://huggingface.co/huawei-noah/AutoTinyBERT-S1

AutoTinyBERT-S1 install

AutoTinyBERT-S1 is an open source model from GitHub that offers a free installation service, and any user can find AutoTinyBERT-S1 on GitHub to install. At the same time, huggingface.co provides the effect of AutoTinyBERT-S1 install, users can directly use AutoTinyBERT-S1 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

AutoTinyBERT-S1 install url in huggingface.co:

https://huggingface.co/huawei-noah/AutoTinyBERT-S1

Url of AutoTinyBERT-S1

AutoTinyBERT-S1 huggingface.co Url

Provider of AutoTinyBERT-S1 huggingface.co

huawei-noah
ORGANIZATIONS

Other API from huawei-noah

huggingface.co

Total runs: 46
Run Growth: 36
Growth Rate: 78.26%
Updated:January 18 2024
huggingface.co

Total runs: 20
Run Growth: 15
Growth Rate: 75.00%
Updated:January 18 2024
huggingface.co

Total runs: 19
Run Growth: 10
Growth Rate: 52.63%
Updated:December 22 2022
huggingface.co

Total runs: 14
Run Growth: 5
Growth Rate: 35.71%
Updated:December 22 2022
huggingface.co

Total runs: 9
Run Growth: -1
Growth Rate: -11.11%
Updated:January 18 2024
huggingface.co

Total runs: 1
Run Growth: 1
Growth Rate: 100.00%
Updated:January 05 2022
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:September 27 2023