tielectra-small huggingface.co api & fgaim tielectra-small github AI Model

Introduction of tielectra-small

Model Details of tielectra-small

Pre-trained ELECTRA small for Tigrinya Language

We pre-train ELECTRA small on the TLMD dataset, with over 40 million tokens.

Contained are trained Flax and PyTorch models.

Hyperparameters

The hyperparameters corresponding to model sizes mentioned above are as follows:

Model Size	L	AH	HS	FFN	P	Seq
SMALL	12	4	256	1024	14M	512

(L = number of layers; AH = number of attention heads; HS = hidden size; FFN = feedforward network dimension; P = number of parameters; Seq = maximum sequence length.)

Framework versions

Transformers 4.12.0.dev0
Pytorch 1.9.0+cu111
Datasets 1.13.3
Tokenizers 0.10.3

Citation

If you use this model in your product or research, please cite as follows:

@article{Fitsum2021TiPLMs,
  author={Fitsum Gaim and Wonsuk Yang and Jong C. Park},
  title={Monolingual Pre-trained Language Models for Tigrinya},
  year=2021,
  publisher={WiNLP 2021 at EMNLP 2021}
}

Runs of fgaim tielectra-small on huggingface.co

Total runs

24-hour runs

-1

3-day runs

-1

7-day runs

30-day runs

More Information About tielectra-small huggingface.co Model

tielectra-small huggingface.co

tielectra-small huggingface.co is an AI model on huggingface.co that provides tielectra-small's model effect (), which can be used instantly with this fgaim tielectra-small model. huggingface.co supports a free trial of the tielectra-small model, and also provides paid use of the tielectra-small. Support call tielectra-small model through api, including Node.js, Python, http.

tielectra-small huggingface.co Url

https://huggingface.co/fgaim/tielectra-small

fgaim tielectra-small online free

tielectra-small huggingface.co is an online trial and call api platform, which integrates tielectra-small's modeling effects, including api services, and provides a free online trial of tielectra-small, you can try tielectra-small online for free by clicking the link below.

fgaim tielectra-small online free url in huggingface.co:

https://huggingface.co/fgaim/tielectra-small

tielectra-small install

tielectra-small is an open source model from GitHub that offers a free installation service, and any user can find tielectra-small on GitHub to install. At the same time, huggingface.co provides the effect of tielectra-small install, users can directly use tielectra-small installed effect in huggingface.co for debugging and trial. It also supports api for free installation.