mnaylor / mega-base-wikitext

huggingface.co
Total runs: 4.5K
24-hour runs: 0
7-day runs: -182
30-day runs: 2.8K
Model's Last Updated: June 29 2023
fill-mask

Introduction of mega-base-wikitext

Model Details of mega-base-wikitext

Mega Masked LM on wikitext-103

This is the location on the Hugging Face hub for the Mega MLM checkpoint. I trained this model on the wikitext-103 dataset using standard BERT-style masked LM pretraining using the original Mega repository and uploaded the weights initially to hf.co/mnaylor/mega-wikitext-103. When the implementation of Mega into Hugging Face's transformers is finished, the weights here are designed to be used with MegaForMaskedLM and are compatible with the other (encoder-based) MegaFor* model classes.

This model uses the RoBERTa base tokenizer since the Mega paper does not implement a specific tokenizer aside from the character-level tokenizer used to illustrate long-sequence performance.

Runs of mnaylor mega-base-wikitext on huggingface.co

4.5K
Total runs
0
24-hour runs
16
3-day runs
-182
7-day runs
2.8K
30-day runs

More Information About mega-base-wikitext huggingface.co Model

More mega-base-wikitext license Visit here:

https://choosealicense.com/licenses/apache-2.0

mega-base-wikitext huggingface.co

mega-base-wikitext huggingface.co is an AI model on huggingface.co that provides mega-base-wikitext's model effect (), which can be used instantly with this mnaylor mega-base-wikitext model. huggingface.co supports a free trial of the mega-base-wikitext model, and also provides paid use of the mega-base-wikitext. Support call mega-base-wikitext model through api, including Node.js, Python, http.

mega-base-wikitext huggingface.co Url

https://huggingface.co/mnaylor/mega-base-wikitext

mnaylor mega-base-wikitext online free

mega-base-wikitext huggingface.co is an online trial and call api platform, which integrates mega-base-wikitext's modeling effects, including api services, and provides a free online trial of mega-base-wikitext, you can try mega-base-wikitext online for free by clicking the link below.

mnaylor mega-base-wikitext online free url in huggingface.co:

https://huggingface.co/mnaylor/mega-base-wikitext

mega-base-wikitext install

mega-base-wikitext is an open source model from GitHub that offers a free installation service, and any user can find mega-base-wikitext on GitHub to install. At the same time, huggingface.co provides the effect of mega-base-wikitext install, users can directly use mega-base-wikitext installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

mega-base-wikitext install url in huggingface.co:

https://huggingface.co/mnaylor/mega-base-wikitext

Url of mega-base-wikitext

mega-base-wikitext huggingface.co Url

Provider of mega-base-wikitext huggingface.co

mnaylor
ORGANIZATIONS

Other API from mnaylor