DictaBERT: A State-of-the-Art BERT Suite for Modern Hebrew
State-of-the-art language model for Hebrew, released
here
.
This is the base model pretrained with the masked-language-modeling objective.
For the bert-base models for other tasks, see
here
.
Sample usage:
from transformers import AutoModelForMaskedLM, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained('dicta-il/dictabert')
model = AutoModelForMaskedLM.from_pretrained('dicta-il/dictabert')
model.eval()
sentence = 'בשנת 1948 השלים אפרים קישון את [MASK] בפיסול מתכת ובתולדות האמנות והחל לפרסם מאמרים הומוריסטיים'
output = model(tokenizer.encode(sentence, return_tensors='pt'))
# the [MASK] is the 7th token (including [CLS])import torch
top_2 = torch.topk(output.logits[0, 7, :], 2)[1]
print('\n'.join(tokenizer.convert_ids_to_tokens(top_2))) # should print מחקרו / התמחותו
Citation
If you use DictaBERT in your research, please cite
DictaBERT: A State-of-the-Art BERT Suite for Modern Hebrew
BibTeX:
@misc{shmidman2023dictabert,
title={DictaBERT: A State-of-the-Art BERT Suite for Modern Hebrew},
author={Shaltiel Shmidman and Avi Shmidman and Moshe Koppel},
year={2023},
eprint={2308.16687},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
dictabert huggingface.co is an AI model on huggingface.co that provides dictabert's model effect (), which can be used instantly with this dicta-il dictabert model. huggingface.co supports a free trial of the dictabert model, and also provides paid use of the dictabert. Support call dictabert model through api, including Node.js, Python, http.
dictabert huggingface.co is an online trial and call api platform, which integrates dictabert's modeling effects, including api services, and provides a free online trial of dictabert, you can try dictabert online for free by clicking the link below.
dicta-il dictabert online free url in huggingface.co:
dictabert is an open source model from GitHub that offers a free installation service, and any user can find dictabert on GitHub to install. At the same time, huggingface.co provides the effect of dictabert install, users can directly use dictabert installed effect in huggingface.co for debugging and trial. It also supports api for free installation.