from transformers import AutoModelForMaskedLM, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained('dicta-il/dictabert-tiny')
model = AutoModelForMaskedLM.from_pretrained('dicta-il/dictabert-tiny')
model.eval()
sentence = 'בשנת 1948 השלים אפרים קישון את [MASK] בפיסול מתכת ובתולדות האמנות והחל לפרסם מאמרים הומוריסטיים'
output = model(tokenizer.encode(sentence, return_tensors='pt'))
# the [MASK] is the 7th token (including [CLS])import torch
top_2 = torch.topk(output.logits[0, 7, :], 2)[1]
print('\n'.join(tokenizer.convert_ids_to_tokens(top_2))) # should print עבודתו / התמחותו
Citation
If you use DictaBERT in your research, please cite
DictaBERT: A State-of-the-Art BERT Suite for Modern Hebrew
BibTeX:
@misc{shmidman2023dictabert,
title={DictaBERT: A State-of-the-Art BERT Suite for Modern Hebrew},
author={Shaltiel Shmidman and Avi Shmidman and Moshe Koppel},
year={2023},
eprint={2308.16687},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
dictabert-tiny huggingface.co is an AI model on huggingface.co that provides dictabert-tiny's model effect (), which can be used instantly with this dicta-il dictabert-tiny model. huggingface.co supports a free trial of the dictabert-tiny model, and also provides paid use of the dictabert-tiny. Support call dictabert-tiny model through api, including Node.js, Python, http.
dictabert-tiny huggingface.co is an online trial and call api platform, which integrates dictabert-tiny's modeling effects, including api services, and provides a free online trial of dictabert-tiny, you can try dictabert-tiny online for free by clicking the link below.
dicta-il dictabert-tiny online free url in huggingface.co:
dictabert-tiny is an open source model from GitHub that offers a free installation service, and any user can find dictabert-tiny on GitHub to install. At the same time, huggingface.co provides the effect of dictabert-tiny install, users can directly use dictabert-tiny installed effect in huggingface.co for debugging and trial. It also supports api for free installation.