DictaBERT: A State-of-the-Art BERT Suite for Modern Hebrew
State-of-the-art language model for Hebrew, released
here
.
This is the fine-tuned model for the morphological tagging task.
For the bert-base models for other tasks, see
here
.
Sample usage:
from transformers import AutoModel, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained('dicta-il/dictabert-morph')
model = AutoModel.from_pretrained('dicta-il/dictabert-morph', trust_remote_code=True)
model.eval()
sentence = 'בשנת 1948 השלים אפרים קישון את לימודיו בפיסול מתכת ובתולדות האמנות והחל לפרסם מאמרים הומוריסטיים'print(model.predict([sentence], tokenizer))
Output:
[{"text":"בשנת 1948 השלים אפרים קישון את לימודיו בפיסול מתכת ובתולדות האמנות והחל לפרסם מאמרים הומוריסטיים","tokens":[{"token":"בשנת","pos":"NOUN","feats":{"Gender":"Fem","Number":"Sing"},"prefixes":["ADP"],"suffix":false},{"token":"1948","pos":"NUM","feats":{},"prefixes":[],"suffix":false},{"token":"השלים","pos":"VERB","feats":{"Gender":"Masc","Number":"Sing","Person":"3","Tense":"Past"},"prefixes":[],"suffix":false},{"token":"אפרים","pos":"PROPN","feats":{},"prefixes":[],"suffix":false},{"token":"קישון","pos":"PROPN","feats":{},"prefixes":[],"suffix":false},{"token":"את","pos":"ADP","feats":{},"prefixes":[],"suffix":false},{"token":"לימודיו","pos":"NOUN","feats":{"Gender":"Masc","Number":"Plur"},"prefixes":[],"suffix":"PRON","suffix_feats":{"Gender":"Masc","Number":"Sing","Person":"3"}},{"token":"בפיסול","pos":"NOUN","feats":{"Gender":"Masc","Number":"Sing"},"prefixes":["ADP"],"suffix":false},{"token":"מתכת","pos":"NOUN","feats":{"Gender":"Fem","Number":"Sing"},"prefixes":[],"suffix":false},{"token":"ובתולדות","pos":"NOUN","feats":{"Gender":"Fem","Number":"Plur"},"prefixes":["CCONJ","ADP"],"suffix":false},{"token":"האמנות","pos":"NOUN","feats":{"Gender":"Fem","Number":"Sing"},"prefixes":["DET"],"suffix":false},{"token":"והחל","pos":"VERB","feats":{"Gender":"Masc","Number":"Sing","Person":"3","Tense":"Past"},"prefixes":["CCONJ"],"suffix":false},{"token":"לפרסם","pos":"VERB","feats":{},"prefixes":[],"suffix":false},{"token":"מאמרים","pos":"NOUN","feats":{"Gender":"Masc","Number":"Plur"},"prefixes":[],"suffix":false},{"token":"הומוריסטיים","pos":"ADJ","feats":{"Gender":"Masc","Number":"Plur"},"prefixes":[],"suffix":false}]}]
Citation
If you use DictaBERT in your research, please cite
DictaBERT: A State-of-the-Art BERT Suite for Modern Hebrew
BibTeX:
@misc{shmidman2023dictabert,
title={DictaBERT: A State-of-the-Art BERT Suite for Modern Hebrew},
author={Shaltiel Shmidman and Avi Shmidman and Moshe Koppel},
year={2023},
eprint={2308.16687},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
dictabert-morph huggingface.co is an AI model on huggingface.co that provides dictabert-morph's model effect (), which can be used instantly with this dicta-il dictabert-morph model. huggingface.co supports a free trial of the dictabert-morph model, and also provides paid use of the dictabert-morph. Support call dictabert-morph model through api, including Node.js, Python, http.
dictabert-morph huggingface.co is an online trial and call api platform, which integrates dictabert-morph's modeling effects, including api services, and provides a free online trial of dictabert-morph, you can try dictabert-morph online for free by clicking the link below.
dicta-il dictabert-morph online free url in huggingface.co:
dictabert-morph is an open source model from GitHub that offers a free installation service, and any user can find dictabert-morph on GitHub to install. At the same time, huggingface.co provides the effect of dictabert-morph install, users can directly use dictabert-morph installed effect in huggingface.co for debugging and trial. It also supports api for free installation.