Conversational BERT (English, cased, 12‑layer, 768‑hidden, 12‑heads, 110M parameters) was trained on the English part of Twitter, Reddit, DailyDialogues[1], OpenSubtitles[2], Debates[3], Blogs[4], Facebook News Comments. We used this training data to build the vocabulary of English subtokens and took English cased version of BERT‑base as an initialization for English Conversational BERT.
08.11.2021: upload model with MLM and NSP heads
[1]: Yanran Li, Hui Su, Xiaoyu Shen, Wenjie Li, Ziqiang Cao, and Shuzi Niu. DailyDialog: A Manually Labelled Multi-turn Dialogue Dataset. IJCNLP 2017.
[2]: P. Lison and J. Tiedemann, 2016, OpenSubtitles2016: Extracting Large Parallel Corpora from Movie and TV Subtitles. In Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC 2016)
[3]: Justine Zhang, Ravi Kumar, Sujith Ravi, Cristian Danescu-Niculescu-Mizil. Proceedings of NAACL, 2016.
[4]: J. Schler, M. Koppel, S. Argamon and J. Pennebaker (2006). Effects of Age and Gender on Blogging in Proceedings of 2006 AAAI Spring Symposium on Computational Approaches for Analyzing Weblogs.
Runs of DeepPavlov bert-base-cased-conversational on huggingface.co
166
Total runs
-5
24-hour runs
4
3-day runs
-27
7-day runs
48
30-day runs
More Information About bert-base-cased-conversational huggingface.co Model
bert-base-cased-conversational huggingface.co
bert-base-cased-conversational huggingface.co is an AI model on huggingface.co that provides bert-base-cased-conversational's model effect (), which can be used instantly with this DeepPavlov bert-base-cased-conversational model. huggingface.co supports a free trial of the bert-base-cased-conversational model, and also provides paid use of the bert-base-cased-conversational. Support call bert-base-cased-conversational model through api, including Node.js, Python, http.
bert-base-cased-conversational huggingface.co is an online trial and call api platform, which integrates bert-base-cased-conversational's modeling effects, including api services, and provides a free online trial of bert-base-cased-conversational, you can try bert-base-cased-conversational online for free by clicking the link below.
DeepPavlov bert-base-cased-conversational online free url in huggingface.co:
bert-base-cased-conversational is an open source model from GitHub that offers a free installation service, and any user can find bert-base-cased-conversational on GitHub to install. At the same time, huggingface.co provides the effect of bert-base-cased-conversational install, users can directly use bert-base-cased-conversational installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
bert-base-cased-conversational install url in huggingface.co: