CuBERT: Learning and Evaluating Contextual Embedding of Source Code
Overview
This model is the unofficial HuggingFace version of "
CuBERT
". In particular, this version comes from
gs://cubert/20210711_Python/pre_trained_model_epochs_2__length_1024
. It was trained 2021-07-11 for 2 epochs with a 1024 token context window on the Python BigQuery dataset. I manually converted the Tensorflow checkpoint to PyTorch and have uploaded it here. The
tokenizer
has not been converted yet. All credit goes to Aditya Kanade, Petros Maniatis, Gogul Balakrishnan, and Kensen Shi.
@inproceedings{cubert,
author = {Aditya Kanade and
Petros Maniatis and
Gogul Balakrishnan and
Kensen Shi},
title = {Learning and evaluating contextual embedding of source code},
booktitle = {Proceedings of the 37th International Conference on Machine Learning,
{ICML} 2020, 12-18 July 2020},
series = {Proceedings of Machine Learning Research},
publisher = {{PMLR}},
year = {2020},
}
Runs of claudios cubert-20210711-Python-1024 on huggingface.co
4
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
3
30-day runs
More Information About cubert-20210711-Python-1024 huggingface.co Model
More cubert-20210711-Python-1024 license Visit here:
cubert-20210711-Python-1024 huggingface.co is an AI model on huggingface.co that provides cubert-20210711-Python-1024's model effect (), which can be used instantly with this claudios cubert-20210711-Python-1024 model. huggingface.co supports a free trial of the cubert-20210711-Python-1024 model, and also provides paid use of the cubert-20210711-Python-1024. Support call cubert-20210711-Python-1024 model through api, including Node.js, Python, http.
cubert-20210711-Python-1024 huggingface.co is an online trial and call api platform, which integrates cubert-20210711-Python-1024's modeling effects, including api services, and provides a free online trial of cubert-20210711-Python-1024, you can try cubert-20210711-Python-1024 online for free by clicking the link below.
claudios cubert-20210711-Python-1024 online free url in huggingface.co:
cubert-20210711-Python-1024 is an open source model from GitHub that offers a free installation service, and any user can find cubert-20210711-Python-1024 on GitHub to install. At the same time, huggingface.co provides the effect of cubert-20210711-Python-1024 install, users can directly use cubert-20210711-Python-1024 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
cubert-20210711-Python-1024 install url in huggingface.co: