Readme
CodeGen
This is an unofficial implementation not affiliated with Salesforce.
Sample from the
codegen-6B-mono
checkpoint trained on python.
Arxiv : A Conversational Paradigm for Program Synthesis
Authors : Erik Nijkamp *, Bo Pang *, Hiroaki Hayashi *, Lifu Tu , Huan Wang , Yingbo Zhou , Silvio Savarese , and Caiming Xiong (* indicates equal contribution)
Released models
The models are named in the following format:
codegen-{model-size}-{data}
model-size
has 4 options:
350M
,
2B
,
6B
,
16B
, which represent the number of parameters in each model.
data
has 3 options:
nl
,
multi
,
mono
.
-
nlmodels are randomly initialized and trained on The Pile , a 825.18 GB English text corpous. -
multimodels are initialized fromnlmodels and then trained on a corpus with code data consisting of multiple programming languages. -
monomodels are initialized frommultimodels and then trained on a corpus with Python code data.
Download the model parameters
codegen-350M-nl,multi,mono
https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-350M-nl.tar.gz https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-350M-multi.tar.gz https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-350M-mono.tar.gz
codegen-2B-nl,multi,mono
https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-2B-nl.tar.gz https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-2B-multi.tar.gz https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-2B-mono.tar.gz
codegen-6B-nl,multi,mono
https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-6B-nl.tar.gz https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-6B-multi.tar.gz https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-6B-mono.tar.gz
codegen-16B-nl,multi,mono
https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-16B-nl.tar.gz https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-16B-multi.tar.gz https://storage.googleapis.com/sfr-codegen-research/checkpoints/codegen-16B-mono.tar.gz
Citation
If you find our code or paper useful, please cite the paper:
@article{Nijkamp2022ACP,
title={A Conversational Paradigm for Program Synthesis},
author={Nijkamp, Erik and Pang, Bo and Hayashi, Hiroaki and Tu, Lifu and Wang, Huan and Zhou, Yingbo and Savarese, Silvio and Xiong, Caiming},
journal={arXiv preprint},
year={2022}
}
License
Our code is BSD-3 licensed. See LICENSE.txt for details.
