salesforce / CodeT5

Home of CodeT5: Open Code LLMs for Code Understanding and Generation
https://arxiv.org/abs/2305.07922
BSD 3-Clause "New" or "Revised" License
2.68k stars 394 forks source link

The dual-gen pre-trained model #37

Closed Vladimir-Chan closed 2 years ago

Vladimir-Chan commented 2 years ago

Hi, I'm fine-tuning the CodeT5 model on my dataset for the code generation task. In the paper the CodeT5-base model with the dual-gen achieved the best performance but there are no model with dual-gen released. So, is the CodeT5-base model released in hugginface the model with the dual-gen? If not, could you please release the pre-trained model with the dual-gen?

yuewang-cuhk commented 2 years ago

Hi, currently we do not released the checkpoints with dual-gen. Tentatively you can directly fine-tune from the released CodeT5-base checkpoint.