salesforce / CodeT5

Home of CodeT5: Open Code LLMs for Code Understanding and Generation
https://arxiv.org/abs/2305.07922
BSD 3-Clause "New" or "Revised" License
2.65k stars 391 forks source link

Unimodal Pretraining #141

Open senu11 opened 10 months ago

senu11 commented 10 months ago

Dear author,

Thank you for the great work and published it! I'm very interested in your work. Could you please release the Codet5p-2b model that has only been pretrained with the first stage of unimodal pretraining? Thanks for your time!

yuewang-cuhk commented 10 months ago

Hi there, the current released CodeT5+ 2B model is exactly the one that has only been pretrained with the first stage of unimodal pretraining.

senu11 commented 10 months ago

Thank you and your answer!