salesforce / CodeT5

Home of CodeT5: Open Code LLMs for Code Understanding and Generation
https://arxiv.org/abs/2305.07922
BSD 3-Clause "New" or "Revised" License
2.71k stars 396 forks source link

Finetune Task For Code Completion #12

Closed HoratioJSY closed 2 years ago

HoratioJSY commented 2 years ago

Hi, Is there a fine-tune task for code completion? Maybe, I can implement Masked Span Prediction Task as fine-tune task for code generation (like gpt style)?

yuewang-cuhk commented 2 years ago

Hi, we do not fine-tune CodeT5 on code completion. You might refer to this paper for how to apply seq2seq models for code autocompletion task.