Please tell me about "+ dual-gen" and "+ multi-task".

salesforce / CodeT5

Home of CodeT5: Open Code LLMs for Code Understanding and Generation

https://arxiv.org/abs/2305.07922

BSD 3-Clause "New" or "Revised" License

2.68k stars 394 forks source link

Please tell me about "+ dual-gen" and "+ multi-task". #53

Closed yfnskw closed 2 years ago

yfnskw commented 2 years ago

Hello. Please forgive me because I am not used to reading papers. I have a question about the description of the Code T5 paper. Tables 2 and 4 of the CodeT5 paper have the descriptions "CodeT5-base", "+ dual-gen", and "multi-task". Does this fit the following interpretation? "CodeT5-base" "CodeT5-base + dual-gen" "CodeT5-base + dual-gen + multi-task"

And is only "Code T5-base" published on Hugging Face?

yuewang-cuhk commented 2 years ago

Hi, most of your interpretation are correct except that for "CodeT5-base + multi-task", it does not include the dual-gen pretraining objective.