search

salesforce / CodeT5

Home of CodeT5: Open Code LLMs for Code Understanding and Generation
https://arxiv.org/abs/2305.07922
BSD 3-Clause "New" or "Revised" License
2.74k stars 401 forks source link

Is the decoder of large CodeT5p fine-tuned during the fine-tuning ? #125

Closed huynhvp closed 1 year ago

huynhvp commented 1 year ago

Hello,

Thank you for the great work ! I am wondering if the decoder will be fine-tuned or still be kept intact during the fine-tuning with my own training dataset, as during the pretraning, it is freezed.

Thank you for your answer !

yuewang-cuhk commented 1 year ago

Hi there, you can decide whether to finetune the deep decode LLM by commenting/uncommenting this line.