How do I operate separately on the encoder and decoder ?

salesforce / CodeT5

Home of CodeT5: Open Code LLMs for Code Understanding and Generation

https://arxiv.org/abs/2305.07922

BSD 3-Clause "New" or "Revised" License

2.65k stars 391 forks source link

How do I operate separately on the encoder and decoder ? #170

Open aniucw opened 1 month ago

aniucw commented 1 month ago

Hello! I intend to implement a code repair task based on codeT5, but I need to do some processing on the encoder generated embedding before passing it to the decoder for experimentation. Is there a way to implement this process?