wasiahmad / PLBART

Official code of our work, Unified Pre-training for Program Understanding and Generation [NAACL 2021].
https://arxiv.org/abs/2103.06333
MIT License
186 stars 35 forks source link

Can we add structural information in PLBART? #44

Closed smith-co closed 2 years ago

smith-co commented 2 years ago

I know this is not the perfect question to add into this repo. I understand PLABART is based on a transformer architecture and deal with sequence based text stream.

But would be curious to know whether we can embed structural information like AST level edges in PLBART.

wasiahmad commented 2 years ago

We can do anything we want with PLBART; however, what you are looking for is not supported in the code repository.

smith-co commented 2 years ago

@wasiahmad how would you actually approach adding AST level edges in PLBART as it is a sequence based model?

wasiahmad commented 2 years ago

PLBART uses a Transformer structure. Therefore, you can follow prior works that fused AST info into the Transformer architecture.