search

graph4ai / graph4nlp

Graph4nlp is the library for the easy use of Graph Neural Networks for NLP. Welcome to visit our DLG4NLP website (https://dlg4nlp.github.io/index.html) for various learning resources!
Apache License 2.0
1.67k stars 201 forks source link

Support for transformer as the decoder #575

Closed smith-co closed 2 years ago

smith-co commented 2 years ago

🚀 Feature

In the current implementation, RNNs are used as the decoder.

I think it would be great to have Transformer as the decoder.

Wondering whether this feature is already under consideration.

Also if support the transformer implementation, when that feature would be availble?

AlanSwift commented 2 years ago

Thanks for your interest in the library. We agree that transformer is needed and it is on schedule. I have replied it in https://github.com/graph4ai/graph4nlp/issues/496#issuecomment-1207130759.