How do you connect Convolutional layers to Transformers?

Kyubyong / transformer

A TensorFlow Implementation of the Transformer: Attention Is All You Need

Apache License 2.0

4.29k stars 1.3k forks source link

How do you connect Convolutional layers to Transformers? #160

Open leersaam opened 4 years ago

leersaam commented 4 years ago

Hi everyone! Where can I find code example that makes clear how Convolutional layers are connected to Transformers and how it needs to be shaped in order to make such a connection? I have a bit of a hard time figuring it out.

Thank you for your support.