Closed alexdemartos closed 3 years ago
Hi, Google just published a model similar to yours. I just thought it might be interesting for you, in case you haven't read it yet :p
https://arxiv.org/abs/2010.04301
I think it's particularly interesting the Gaussian way they upsample the encoder outputs, and maybe also the positional encoding.
Best regards!
Cool, didnt read that yet - looks interesting, thanks!
Hi, Google just published a model similar to yours. I just thought it might be interesting for you, in case you haven't read it yet :p
https://arxiv.org/abs/2010.04301
I think it's particularly interesting the Gaussian way they upsample the encoder outputs, and maybe also the positional encoding.
Best regards!