lucidrains / recurrent-interface-network-pytorch

Implementation of Recurrent Interface Network (RIN), for highly efficient generation of images and video without cascading networks, in Pytorch
MIT License
195 stars 14 forks source link

Block-wise positional embedding #12

Open katop1234 opened 1 year ago

katop1234 commented 1 year ago

Hi,

I was looking to implement the RIN architecture using your code. I noticed you applied positional embedding in every block, as opposed to just once in the beginning. What was the reasoning was behind this?

https://github.com/lucidrains/recurrent-interface-network-pytorch/blob/main/rin_pytorch/rin_pytorch.py#L312

And thank you for writing this code!