search

kevinzakka / recurrent-visual-attention

A PyTorch Implementation of "Recurrent Models of Visual Attention"
MIT License
468 stars 123 forks source link

Recurrent Attention Model using Transformer? #33

Open bemoregt opened 3 years ago

bemoregt commented 3 years ago

Hi, @clvcooke @kevinzakka @malashinroman

Visual Recurrent Attention Model using Transformer is not yet?

That is possible?

I wonder ...

Thanks.

Best,

@bemoregt.

clvcooke commented 3 years ago

Hey @bemoregt, maybe not a great place to ask (and I don't think any of the people you pinged are collaborators), but it certainly is possible. The recent VIT paper shows how to use transformers for image classification, so you could probably put them in place of the RNN cell used in RAM.

https://openreview.net/forum?id=YicbFdNTTy