search

zhmiao / OpenLongTailRecognition-OLTR

Pytorch implementation for "Large-Scale Long-Tailed Recognition in an Open World" (CVPR 2019 ORAL)
BSD 3-Clause "New" or "Revised" License
849 stars 128 forks source link

What's the difference and relationship between spatial attention and self attention #18

Closed jchhuang closed 5 years ago

jchhuang commented 5 years ago

Since both of the spatial and self attention are used in the modulated attention, in my understanding both of these two parts are used to capture the spatial information, so may you tell me what's the difference and relationship between spatial attention and self attention.

zhmiao commented 5 years ago

same as this issue: https://github.com/zhmiao/OpenLongTailRecognition-OLTR/issues/15#issuecomment-514042191