Closed yangliu1510 closed 1 year ago
yes,I think so
yes,it totally different.I don't how shifted operation pays attention to the local as the paper illustrate. I wonder if my understanding is right.
The shift operation restricts the information that the MLP sees. Shifting across height and width simply localizes the span of information that the network sees.
From the code the shifted mlp operation seems a bit like the operation in [S2-MLP: Spatial-Shift MLP Architecture for Vision].