Relative Positional Encoding

mli0603 / stereo-transformer

Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformers. (ICCV 2021 Oral)

Apache License 2.0

659 stars 107 forks source link

Relative Positional Encoding #91

Open yesstarA opened 10 months ago

yesstarA commented 10 months ago

Hello! Your wonderful work inspired me a lot, especially the part "Efficient Implementation of Attention with Relative Positional Encoding". I want to know whether the relative positional encoding you proposed can be applied to 3D transformer? If possible, could you give me some advice?