Does the relative position embedding work?

[22TonyFStark]

Hello, I notice that you provide the code for the relative position as optional, I wonder have you done some experiments about it? Does it work well? Thanks for your work, it inspires me a lot :)

[peterant330]

Hello, I notice that you provide the code for the relative position as optional, I wonder have you done some experiments about it? Does it work well? Thanks for your work, it inspires me a lot :)

The code about the relative position is inherited from the original SAM code. As we are focusing on fine-tuning, for those parameters we just use the same setting as the original code without further ablation (which is set to be true if I remember correctly).