Closed kun-dragon closed 1 year ago
Do you try to use learnable position embedding, instead of sinusoid encoding? Will it have better performance?
We follow MAE and use sinusoid encoding as default setting.
Do you try to use learnable position embedding, instead of sinusoid encoding? Will it have better performance?