cheerss / CrossFormer

The official code for the paper: https://openreview.net/forum?id=_PHymLIxuI
MIT License
360 stars 43 forks source link

question about LDA and SDA for irregular feature map #6

Open Huzhen757 opened 3 years ago

Huzhen757 commented 3 years ago

Thank you very much for your careful reply about LDA and SDA ,but I have another question about LDA and SDA for irregular feature map。

In your paper,the LDA and SDA used for regular input image size,like 224x224 or 384x384. So the group size is default 7, and the I is set (8, 4, 2, 1) . And for Stage-1, the I = 8, because of the need to meet GxI = feature map width/height(56x56).

However, for irregular feature map size, for example, 80 x 134, now for the group size and interval ,It seems that we can no longer design as mentioned in the paper。If the group size is 7,it's need to padding feature map to apply the group size,then the feature map size is become 84x140, the feature map reshape to [W_nG, G, H_nG, G], SDA here can be executed normally。 but for next LDA,how to set the interval I ?Besides,the feature map is irregular,so the interval I is different for width and height。How can I reasonably set the parameter interval I ?

Can you give me some advice about this question?Thanks!