search

feixue94 / imp-release

[CVPR 2023] IMP: iterative matching and pose estimation with transformer-based recurrent module
https://feixue94.github.io/
Other
141 stars 11 forks source link

No pose supervision? #7

Open AbyssGaze opened 1 year ago

AbyssGaze commented 1 year ago

After looking at the code, it seems that I didn't see any estimation or supervision of pose during the training process. Additionally, the "Iterative" mentioned in the paper seems to correspond to the number of iterations for self-cross attention. I'm not sure if I misunderstood this.

feixue94 commented 1 year ago

The code of pose supervision is very similar to that used in OANet and will be added later. In each iteration, we perform descriptor augmentation (self/cross) and pose estimation, so it is more like how many steps needed to augment the descriptors so as to find good matches. More iterations are used for tough cases and fewer for easy ones.

AbyssGaze commented 1 year ago

Thank you for your reply. I have tried to add OANet directly to the matching for pose estimation before, but the performance slightly decreased. I'm looking forward to your pose estimation code. Thank you very much.

July0928 commented 10 months ago

Hi, i try the pose supervision on the superglue by learnable coefficient, but the result is not good. I want to confirm if the loss function formed between the generated R、t and groundtruth is through L2Loss? Would you release the code for constructing the loss function section, if possible?