Rotation steerers for LoFTR

georg-bn / rotation-steerers

A steerer for D-dimensional keypoint descriptions is a DxD matrix that transforms the descriptions as if they were computed from a rotated image.

MIT License

73 stars 8 forks source link

Rotation steerers for LoFTR #10

Open tangconghui2008 opened 1 week ago

tangconghui2008 commented 1 week ago

Thank you for sharing your great work. Inspired by "Acase for using rotation invariant features in state of the art feature matchers", I am attempting to integrate Steerers with LoFTR by using Steerers to rotate the descriptors before the coarse matching stage of LoFTR. However, I have not been able to generate any matches. May I ask if there are any precautions to consider when combining this work with LoFTR?

georg-bn commented 3 days ago

That sounds like an interesting idea. Are you optimizing a steerer for a pretrained loftr-model, or optimizing everything from scratch?