cvg / GlueStick

Joint Deep Matcher for Points and Lines 🖼️💥🖼️ (ICCV 2023)
https://iago-suarez.com/gluestick
MIT License
551 stars 43 forks source link

A question about dual-softmax #14

Closed Graysonggg closed 1 year ago

Graysonggg commented 1 year ago

Hello, great job!

I noticed that you used sinkhorn algorithm in the matching phase of superglue, while dual-softmax is used in this paper. May I ask why they are similar in effect? Or is there any theoretical support?

Looking forward to your reply very much!

rpautrat commented 1 year ago

Hi, yes SuperGlue was trained and released with the Sinkhorn algorithm. However, since then, several methods (such as LoFTR) opted for the double softmax instead, as it was faster and at least as good as Sinkhorn.

We don't have a theoretical proof for that, but we also observed a similar behavior for GlueStick, so we chose the double softmax.

Graysonggg commented 1 year ago

Appreciate for so quick reply.