OML-Team / open-metric-learning

Metric learning and retrieval pipelines, models and zoo.
https://open-metric-learning.readthedocs.io/en/latest/index.html
Apache License 2.0
895 stars 61 forks source link

Implement geometric verification | OmniGlue as a retrieval post-processor #590

Open AlekseySh opened 5 months ago

AlekseySh commented 5 months ago

Geometric verification is a pairwise method for comparison content on two images based on classical descriptors. It's especially good in landmark detection task and was widely used on Kaggle in the relevant competitions. You can easily find more details in the internet.

From OML's point of view, we can implement this verifier and pass it to the existing PairwiseReranker object. See similar code for Siamese model which compares two images on pixel level. (You only need to check and adapt the prediction code, because geometric verifier is not a trainable NN, it's rather an algorithm).

image

AlekseySh commented 5 months ago

Also omniglue model looks interesting:

Screenshot 2024-06-12 at 21 11 40