cvg / LightGlue

LightGlue: Local Feature Matching at Light Speed (ICCV 2023)
Apache License 2.0
3.15k stars 291 forks source link

The matching effect of similar images is too different #102

Open NPUXJH opened 5 months ago

NPUXJH commented 5 months ago

Hello! I tried using LightGlue and encountered this problem: the matching effect of two similar scene images A and B and another image C is very different. For example, the matching effect of image A and image C is very good, but the matching effect of image B is very different. The match with image C is poor. Among them, the angle of view and scale of image A and image B are very similar. What is the reason for this?

Phil26AT commented 5 months ago

Hello @NPUXJH, i cannot answer this question without more information. Could you upload the images A, B, C here or send them to me privately?

NPUXJH commented 5 months ago

Hello @NPUXJH, i cannot answer this question without more information. Could you upload the images A, B, C here or send them to me privately?

OK, I have sent the relevant pictures and results to the email address of your homepage, and I look forward to further replies. Thank you!

Phil26AT commented 5 months ago

Hi @NPUXJH

Indeed this is a weird failure case, I tested your example with different numbers of keypoints, and it seems the confidences get confused here, but only for 2K keypoints:

1K keypoints: B_C_1K 2K keypoints: B_C_2K 4K keypoints: B_C_4K

Disabling early stopping results in: B_C_2K_full

Going forward, I suggest to increase the early stopping confidence.

noahzn commented 4 months ago

@Phil26AT I have met the same problem. Increasing the early stopping confidence doesn't help.

erdemkkok commented 2 months ago

@Phil26AT hi, have you trained your data before this matching results ? if you trained your data before this results how can i train LightGlue weigths according to my data ? and How can i fine-tune that ?