ubc-vision / image-matching-benchmark

Public release of the Image Matching Benchmark: https://image-matching-challenge.github.io
https://image-matching-challenge.github.io
Apache License 2.0
527 stars 93 forks source link

How to generate "new-vis-pairs/keys-th-0.1.npy" #15

Closed sailor-z closed 4 years ago

sailor-z commented 4 years ago

Hi,

Thanks for releasing the benchmark. I'd like to pair images in training and validation sets, but I have a issue about the "new-vis-pairs/keys-th-{}.npy". I've used two different methods to generate image pairs. The first one is loading "imw2020-valid/reichstag/set_100/new-vis-pairs/keys-th-{}.npy", and the second one is as follows image. I got two different results. For example in "sacre_coeur", the first one generates 3373 image pairs with the threshold 0.2, but the second one generates 442645 pairs with the same threshold. I'm confused by the inconsistency. Which one should I use?

etrulls commented 4 years ago

You're mixing up the training and validation data.

For the validation scenes, we provide a pre-formatted set which, similarly to the test data, is subsampled to 100 images per scene. So if you set the visibility threshold to 0 you will get 100 * 99 / 2 = 4950 pairs. You should not really look at this, it's just used to compile statistics at different co-visibility thresholds (automatically).

You can also use this for training if you want, so we provide the full set, which gives you the largest set of pairs. The download page has separate links for validation and training, for the same scenes.