cvlab-epfl / LIFT

Code release for the ECCV 2016 paper
485 stars 168 forks source link

Some problems about patch size #46

Closed zzxp closed 4 years ago

zzxp commented 4 years ago

Hello! I don't understand the patch size setting in your paper "LIFT: Learned Invariant Feature Transform".Why the 24σ ×24σ support region correspond to 128X128 ? And where the sift descriptor say it support region size is12σ ? Looking forward to your reply!

kmyi commented 4 years ago

I am not sure I understand your question properly. For SIFT, you should look at the SIFT paper, or maybe even the SIFT implementation you are using. Descriptors are typically extracted by cropping out the proper support region, and then processing the cropped patch. This depends on the algorithmic design, and is typically parameterized by the sigma. Again, I would suggest studying the SIFT algorithm here.

zzxp commented 4 years ago

I have seen the SIFT paper,and descriptors computed from a 16x16 sample array,it does not related to 12σ? image

kmyi commented 4 years ago

that 16x16 sample array is drawn on a 12sigma region on the local feature. E.g. https://www.vlfeat.org/overview/sift.html

zzxp commented 4 years ago

Sorry for disturbing you again.In SIFT,support region seems to be 3X1.5Xσ, where is the"12"?

etrulls commented 4 years ago

The size of the support region is 12 times the "scale" provided by OpenCV. It's a simple conversion factor.

zzxp commented 4 years ago

How is the correspondence between patch size and σ calculated in the paper? For example, 24σX24σ corresponds to 128X128, and 12σX12σ corresponds to 64x64.

etrulls commented 4 years ago

I am not sure what you're asking. The patch is 12σ where σ is the scale reported by OpenCV. For training, we extract a larger patch (24σ) from which we detect a keypoint and then crop a smaller patch (again, 12σ) which is what we use to extract the descriptor.

That's off the top of my head because that was 5 years ago.

zzxp commented 4 years ago

I know what you mean. image I just want to know how this standardization process is achieved.

etrulls commented 4 years ago

That's what I just explained in my previous message:

6aZ0BS4i1Rr

zzxp commented 4 years ago

Well, thank you