search

lmb-freiburg / flownet2

FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks
https://lmb.informatik.uni-freiburg.de/Publications/2017/IMKDB17/
Other
1k stars 318 forks source link

About the usefulness of warping #6

Closed ptriantd closed 7 years ago

ptriantd commented 7 years ago

First of all, great work! I was wondering why warping is useful in this case. More specifically, what troubles me are the artifacts of the warping operation in the case of occlusions. Is there any guarantee that the warped image 2 we would get by using the ground truth flow is "closer" to image 1 than the warped image 2 we get by using the estimated flow in this case?

eddy-ilg commented 7 years ago

We fill occluded areas with 0s (black). In general the warping is useful to make a step towards the solution (or assessing the quality of the current solution). Compare e.g. the non-liner iteration in LDOF.

I do not see a case when warping with ground truth could be worse than warping with the prediction.