search

goutamgmb / NTIRE21_BURSTSR

85 stars 15 forks source link

Question about pwcnet and warp #26

Closed Nianzhen-GU closed 2 years ago

Nianzhen-GU commented 3 years ago

Hello! I use the PWC-Net code in your GitHub to calculate the optical from the first image to the second image and warped the second back to the first using the optical flow. However, the warped image is blurred. I want to know whether it is difficult to warp two images with large difference or it is my fault that my optical flow is wrong. chair2 chair5 flo2-5 warped

goutamgmb commented 3 years ago

Hi,

Its hard to say looking at the results whether there is any bug in the optical flow computation itself. But the two images have substantial view point changes. In general the optical flow networks are trained to handle smaller viewpoint changes, and thus cannot be expected to accurately handle large view point changes present in your examples. You can try using geometric correspondence networks (e.g. https://github.com/PruneTruong/DenseMatching) which are specifically trained to handle these large motions.

Nianzhen-GU commented 2 years ago

Thanks alot!