search

mrharicot / monodepth

Unsupervised single image depth prediction with CNNs
Other
2.21k stars 628 forks source link

Question about paper #229

Open abeyang00 opened 5 years ago

abeyang00 commented 5 years ago

What is dense correspondence field exactly? There seems to be no explanation about this in the paper. And when i read your code, it seems like disparity is regarded as correspondence field??

Thank you in advance

macaodha commented 5 years ago

Yes. For each pixel we predict a single scalar value specifying the disparity (i.e. scaled inverse depth). The "ground truth" disparity would point to the corresponding pixel in the second stereo view.

zhongcl-thu commented 4 years ago

@macaodha Does the 'dl' mean the disparity of the right image in the equation(3)? Because in the paper, you indicate that the reconstructed right image(~Ir) can be obtained from left image(Il) and the disparity image(dr). For the disparity smoothness loss, you weight this cost with an edge-aware term using the image gradients. It means that the origin image should be correspondent with the disparity image in the Eq.3. But, according to the Eq.3, the 'Il ' isn't correspondent with the 'dl'. I would really appreciate it if you could answer my question. image image

macaodha commented 4 years ago

dl is aligned with the left image and dr with the right. We use backward mapping (B in the attached image) to reconstruct the right image from pixels in the left guided by the predicted right disparity.

image