search

YvanYin / VNL_Monocular_Depth_Prediction

Monocular Depth Prediction
Other
463 stars 79 forks source link

how to get the surface normal image #34

Closed ITking666 closed 4 years ago

ITking666 commented 4 years ago

Dear YvanYin: I missed a problem when test your masterpiece,which is that i can't get surface normal image from depth image and RGB image ,would you please tell me how to get it.

YvanYin commented 4 years ago

Hi, I will try to find the code. You can read this: https://stackoverflow.com/questions/34644101/calculate-surface-normals-from-depth-image-using-neighboring-pixels-cross-produc It is very helpful for you to understand how to recover surface normal. However, you should recover (x, y, z) for each pixel before calculating its surface normal

ITking666 commented 4 years ago

Thank you so much for your kind reply. But I still want to konw how did you get the depth estimation results by Junjie Hu (Revisiting Single Image Depth Estimation: Toward Higher Resolution Maps With Accurate Object Boundaries) and convert these depth images to surface normal map .

YvanYin commented 4 years ago

Hi, can you send me an email, I can send you the code.

ITking666 commented 4 years ago

Thank you very much and my mails is 1474690467@qq.com

ITking666 commented 4 years ago

Thank you very much and my mails is 1474690467@qq.com

yiying66 commented 4 years ago

Hi, I have tried to understand the link @YvanYin gives, but failed. Could you please send me the code too. My email is 407055993@qq.com. Looking forward to your reply and thank you very much.

kwea123 commented 4 years ago

@YvanYin Hi, the link you provide gives a good insight but is not directly applicable here as it doesn't take into account the camera parameters. As you suggested, the correct way should be to backproject each pixel into 3d xyz then calculate the normals. However I struggle to find an efficient and concise implementation... I'm also surprised that I cannot find any resource on google as it seems to be a common problem. Anyway, can you provide the code in this repo? Thank you.

YvanYin commented 4 years ago

Hi all, I will post my code for recovering the surface normal from the point cloud.

YvanYin commented 4 years ago

Please check /tools/recover_surface_normal.py.

ITking666 commented 4 years ago

Thank you very much

------------------ 原始邮件 ------------------ 发件人: "YvanYin/VNL_Monocular_Depth_Prediction" <notifications@github.com>; 发送时间: 2020年7月31日(星期五) 上午9:34 收件人: "YvanYin/VNL_Monocular_Depth_Prediction"<VNL_Monocular_Depth_Prediction@noreply.github.com>; 抄送: "1474690467"<1474690467@qq.com>;"Author"<author@noreply.github.com>; 主题: Re: [YvanYin/VNL_Monocular_Depth_Prediction] how to get the surface normal image (#34)

Please check /tools/recover_surface_normal.py.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe.