JUGGHM / PENet_ICRA2021

ICRA 2021 "Towards Precise and Efficient Image Guided Depth Completion"
MIT License
327 stars 46 forks source link

Is that possible to use 3 inputs to your model instead of 2 ? #26

Open Laihu08 opened 3 years ago

Laihu08 commented 3 years ago

Hi, I am wondering to use 3 inputs like as if now you are using 2 inputs like Sparse depth map and corresponding RGB, Is that possible to use one more input like Coarse dense depth map got from hand crafted methods with corresponding to sparse depth map ? please let me know if its possible, Thanks in advance .

JUGGHM commented 3 years ago

HI! Of course you could make an attempt. In our two-branch (actually hourglass-styled) backbone, the second (DD) branch could be regarded as a reprocessing procedure of the first (CD) branch prediction, which is actually a coarse predicted depth. Therefore, you could either feed the hand-crafted one into the second branch or even add a new third branch. And the third branch would function similarly as the second branch.

Laihu08 commented 3 years ago

Thank you so much, I will give a try as you suggested.

Laihu08 commented 3 years ago

Hi, @JUGGHM , sorry to ask you this question again, I want to back project the predicted depth map to point cloud coordinates, is that possible ? if so, can you give me code for back projection like input will be predicted depth map and output will be point cloud which will be denser in front view. Thank you.