once-3dlanes / once_3dlanes_benchmark

103 stars 12 forks source link

Question about depth completion #12

Open canteen-man opened 2 years ago

canteen-man commented 2 years ago

I follow the paper describes, find the depth completion algorithm in reference list named "In Defense of Classical Image Processing" and the code repo. And I try to complete the depth map by using that code. I found may be the 3D coordinate provide in the ONCE-3DLanes is not dense enough for that depth completion code. So I use the interplotation code in utils from ONCE3DLanes repo to interploate the 3D coordinate. Then project the 3D coordinate to 2D depth map with 16 bit value.(3D depth* 256 and round in uint16) The input depth map after interplote like this (set every points in 65535 for show, the truth input depth map is the truth depth value) D5016C84-6EC8-4E17-8733-EBDBB1F4FFA9

And I choose the "Fast" mode in that depth completion code. The output like this. I think the output depth map is not correct. A66C391D-7C37-41BA-99D5-90E90CAF1C88

And when I modify the density of interpolation, the more dense depth map looks like below 3A811ADA-9778-4F9D-9EF7-ADF72B0907B2

The depth complete output is like this. F3BB0ED1-BA4F-4A29-8472-B9BBBA39B236

Do I need to modify the depth completion code or any step is wrong.

sumenpuyuan commented 2 years ago

hello I found that the kitti data set is also 3D depth* 256 and round in uint16, what is the significance of this data preprocessing

sumenpuyuan commented 2 years ago

Does the completion fail if blocked by a vehicle

Ivanyan0516 commented 2 years ago

No depth completion when a lane point is blocked by a vehicle since we do not have the real z value.