Nova-UTD / navigator

Navigator, our self-driving vehicle software stack
https://nova-utd.github.io/navigator
Other
32 stars 10 forks source link

Camera-depth fusion - image projection on pcl #370

Open danielv012 opened 9 months ago

jruths commented 9 months ago

There is an unused node (image_projection_node) that works toward this... maybe useful?

MtGuerenS commented 7 months ago

I found this online, maybe its helpful: https://www.open3d.org/docs/release/tutorial/geometry/rgbd_image.html

jruths commented 1 week ago

Our 360-degree coverage provided by the new ZED cameras could help with this. The ZED provides both image and depth maps that are already aligned, so presumably projecting the image onto that depth map should be very straightforward. Then aligning the depth map and lidar scans should then assist projecting the image onto the lidar depth.