NVIDIA-ISAAC-ROS / isaac_ros_depth_segmentation

NVIDIA-accelerated, deep learned depth segmentation and obstacle field ranging using Bi3D
Apache License 2.0
45 stars 8 forks source link

quasi stereo images #7

Closed benkelaci closed 1 year ago

benkelaci commented 1 year ago

Hi,

Do you think it work with images those are not from a stereo camera? E.g.: 2x images that was made from 5-10 meter away (but they are pointing to the same direction)

Thank you

gordongrigor commented 1 year ago

Unlikely.

Stereo perception functions require precise calibration for intrinsic and extrinsic parameters. These perception functions rely on Epipolar geometry with left and right camera on the same plane, within a tight mechanical tolerance so they are pointing the same direction.

DNN's such as BI3D used in proximity segmentation can be robust to some variation, however two camera's roughly in the right position and direction would lack the calibration and mechanical tolerance for this predictive function to work.