introlab / rtabmap_ros

RTAB-Map's ROS package.
http://wiki.ros.org/rtabmap_ros
BSD 3-Clause "New" or "Revised" License
1.01k stars 559 forks source link

RTABMAP_SYNC_MULTI_RGBD using multiple RGBD cameras #1078

Closed takahiko-hasegawa-hdjp closed 12 months ago

takahiko-hasegawa-hdjp commented 12 months ago

Hi there,

Im trying to use multiple RGBD cameras for visual localization and did some reading on the usage of multiple cameras (using rgbd_sync nodelet) on ros2.

First question is can I use multiplecamera feature to improve mapping and localization? (I have my own wheel encoder which publishes odom and base_link, so not using visual odometry)

I have two cameras in my robot which are located in the front of the camera and the second one located in the rear of the robot (180degree rotated from front camera).

Does the multicamera capability also handle front and rear? or it needs to be front and right/left

thanks in advance

matlabbe commented 11 months ago

Yes, multiple cameras could increase your odometry accuracy, unless your wheel encoders have already a very low drift.

If you want to use multi cameras with rtabmap, it is strongly recommended to build rtabmap with OpenGV support.

You can place your cameras anywhere on the robot. You should make sure that the extrinsics/TF between cameras and base frame are accurate. Ideally having hardware synchronized cameras, though it can work satisfactory with 30 Hz approx sync between the cameras.