introlab / rtabmap_ros

RTAB-Map's ROS package.
http://wiki.ros.org/rtabmap_ros
BSD 3-Clause "New" or "Revised" License
962 stars 558 forks source link

Warn: Did not receive data since 5 seconds! #729

Open UdayRockzz opened 2 years ago

UdayRockzz commented 2 years ago

Hello Everyone,

I am working on pepper robot with Rtabmap. pepper robot has an xtion 3D camera and two RGB cameras, but I am taking data from only one camera. I have written the code as below.

` ` when I run the code I am getting warning/error as below. ![rtabmap eroor](https://user-images.githubusercontent.com/39263163/157246942-ebbbcf63-7b01-4856-8bb2-b508e0791bff.png) I have followed issue 189 but didn't succeed for me. Could anyone tell me where I am doing wrong in this?
awesomebytes commented 2 years ago

Hello @UdayRockzz

I'd start by checking things like:

rosnode info /rtabmap
# check what topics is rtabmap subscribing to

If the topics you expect to have are there (e.g. rgb and depth camera), check that they have a camera_info topic associated to it. Without it, I think it won't work (or so I recall).

I do not know where the source of your ROS images is (e.g. running your robot? running from a bridge in your computer?), but if it is in the robot, you may need to synchronize the clock of your system and the robot's system to avoid timestamp issues.

I also would recommend you to start with a rosbag with the topics you need from the robot, and then try to run rtabmap with that rosbag until you get something working.

Additionally, having a rosbag, you can post it here (or probably in ROS answers, which I'm pretty sure would be a better place to post this question) so people can help you better. Without data, it's hard to help.

Good luck!

UdayRockzz commented 2 years ago

Thanks for the reply @awesomebytes. Iam Using nao python based SDK to connect bridge between ros and pepper robot. and then these are the topics I have used. rtabmap topics it was there in the code which I have sent to you in email. but I dont know how those are missed here. and I will start working with rosbags.

awesomebytes commented 2 years ago

Showing the launchfile is not the same than checking what the node is subscribed to

UdayRockzz commented 2 years ago

well, I got it. this is rqt_graph rosgraph-1 and below are the topics list.

/clicked_point /cmd_vel /diagnostics /initialpose /joint_angles /joint_states /map /move_base_simple/goal /pepper_robot/audio /pepper_robot/bumper /pepper_robot/camera/bottom/camera_info /pepper_robot/camera/bottom/image_raw /pepper_robot/camera/bottom/image_raw/compressed /pepper_robot/camera/bottom/image_raw/compressed/parameter_descriptions /pepper_robot/camera/bottom/image_raw/compressed/parameter_updates /pepper_robot/camera/bottom/image_raw/theora /pepper_robot/camera/bottom/image_raw/theora/parameter_descriptions /pepper_robot/camera/bottom/image_raw/theora/parameter_updates /pepper_robot/camera/bottom/image_rect_color /pepper_robot/camera/bottom/image_rect_color/compressed /pepper_robot/camera/bottom/image_rect_color/compressed/parameter_descriptions /pepper_robot/camera/bottom/image_rect_color/compressed/parameter_updates /pepper_robot/camera/bottom/image_rect_color/compressedDepth /pepper_robot/camera/bottom/image_rect_color/compressedDepth/parameter_descriptions /pepper_robot/camera/bottom/image_rect_color/compressedDepth/parameter_updates /pepper_robot/camera/bottom/image_rect_color/theora /pepper_robot/camera/bottom/image_rect_color/theora/parameter_descriptions /pepper_robot/camera/bottom/image_rect_color/theora/parameter_updates /pepper_robot/camera/bottom_rectify_color/parameter_descriptions /pepper_robot/camera/bottom_rectify_color/parameter_updates /pepper_robot/camera/depth/camera_info /pepper_robot/camera/depth/image /pepper_robot/camera/depth/image/compressed /pepper_robot/camera/depth/image/compressed/parameter_descriptions /pepper_robot/camera/depth/image/compressed/parameter_updates /pepper_robot/camera/depth/image/compressedDepth /pepper_robot/camera/depth/image/compressedDepth/parameter_descriptions /pepper_robot/camera/depth/image/compressedDepth/parameter_updates /pepper_robot/camera/depth/image/theora /pepper_robot/camera/depth/image/theora/parameter_descriptions /pepper_robot/camera/depth/image/theora/parameter_updates /pepper_robot/camera/depth/image_raw /pepper_robot/camera/depth/image_raw/compressed /pepper_robot/camera/depth/image_raw/compressed/parameter_descriptions /pepper_robot/camera/depth/image_raw/compressed/parameter_updates /pepper_robot/camera/depth/image_raw/compressedDepth /pepper_robot/camera/depth/image_raw/compressedDepth/parameter_descriptions /pepper_robot/camera/depth/image_raw/compressedDepth/parameter_updates /pepper_robot/camera/depth/image_raw/theora /pepper_robot/camera/depth/image_raw/theora/parameter_descriptions /pepper_robot/camera/depth/image_raw/theora/parameter_updates /pepper_robot/camera/depth/image_rect /pepper_robot/camera/depth/image_rect/compressed /pepper_robot/camera/depth/image_rect/compressed/parameter_descriptions /pepper_robot/camera/depth/image_rect/compressed/parameter_updates /pepper_robot/camera/depth/image_rect/compressedDepth /pepper_robot/camera/depth/image_rect/compressedDepth/parameter_descriptions /pepper_robot/camera/depth/image_rect/compressedDepth/parameter_updates /pepper_robot/camera/depth/image_rect/theora /pepper_robot/camera/depth/image_rect/theora/parameter_descriptions /pepper_robot/camera/depth/image_rect/theora/parameter_updates /pepper_robot/camera/depth/image_rect_raw /pepper_robot/camera/depth/image_rect_raw/compressed /pepper_robot/camera/depth/image_rect_raw/compressed/parameter_descriptions /pepper_robot/camera/depth/image_rect_raw/compressed/parameter_updates /pepper_robot/camera/depth/image_rect_raw/compressedDepth /pepper_robot/camera/depth/image_rect_raw/compressedDepth/parameter_descriptions /pepper_robot/camera/depth/image_rect_raw/compressedDepth/parameter_updates /pepper_robot/camera/depth/image_rect_raw/theora /pepper_robot/camera/depth/image_rect_raw/theora/parameter_descriptions /pepper_robot/camera/depth/image_rect_raw/theora/parameter_updates /pepper_robot/camera/depth_rectify_depth/parameter_descriptions /pepper_robot/camera/depth_rectify_depth/parameter_updates /pepper_robot/camera/depth_registered/camera_info /pepper_robot/camera/depth_registered/hw_registered/image_rect /pepper_robot/camera/depth_registered/hw_registered/image_rect/compressed /pepper_robot/camera/depth_registered/hw_registered/image_rect/compressed/parameter_descriptions /pepper_robot/camera/depth_registered/hw_registered/image_rect/compressed/parameter_updates /pepper_robot/camera/depth_registered/hw_registered/image_rect/compressedDepth /pepper_robot/camera/depth_registered/hw_registered/image_rect/compressedDepth/parameter_descriptions /pepper_robot/camera/depth_registered/hw_registered/image_rect/compressedDepth/parameter_updates /pepper_robot/camera/depth_registered/hw_registered/image_rect/theora /pepper_robot/camera/depth_registered/hw_registered/image_rect/theora/parameter_descriptions /pepper_robot/camera/depth_registered/hw_registered/image_rect/theora/parameter_updates /pepper_robot/camera/depth_registered/hw_registered/image_rect_raw /pepper_robot/camera/depth_registered/hw_registered/image_rect_raw/compressed /pepper_robot/camera/depth_registered/hw_registered/image_rect_raw/compressed/parameter_descriptions /pepper_robot/camera/depth_registered/hw_registered/image_rect_raw/compressed/parameter_updates /pepper_robot/camera/depth_registered/hw_registered/image_rect_raw/compressedDepth /pepper_robot/camera/depth_registered/hw_registered/image_rect_raw/compressedDepth/parameter_descriptions /pepper_robot/camera/depth_registered/hw_registered/image_rect_raw/compressedDepth/parameter_updates /pepper_robot/camera/depth_registered/hw_registered/image_rect_raw/theora /pepper_robot/camera/depth_registered/hw_registered/image_rect_raw/theora/parameter_descriptions /pepper_robot/camera/depth_registered/hw_registered/image_rect_raw/theora/parameter_updates /pepper_robot/camera/depth_registered/image /pepper_robot/camera/depth_registered/image/compressed /pepper_robot/camera/depth_registered/image/compressed/parameter_descriptions /pepper_robot/camera/depth_registered/image/compressed/parameter_updates /pepper_robot/camera/depth_registered/image/compressedDepth /pepper_robot/camera/depth_registered/image/compressedDepth/parameter_descriptions /pepper_robot/camera/depth_registered/image/compressedDepth/parameter_updates /pepper_robot/camera/depth_registered/image/theora /pepper_robot/camera/depth_registered/image/theora/parameter_descriptions /pepper_robot/camera/depth_registered/image/theora/parameter_updates /pepper_robot/camera/depth_registered/image_raw /pepper_robot/camera/depth_registered/points /pepper_robot/camera/depth_registered/sw_registered/camera_info /pepper_robot/camera/depth_registered/sw_registered/image_rect /pepper_robot/camera/depth_registered/sw_registered/image_rect/compressed /pepper_robot/camera/depth_registered/sw_registered/image_rect/compressed/parameter_descriptions /pepper_robot/camera/depth_registered/sw_registered/image_rect/compressed/parameter_updates /pepper_robot/camera/depth_registered/sw_registered/image_rect/compressedDepth /pepper_robot/camera/depth_registered/sw_registered/image_rect/compressedDepth/parameter_descriptions /pepper_robot/camera/depth_registered/sw_registered/image_rect/compressedDepth/parameter_updates /pepper_robot/camera/depth_registered/sw_registered/image_rect/theora /pepper_robot/camera/depth_registered/sw_registered/image_rect/theora/parameter_descriptions /pepper_robot/camera/depth_registered/sw_registered/image_rect/theora/parameter_updates /pepper_robot/camera/depth_registered/sw_registered/image_rect_raw /pepper_robot/camera/depth_registered/sw_registered/image_rect_raw/compressed /pepper_robot/camera/depth_registered/sw_registered/image_rect_raw/compressed/parameter_descriptions /pepper_robot/camera/depth_registered/sw_registered/image_rect_raw/compressed/parameter_updates /pepper_robot/camera/depth_registered/sw_registered/image_rect_raw/compressedDepth /pepper_robot/camera/depth_registered/sw_registered/image_rect_raw/compressedDepth/parameter_descriptions /pepper_robot/camera/depth_registered/sw_registered/image_rect_raw/compressedDepth/parameter_updates /pepper_robot/camera/depth_registered/sw_registered/image_rect_raw/theora /pepper_robot/camera/depth_registered/sw_registered/image_rect_raw/theora/parameter_descriptions /pepper_robot/camera/depth_registered/sw_registered/image_rect_raw/theora/parameter_updates /pepper_robot/camera/depth_registered_rectify_depth/parameter_descriptions /pepper_robot/camera/depth_registered_rectify_depth/parameter_updates /pepper_robot/camera/front/camera_info /pepper_robot/camera/front/image_raw /pepper_robot/camera/front/image_raw/compressed /pepper_robot/camera/front/image_raw/compressed/parameter_descriptions /pepper_robot/camera/front/image_raw/compressed/parameter_updates /pepper_robot/camera/front/image_raw/theora /pepper_robot/camera/front/image_raw/theora/parameter_descriptions /pepper_robot/camera/front/image_raw/theora/parameter_updates /pepper_robot/camera/front/image_rect_color /pepper_robot/camera/front/image_rect_color/compressed /pepper_robot/camera/front/image_rect_color/compressed/parameter_descriptions /pepper_robot/camera/front/image_rect_color/compressed/parameter_updates /pepper_robot/camera/front/image_rect_color/compressedDepth /pepper_robot/camera/front/image_rect_color/compressedDepth/parameter_descriptions /pepper_robot/camera/front/image_rect_color/compressedDepth/parameter_updates /pepper_robot/camera/front/image_rect_color/theora /pepper_robot/camera/front/image_rect_color/theora/parameter_descriptions /pepper_robot/camera/front/image_rect_color/theora/parameter_updates /pepper_robot/camera/front_rectify_color/parameter_descriptions /pepper_robot/camera/front_rectify_color/parameter_updates /pepper_robot/camera/ir/image_rect_ir /pepper_robot/camera/ir/image_rect_ir/compressed /pepper_robot/camera/ir/image_rect_ir/compressed/parameter_descriptions /pepper_robot/camera/ir/image_rect_ir/compressed/parameter_updates /pepper_robot/camera/ir/image_rect_ir/compressedDepth /pepper_robot/camera/ir/image_rect_ir/compressedDepth/parameter_descriptions /pepper_robot/camera/ir/image_rect_ir/compressedDepth/parameter_updates /pepper_robot/camera/ir/image_rect_ir/theora /pepper_robot/camera/ir/image_rect_ir/theora/parameter_descriptions /pepper_robot/camera/ir/image_rect_ir/theora/parameter_updates /pepper_robot/camera/ir_rectify_ir/parameter_descriptions /pepper_robot/camera/ir_rectify_ir/parameter_updates /pepper_robot/camera/stereo/camera_info /pepper_robot/camera/stereo/image_raw /pepper_robot/camera/stereo/image_raw/compressed /pepper_robot/camera/stereo/image_raw/compressed/parameter_descriptions /pepper_robot/camera/stereo/image_raw/compressed/parameter_updates /pepper_robot/camera/stereo/image_raw/theora /pepper_robot/camera/stereo/image_raw/theora/parameter_descriptions /pepper_robot/camera/stereo/image_raw/theora/parameter_updates /pepper_robot/hand_touch /pepper_robot/head_touch /pepper_robot/imu/base /pepper_robot/imu/torso /pepper_robot/info /pepper_robot/laser /pepper_robot/odom /pepper_robot/sonar/back /pepper_robot/sonar/front /rosout /rosout_agg /rtabmap/cloud_ground /rtabmap/cloud_map /rtabmap/cloud_obstacles /rtabmap/global_path /rtabmap/global_path_nodes /rtabmap/global_pose /rtabmap/goal /rtabmap/goal_node /rtabmap/goal_out /rtabmap/goal_reached /rtabmap/gps/fix /rtabmap/grid_map /rtabmap/grid_map_updates /rtabmap/grid_prob_map /rtabmap/imu /rtabmap/info /rtabmap/initialpose /rtabmap/labels /rtabmap/landmarks /rtabmap/local_grid_empty /rtabmap/local_grid_ground /rtabmap/local_grid_obstacle /rtabmap/local_path /rtabmap/local_path_nodes /rtabmap/localization_pose /rtabmap/mapData /rtabmap/mapGraph /rtabmap/mapPath /rtabmap/octomap_binary /rtabmap/octomap_empty_space /rtabmap/octomap_full /rtabmap/octomap_global_frontier_space /rtabmap/octomap_grid /rtabmap/octomap_ground /rtabmap/octomap_obstacles /rtabmap/octomap_occupied_space /rtabmap/odom /rtabmap/proj_map /rtabmap/rgb/camera_info /rtabmap/rgb/image /rtabmap/rgbd_image /rtabmap/rgbd_image/compressed /rtabmap/scan_map /rtabmap/user_data_async /speech /statistics /tf /tf_static

I checked with rosbag for all the topics. here are the recorded messages

rosbag1 rosbag2 rosbag3

also, Here are the results when I run rostopic hz for both front camera and depth topics. rostopic hz and finally. rviz image rviz

awesomebytes commented 2 years ago

You still haven't shared the rosnode info command.

UdayRockzz commented 2 years ago

These are the list of nodes after launching the launch file,. rosnode_list_rtabmap.

so I have checked nodes with /rtabmap/rtabmap. and here is the list for that. rtabmap_rtabmap rtabmap_rtabmap3 rtabmap4

and here is the node info for /rtabmap/rgbd_sync rtabmap_rgbd_sync

awesomebytes commented 2 years ago

@UdayRockzz you can see that rtabmap is not subscribed to any existing image topic. You'll need to remap that correctly (using or not using rgbd sync, i don't think you need it, but up to you). Search in the ROS wiki how to remap topics on launchfiles. Also, you seem to want to use the front (top) camera but forwarding the bottom camera camera_info, that also looks wrong to me.

If you try to follow the errors and carefully check the input and outputs of the nodes you should be able to make it work. You can also check the source code of rtabmap if you still don't know what's going on, a good starting point is to search for the prints of errors/warnings you are seeing.

This is probably your first time using ROS. I would recommend you to take a look again at the ROS tutorials, try to use some tutorial with a simulated robot, and maybe borrow a friend to walk you through how to debug some ROS node.

Good luck! I hope you make good progress soon!

UdayRockzz commented 2 years ago

Thanks alot for your inputs @awesomebytes. I can slove this issue with correct remaps. And I am testing with bottom camera, so I used bottom camera at that time. and I have another question. Did you use laser sensor for generating map with rtabmap? if so, have you faced any similar kind of issues? and the laser scan works fine when I use with slam_gmapping, but not working with rtabmap.

awesomebytes commented 2 years ago

I did not use laser scans, I used just rgb + depth/pointcloud.

matlabbe commented 2 years ago

For RGB-D + Lidar, see http://wiki.ros.org/rtabmap_ros/Tutorials/SetupOnYourRobot#Kinect_.2B-_Odometry_.2B-_2D_laser

hariharan382 commented 2 years ago

I am having perfect input connection,I could see the echo but it throws me error ,time difference between RGB and depth less than 0.01 ,which I have no idea about it ,since rgbdsync will combine and publish at constant rate ,my configuration is d435+laser+odom

matlabbe commented 1 year ago

it throws me error

What error?