NVlabs / Deep_Object_Pose

Deep Object Pose Estimation (DOPE) – ROS inference (CoRL 2018)
Other
1.02k stars 286 forks source link

Not able to visualize 3D cuboid in rviz #273

Open monajalal opened 1 year ago

monajalal commented 1 year ago

I tried both of these and none works for publishing the 3D cuboid when I select the "Image" in "Add --> Display Name" however the actual image and the belief maps are published. Can you please guide me how to see the 3D cuboid around the meat can? In config_pose.xml I have commented soup can and set to meat.

~/catkin_ws/src/camera_info_manager_py# rosrun tf2_ros static_transform_publisher 0 0 0 0.7071 0 0 -0.7071 world

[ INFO] [1669839875.757842505]: Spinning until killed publishing -0.7071 to world ~/catkin_ws/src/camera_info_manager_pyrosrun tf static_transform_publisher 0 0 0 0 0 0 1 map dope_webcam 5

Screenshot from 2022-11-30 16-12-26

Screenshot from 2022-11-30 16-11-39

Here's the config_pose.xml change:

    # "cracker":"package://dope/weights/cracker_60.pth",
    # "gelatin":"package://dope/weights/gelatin_60.pth",
     "meat":"package://dope/weights/meat_20.pth",
    # "mustard":"package://dope/weights/mustard_60.pth",
    #"soup":"package://dope/weights/soup_60.pth",
    #"sugar":"package://dope/weights/sugar_60.pth",
    # "bleach":"package://dope/weights/bleach_28_dr.pth"
TontonTremblay commented 1 year ago

Can you check by topics? I am not sure what is going on here. I am not sure the detection is working correctly. I see some heatmap, but no detection on the second image, e.g., bounding box.

monajalal commented 1 year ago

I have tested almost everything in topic and nothing shows the pose. Could you please show which one do you select? I haven't changed your code and I though it would work for the items and it seems people are getting it to work without change of code.

When I first open rviz I get a warning for "global status" Screenshot from 2022-12-01 08-35-04

Then I use the command at the end of your README.md for fixed frame but it throws an error:

~/catkin_ws# rosrun tf2_ros static_transform_publisher 0 0 0 0.7071 0 0 -0.7071 world Screenshot from 2022-12-01 08-37-52

Then I changed it to the following command and the error is gone however still no pose shown. ~/catkin_ws# rosrun tf static_transform_publisher 0 0 0 0 0 0 1 map dope_webcam 5 Screenshot from 2022-12-01 08-39-17

Screenshot from 2022-12-01 08-40-11

Here are what pose_meat and PoseArray show: Screenshot from 2022-12-01 08-57-06

For the image that nothing shows ('No Image') here's the side panel. This is the image selected by 'Display Name'. The image that has a SPAM is from topic --> webcam--> image Screenshot from 2022-12-01 09-01-14

Also, the following shows pose_meat doesn't have any new messages.

~# rosstopic list
bash: rosstopic: command not found
# rostopic list
/clicked_point
/dope/belief_meat
/dope/camera_info
/dope/detected_objects
/dope/dimension_meat
/dope/markers
/dope/pose_meat
/dope/rgb_points
/dope/webcam/camera_info
/dope/webcam/image_raw
/initialpose
/move_base_simple/goal
/rosout
/rosout_agg
/tf
/tf_static
# rostopic hz /dope/pose_meat
subscribed to [/dope/pose_meat]
no new messages
no new messages
no new messages
no new messages
no new messages
no new messages
no new messages
no new messages
no new messages
no new messages

My rosnodes are:

# rosnode list
/dope
/dope_webcam
/rosout
/rviz_1669901658066642276
/static_transform_publisher_1669901906574858598

also:

# rostopic info /dope/pose_meat
Type: geometry_msgs/PoseStamped

Publishers: 
 * /dope (http://MYCOMPUTER:40797/)

Subscribers: 
 * /rviz_1669901658066642276 (http://MYCOMPUTER:46235/)