Open YumTaha opened 1 day ago
The realsense2_camera package was somewhat recently updated to namespace the camera output topics under the camera name. Please try setting the cloud_topic
launch arg to '/camera/camera/depth/color/points'
.
The reason you're not seeing the cropbox (or likely any other markers) is because those visualizations are typically only published on receiving a new pointcloud message. See the pointcloud pipeline source for more details.
Thanks, now I can see the CropBox. I've never had this but any idea why cpu utilization is 100% when I ran the perception command?
ras@pibot:~$ top
top - 11:46:51 up 11 min, 1 user, load average: 5.30, 3.86, 2.15
Tasks: 282 total, 4 running, 278 sleeping, 0 stopped, 0 zombie
%Cpu(s): 48.9 us, 4.5 sy, 0.0 ni, 43.8 id, 0.3 wa, 0.0 hi, 2.5 si, 0.0 st
MiB Mem : 15847.2 total, 9672.6 free, 2155.0 used, 4019.6 buff/cache
MiB Swap: 2048.0 total, 2048.0 free, 0.0 used. 11623.4 avail Mem
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
7580 iras 20 0 2552032 180024 117840 S 105.6 1.1 2:10.41 pointcloud_tune
7578 iras 20 0 673644 82888 46080 R 104.0 0.5 6:23.34 pointcloud_pipe
7576 iras 20 0 1382732 152256 52864 S 67.2 0.9 4:03.15 realsense2_came
7594 iras 20 0 3256688 244252 158772 R 63.3 1.5 3:44.95 rviz2
1212 iras 20 0 5863968 413892 279484 S 18.9 2.6 2:05.62 gnome-shell
3191 iras 20 0 1087112 116584 89456 S 15.8 0.7 4:07.25 Xwayland
7584 iras 20 0 1031772 170564 101104 S 11.3 1.1 0:43.52 picture_snapper
2163 iras 20 0 3567396 464068 284100 S 10.5 2.9 0:26.18 firefox
2689 iras 20 0 2541448 210868 116352 R 10.2 1.3 0:07.12 Isolated Web Co
7572 iras 20 0 1089304 27648 19840 S 9.0 0.2 0:35.05 xs_sdk
26 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/1:0H-events_highpri
27 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/2
28 root -51 0 0 0 0 S 0.0 0.0 0:00.00 idle_inject/2
29 root rt 0 0 0 0 S 0.0 0.0 0:00.16 migration/2
30 root 20 0 0 0 0 S 0.0 0.0 0:00.11 ksoftirqd/2
31 root 20 0 0 0 0 I 0.0 0.0 0:00.66 kworker/2:0-i915-unordered
32 root 0 -20 0 0 0 I 0.0 0.0 0:00.08 kworker/0:1-i915-unordered
111 root 0 -20 0 0 0 I 1.0 0.0 0:05.45 kworker/u17:0-uvcvideo
214 root -51 0 0 0 0 S 0.7 0.0 0:06.78 irq/51-ELAN0651:00
7985 root 0 -20 0 0 0 I 0.7 0.0 0:00.41 kworker/u17:2-uvcvideo
640 message+ 20 0 11028 6016 3968 S 0.3 0.0 0:01.10 dbus-daemon
2356 iras 20 0 2468040 134044 101076 S 0.3 0.8 0:02.52 Privileged Cont
7582 iras 20 0 920952 230144 45568 S 0.3 1.4 0:00.81 apriltag_ros_si
7586 iras 20 0 1883920 174248 115192 S 0.3 1.1 0:02.82 armtag_tuner_gu
8053 iras 20 0 22340 4224 3328 R 0.3 0.0 0:00.12 top
1 root 20 0 166824 11468 8140 S 0.0 0.1 0:01.25 systemd
The pointcloud pipeline is very resource intensive when running continuously (like during the tuning process). When actually deployed, the pipeline is run once when its service is called.
Is there a way to minimize it since I am trying to tune the object detection but the pointcloud tuner is barely responding and slow
You can try to reduce the fps (or resolution) of the camera's depth module using the rs_camera_depth_module_profile
launch arg (default 30).
What happened?
Initial setup after installing ROS 2 Humble and the Interbotix workspace. Installed the RealSense package using the following command:
sudo apt install ros-humble-realsense2-camera
When running perception, RViz did not display the camera (no camera)(mind you therealsense-viewer
works fine). It indicated an issue with the topic/camera/color/image_raw
. After executingros2 topic list
, I discovered that the correct topic was:/camera/camera/color/image_raw
.To verify this, I modified the RViz interface by changing the image topic to:
/camera/camera/color/image_raw
and the image displayed correctly. I then updated the launch configuration and Python files, changing the topics: From/camera/color/image_raw
to/camera/camera/color/image_raw
and from/camera/color/camera_info
to/camera/camera/color/camera_info
. This resolved the initial issue, but now I face another problem. Although the camera captures images of the AprilTag and recognizes its position in relation to the robot arm, the CropBox is not visible in RViz. The interface indicates that the status is OK, yet nothing is being published to the topic/pc_filter/markers/crop_box
.Robot Model
vx300
Operating System
Ubuntu 22.04
ROS Distro
ROS 2 Humble
Steps To Reproduce
No response
Relevant log output
Additional Info
No response