IntelRealSense / realsense-ros

ROS Wrapper for Intel(R) RealSense(TM) Cameras
http://wiki.ros.org/RealSense
Apache License 2.0
2.53k stars 1.75k forks source link

No pointcloud and no color image when activating PCL #2485

Closed vivekmange56 closed 2 years ago

vivekmange56 commented 2 years ago

Hello

I am using Realsense D455, with Nano (Jetpack 4.6)

I am facing issues when testing PCL with the above device. I am using the rs_camera.launch file. When enabling PCL as true, There is NO PCL and NO Color Image and Drop in Depth images from 30 to 15-12hz

I have tested the above above files with below configurations

ROS output

... logging to /home/uvrobot/.ros/log/da6c2594-38d2-11ed-aa09-00044be67567/roslaunch-uvrobot-desktop-11154.log Checking log directory for disk usage. This may take a while. Press Ctrl-C to interrupt Done checking log file disk usage. Usage is <1GB.

started roslaunch server http://192.168.0.10:43049/

SUMMARY

PARAMETERS

NODES /camera/ realsense2_camera (nodelet/nodelet) realsense2_camera_manager (nodelet/nodelet)

auto-starting new master process[master]: started with pid [11164] ROS_MASTER_URI=http://192.168.0.10:11311

setting /run_id to da6c2594-38d2-11ed-aa09-00044be67567 process[rosout-1]: started with pid [11177] started core service [/rosout] process[camera/realsense2_camera_manager-2]: started with pid [11194] process[camera/realsense2_camera-3]: started with pid [11195] [ INFO] [1663671381.205168485]: Initializing nodelet with 4 worker threads. [ INFO] [1663671381.497208331]: RealSense ROS v2.3.0 [ INFO] [1663671381.497301046]: Built with LibRealSense v2.45.0 [ INFO] [1663671381.497372457]: Running with LibRealSense v2.45.0 [ INFO] [1663671381.555979212]:
[ INFO] [1663671381.638543100]: Device with serial number 151422253770 was found.

[ INFO] [1663671381.638759314]: Device with physical ID /sys/devices/70090000.xusb/usb2/2-1/2-1.1/2-1.1:1.0/video4linux/video0 was found. [ INFO] [1663671381.639027145]: Device with name Intel RealSense D455 was found. [ INFO] [1663671381.640388701]: Device with port number 2-1.1 was found. [ INFO] [1663671381.640542306]: Device USB type: 3.2

[ INFO] [1663671381.932563870]: JSON file is not provided [ INFO] [1663671381.932649292]: ROS Node Namespace: camera [ INFO] [1663671381.932737476]: Device Name: Intel RealSense D455 [ INFO] [1663671381.932816492]: Device Serial No: 151422253770 [ INFO] [1663671381.932919781]: Device physical port: /sys/devices/70090000.xusb/usb2/2-1/2-1.1/2-1.1:1.0/video4linux/video0 [ INFO] [1663671381.933000828]: Device FW version: 05.13.00.50 [ INFO] [1663671381.933079948]: Device Product ID: 0x0B5C [ INFO] [1663671381.933261159]: Enable PointCloud: On [ INFO] [1663671381.933340332]: Align Depth: Off [ INFO] [1663671381.933403149]: Sync Mode: On [ INFO] [1663671381.933572900]: Device Sensors: [ INFO] [1663671381.977119408]: Stereo Module was found. [ INFO] [1663671382.021415966]: RGB Camera was found. [ INFO] [1663671382.022728143]: Motion Module was found. [ INFO] [1663671382.022848308]: (Confidence, 0) sensor isn't supported by current device! -- Skipping... [ INFO] [1663671382.022943419]: Add Filter: pointcloud [ INFO] [1663671382.024344405]: num_filters: 1 [ INFO] [1663671382.024436703]: Setting Dynamic reconfig parameters. [ WARN] [1663671382.323709773]: Param '/camera/stereo_module/auto_exposure_limit' has value 0 that is not in range [1, 200000]. Removing this parameter from dynamic reconfigure options. [ WARN] [1663671382.328863579]: Param '/camera/stereo_module/auto_gain_limit' has value 0 that is not in range [16, 248]. Removing this parameter from dynamic reconfigure options. [ WARN] [1663671382.394532286]: Param '/camera/rgb_camera/power_line_frequency' has value 3 that is not in the enum { {50Hz: 1} {60Hz: 2} {Disabled: 0} }. Removing this parameter from dynamic reconfigure options. [ INFO] [1663671382.450775162]: Done Setting Dynamic reconfig parameters. [ INFO] [1663671382.452329180]: depth stream is enabled - width: 848, height: 480, fps: 30, Format: Z16 [ INFO] [1663671382.454025551]: color stream is enabled - width: 1280, height: 720, fps: 30, Format: RGB8

[ INFO] [1663671382.463925373]: Expected frequency for depth = 30.00000 [ INFO] [1663671382.576244865]: Expected frequency for color = 30.00000

[ INFO] [1663671382.673420512]: insert Depth to Stereo Module [ INFO] [1663671382.673576200]: insert Color to RGB Camera [ INFO] [1663671382.870025510]: SELECTED BASE:Depth, 0 [ INFO] [1663671382.916736038]: RealSense Node Is Up! [ WARN] [1663671382.952390255]: Frame metadata isn't available! (frame_timestamp_domain = RS2_TIMESTAMP_DOMAIN_SYSTEM_TIME) 20/09 16:26:22,950 WARNING [546823872896] (ds5-timestamp.cpp:69) UVC metadata payloads not available. Please refer to the installation chapter for details. 20/09 16:26:23,269 WARNING [546834710912] (ds5-timestamp.cpp:69) UVC metadata payloads not available. Please refer to the installation chapter for details. ^C[camera/realsense2_camera-3] killing on exit [camera/realsense2_camera_manager-2] killing on exit [rosout-1] killing on exit [master] killing on exit shutting down processing monitor... ... shutting down processing monitor complete

Jetson info

MartyG-RealSense commented 2 years ago

Hi @vivek2019 I note the warning UVC metadata payloads not available. Please refer to the installation chapter for details in your log. This would indicate that your librealsense SDK installation has not had its kernel patched.

May I ask which methods you used to install the librealsense SDK and the RealSense ROS wrapper on your Jetson Nano, please? For example, if your librealsense installation was built from source code then Jetson devices have their own dedicated L4T kernel patching script called patch-realsense-ubuntu-L4T.sh and so patching the kernel using the 'patch-realsense-ubuntu-lts.sh' script would not be suitable.

https://github.com/IntelRealSense/librealsense/blob/master/doc/installation_jetson.md

vivekmange56 commented 2 years ago

Hello @MartyG-RealSense I used the 4. Install with Debian Packages to install the SDK.

what i understood is that i have to execute the patch-realsense-ubuntu-L4T.sh file to patch the kernel and then the system might work as expected ?

MartyG-RealSense commented 2 years ago

If you installed from packages using the Jetson instructions then the patch should be included in the packages. This makes it unusual that the log reports that hardware metadata is not available.

After you installed from Jetson packages, which method did you use to install the ROS wrapper please?

vivekmange56 commented 2 years ago

I have just git clone the ROS wrapper

MartyG-RealSense commented 2 years ago

I note in your opening comment that you refer to testing with four different librealsense versions (2.45, 2.48, 2.50, 2.51). Did you remove all RealSense related packages each time before beginning a new installation so there were not multiple librealsense installations on the computer that could potentially conflict with each other? If the previous version was not cleared then all RealSense related packages can be uninstalled with the command below.

dpkg -l | grep "realsense" | cut -d " " -f 3 | xargs sudo dpkg --purge

Then a fresh Jetson package installation of librealsense can be performed after the uninstall has been completed.

Also, each time that the librealsense SDK version is updated, the ROS wrapper must be built again afterwards.


May I also ask how PCL is involved in your setup? For example, are you launching the ROS wrapper and then launching a PCL program separately?

vivekmange56 commented 2 years ago

Yes, I removed all the files before switching to the new sdk version. Also i updated the relasense-ros wrapper compatible version and build using catkin_make. To check the compatibility i used the release documents.

I am testing the PCL with the same rs_camera.launch file with updating the parameters below enable_pointcloud:=true filters:=pointcloud enable_sync:=true

vivekmange56 commented 2 years ago

I tried the complete setup installation from the start.

  1. Removed all the files using the below command

dpkg -l | grep "realsense" | cut -d " " -f 3 | xargs sudo dpkg --purge

  1. followed step 4 from the link to install sdk -

https://github.com/IntelRealSense/librealsense/blob/master/doc/installation_jetson.md

  1. Installed the ros wrapper using the below command

sudo apt-get install ros-melodic-realsense2-camera

During the 2nd step the files installed the sdk version 2.51 and when executed step 3. it installed the files with version 2.50.

What should I update in the step2 to install SDK version 2.50, As according to the release document SDK 2.50 is the last compatible version with ROS1 Melodic

Logs from above test

roslaunch realsense2_camera rs_camera.launch

... logging to /home/uvrobot/.ros/log/41ecc1aa-3983-11ed-aad3-00044be67567/roslaunch-uvrobot-desktop-8902.log Checking log directory for disk usage. This may take a while. Press Ctrl-C to interrupt Done checking log file disk usage. Usage is <1GB.

started roslaunch server http://192.168.0.8:33039/

SUMMARY

PARAMETERS

NODES /camera/ realsense2_camera (nodelet/nodelet) realsense2_camera_manager (nodelet/nodelet)

auto-starting new master process[master]: started with pid [8916] ROS_MASTER_URI=http://192.168.0.8:11311

setting /run_id to 41ecc1aa-3983-11ed-aad3-00044be67567 process[rosout-1]: started with pid [8929] started core service [/rosout] process[camera/realsense2_camera_manager-2]: started with pid [8932] process[camera/realsense2_camera-3]: started with pid [8945] [ INFO] [1663747146.414168906]: Initializing nodelet with 4 worker threads. [ INFO] [1663747147.606513151]: RealSense ROS v2.3.2 [ INFO] [1663747147.606602216]: Built with LibRealSense v2.50.0 [ INFO] [1663747147.606668885]: Running with LibRealSense v2.50.0 [ INFO] [1663747147.688184439]:
21/09 13:29:07,758 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 300, error: Success, number: 0 [ INFO] [1663747147.892985069]: Device with serial number 151422253770 was found.

[ INFO] [1663747147.893098510]: Device with physical ID 2-1.1-3 was found. [ INFO] [1663747147.893177001]: Device with name Intel RealSense D455 was found. [ INFO] [1663747147.894665476]: Device with port number 2-1.1 was found. [ INFO] [1663747147.894752613]: Device USB type: 3.2

[ INFO] [1663747148.169503703]: JSON file is not provided [ INFO] [1663747148.169563132]: ROS Node Namespace: camera [ INFO] [1663747148.169642925]: Device Name: Intel RealSense D455 [ INFO] [1663747148.169697458]: Device Serial No: 151422253770 [ INFO] [1663747148.169743709]: Device physical port: 2-1.1-3 [ INFO] [1663747148.169802825]: Device FW version: 05.13.00.50 [ INFO] [1663747148.169853347]: Device Product ID: 0x0B5C [ INFO] [1663747148.169899546]: Enable PointCloud: Off [ INFO] [1663747148.169959079]: Align Depth: Off [ INFO] [1663747148.170010747]: Sync Mode: Off [ INFO] [1663747148.170142052]: Device Sensors: [ INFO] [1663747148.304113055]: Stereo Module was found. [ INFO] [1663747148.368301716]: RGB Camera was found. [ INFO] [1663747148.369164133]: Motion Module was found. [ INFO] [1663747148.369365232]: (Confidence, 0) sensor isn't supported by current device! -- Skipping... [ INFO] [1663747148.369491693]: num_filters: 0 [ INFO] [1663747148.369553153]: Setting Dynamic reconfig parameters. 21/09 13:29:11,502 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 300, error: Resource temporarily unavailable, number: b [ INFO] [1663747153.323060584]: Done Setting Dynamic reconfig parameters. [ INFO] [1663747153.324719166]: depth stream is enabled - width: 848, height: 480, fps: 30, Format: Z16 [ INFO] [1663747153.327444961]: color stream is enabled - width: 1280, height: 720, fps: 30, Format: RGB8

[ INFO] [1663747153.341491497]: Expected frequency for depth = 30.00000 [ INFO] [1663747153.478552870]: Expected frequency for color = 30.00000

21/09 13:29:13,862 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:29:13,912 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:29:13,963 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 [ INFO] [1663747154.013814924]: SELECTED BASE:Depth, 0 [ INFO] [1663747154.056930749]: RealSense Node Is Up! [ WARN] [1663747154.118347378]: 21/09 13:29:14,119 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:29:14,169 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:29:14,220 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:29:14,271 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 [ WARN] [1663747154.323897255]: Hardware Notification:Motion Module force pause,1.66375e+12,Error,Hardware Error 21/09 13:29:14,322 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:29:14,372 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:29:14,423 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:29:14,574 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:29:14,625 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:29:14,777 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:29:14,827 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:29:14,979 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:29:15,030 WARNING [547046277504] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 ^C[camera/realsense2_camera-3] killing on exit [camera/realsense2_camera_manager-2] killing on exit [rosout-1] killing on exit [master] killing on exit shutting down processing monitor... ... shutting down processing monitor complete done

Output

Tested for 5 mins. constant 30hz for both color and depth image

Test 2.

roslaunch realsense2_camera rs_camera.launch enable_pointcloud:=true initial_reset:=true

... logging to /home/uvrobot/.ros/log/e58318be-3983-11ed-80c8-00044be67567/roslaunch-uvrobot-desktop-13571.log Checking log directory for disk usage. This may take a while. Press Ctrl-C to interrupt Done checking log file disk usage. Usage is <1GB.

started roslaunch server http://192.168.0.8:35855/

SUMMARY

PARAMETERS

NODES /camera/ realsense2_camera (nodelet/nodelet) realsense2_camera_manager (nodelet/nodelet)

auto-starting new master process[master]: started with pid [13583] ROS_MASTER_URI=http://192.168.0.8:11311

setting /run_id to e58318be-3983-11ed-80c8-00044be67567 process[rosout-1]: started with pid [13596] started core service [/rosout] process[camera/realsense2_camera_manager-2]: started with pid [13613] process[camera/realsense2_camera-3]: started with pid [13614] [ INFO] [1663747420.729166385]: Initializing nodelet with 4 worker threads. [ INFO] [1663747421.066170670]: RealSense ROS v2.3.2 [ INFO] [1663747421.066265672]: Built with LibRealSense v2.50.0 [ INFO] [1663747421.066325464]: Running with LibRealSense v2.50.0 [ INFO] [1663747421.141783310]:
[ INFO] [1663747421.317432704]: Device with serial number 151422253770 was found.

[ INFO] [1663747421.317592550]: Device with physical ID 2-1.1-3 was found. [ INFO] [1663747421.317686405]: Device with name Intel RealSense D455 was found. [ INFO] [1663747421.319279915]: Device with port number 2-1.1 was found. [ INFO] [1663747421.319410229]: Device USB type: 3.2 [ INFO] [1663747421.319589815]: Resetting device... [ INFO] [1663747427.443404085]:
[ INFO] [1663747427.610992166]: Device with serial number 151422253770 was found.

[ INFO] [1663747427.611097532]: Device with physical ID 2-1.1-3 was found. [ INFO] [1663747427.611148574]: Device with name Intel RealSense D455 was found. [ INFO] [1663747427.612374007]: Device with port number 2-1.1 was found. [ INFO] [1663747427.612447445]: Device USB type: 3.2

[ INFO] [1663747427.891606276]: JSON file is not provided [ INFO] [1663747427.891721329]: ROS Node Namespace: camera [ INFO] [1663747427.891786226]: Device Name: Intel RealSense D455 [ INFO] [1663747427.891837112]: Device Serial No: 151422253770 [ INFO] [1663747427.891881644]: Device physical port: 2-1.1-3 [ INFO] [1663747427.891936957]: Device FW version: 05.13.00.50 [ INFO] [1663747427.891985395]: Device Product ID: 0x0B5C [ INFO] [1663747427.892056490]: Enable PointCloud: On [ INFO] [1663747427.892108834]: Align Depth: Off [ INFO] [1663747427.892151491]: Sync Mode: On [ INFO] [1663747427.892285659]: Device Sensors: [ INFO] [1663747428.023943957]: Stereo Module was found. [ INFO] [1663747428.090629497]: RGB Camera was found. [ INFO] [1663747428.091521748]: Motion Module was found. [ INFO] [1663747428.091668521]: (Confidence, 0) sensor isn't supported by current device! -- Skipping... [ INFO] [1663747428.091766074]: Add Filter: pointcloud [ INFO] [1663747428.093220259]: num_filters: 1 [ INFO] [1663747428.093338281]: Setting Dynamic reconfig parameters. [ INFO] [1663747433.132993071]: Done Setting Dynamic reconfig parameters. [ INFO] [1663747433.134515174]: depth stream is enabled - width: 848, height: 480, fps: 30, Format: Z16 [ INFO] [1663747433.137113957]: color stream is enabled - width: 1280, height: 720, fps: 30, Format: RGB8

[ INFO] [1663747433.146310845]: Expected frequency for depth = 30.00000 [ INFO] [1663747433.274673155]: Expected frequency for color = 30.00000

21/09 13:33:53,686 WARNING [547255996800] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:33:53,736 WARNING [547255996800] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:33:53,787 WARNING [547255996800] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 [ INFO] [1663747433.838160010]: SELECTED BASE:Depth, 0 [ INFO] [1663747433.883304646]: RealSense Node Is Up! [ WARN] [1663747433.902417546]: 21/09 13:33:53,903 WARNING [547255996800] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:33:53,954 WARNING [547255996800] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:33:54,106 WARNING [547255996800] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:33:54,156 WARNING [547255996800] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:33:54,242 WARNING [547255996800] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:33:54,293 WARNING [547255996800] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:33:54,343 WARNING [547255996800] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:33:54,395 WARNING [547255996800] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 21/09 13:34:06,568 ERROR [546937237888] (uvc-streamer.cpp:106) uvc streamer watchdog triggered on endpoint: 132 21/09 13:34:07,460 WARNING [547255996800] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11 ^C[camera/realsense2_camera-3] killing on exit [camera/realsense2_camera_manager-2] killing on exit [rosout-1] killing on exit [master] killing on exit shutting down processing monitor... ... shutting down processing monitor complete done

Output

No PCL No color image Depth image - 6hz

MartyG-RealSense commented 2 years ago

In step 3, if you install with apt-get install ros-melodic-realsense2-camera (known as 'Method 1' in the ROS wrapper instructions) then it is installing librealsense a second time, as this command installs librealsense and the ROS wrapper together at the same time from packages. So as well as creating a potential conflict between the first Jetson package installation of librealsense and the second one that the apt-get command will install, the apt-get install ros-melodic-realsense2-camera version of librealsense also does not contain support for CUDA.

The ROS wrapper should instead be built from source code after the Jetson package install of librealsense.

vivekmange56 commented 2 years ago

Okay will test building the wrapper from source after the librealsense

vivekmange56 commented 2 years ago

Hello @MartyG-RealSense I tested the above configuration and the it seems it worked. But it is using sdk 2.51 in ROS 1 melodic stack and the output is also slow.

Below is the test LOG

roslaunch realsense2_camera rs_camera.launch enable_pointcloud:=true... logging to /home/uvrobot/.ros/log/76ec029a-398c-11ed-a835-00044be67567/roslaunch-uvrobot-desktop-31296.log Checking log directory for disk usage. This may take a while. Press Ctrl-C to interrupt Done checking log file disk usage. Usage is <1GB.

started roslaunch server http://192.168.0.8:41311/

SUMMARY

PARAMETERS

NODES /camera/ realsense2_camera (nodelet/nodelet) realsense2_camera_manager (nodelet/nodelet)

auto-starting new master process[master]: started with pid [31309] ROS_MASTER_URI=http://192.168.0.8:11311

setting /run_id to 76ec029a-398c-11ed-a835-00044be67567 process[rosout-1]: started with pid [31324] started core service [/rosout] process[camera/realsense2_camera_manager-2]: started with pid [31341] process[camera/realsense2_camera-3]: started with pid [31342] [ INFO] [1663751100.622030628]: Initializing nodelet with 4 worker threads. [ INFO] [1663751100.909718769]: RealSense ROS v2.3.2 [ INFO] [1663751100.909810281]: Built with LibRealSense v2.51.1 [ INFO] [1663751100.909871637]: Running with LibRealSense v2.51.1 [ INFO] [1663751100.988684461]:
[ INFO] [1663751101.003346554]: Device with serial number 151422253770 was found.

[ INFO] [1663751101.003493328]: Device with physical ID /sys/devices/70090000.xusb/usb2/2-1/2-1.1/2-1.1:1.0/video4linux/video0 was found. [ INFO] [1663751101.003566299]: Device with name Intel RealSense D455 was found. [ INFO] [1663751101.004791638]: Device with port number 2-1.1 was found. [ INFO] [1663751101.004898255]: Device USB type: 3.2

[ INFO] [1663751101.266408787]: JSON file is not provided [ INFO] [1663751101.266560717]: ROS Node Namespace: camera [ INFO] [1663751101.266674834]: Device Name: Intel RealSense D455 [ INFO] [1663751101.266779211]: Device Serial No: 151422253770 [ INFO] [1663751101.266893693]: Device physical port: /sys/devices/70090000.xusb/usb2/2-1/2-1.1/2-1.1:1.0/video4linux/video0 [ INFO] [1663751101.266994320]: Device FW version: 05.13.00.50 [ INFO] [1663751101.267108542]: Device Product ID: 0x0B5C [ INFO] [1663751101.267203127]: Enable PointCloud: On [ INFO] [1663751101.267303129]: Align Depth: Off [ INFO] [1663751101.267389329]: Sync Mode: On [ INFO] [1663751101.267607146]: Device Sensors: [ INFO] [1663751101.295885736]: Stereo Module was found. [ INFO] [1663751101.322707522]: RGB Camera was found. [ INFO] [1663751101.323500977]: Motion Module was found. [ INFO] [1663751101.323638168]: (Confidence, 0) sensor isn't supported by current device! -- Skipping... [ INFO] [1663751101.323751452]: Add Filter: pointcloud [ INFO] [1663751101.325213567]: num_filters: 1 [ INFO] [1663751101.325358310]: Setting Dynamic reconfig parameters. [ WARN] [1663751101.497531933]: Param '/camera/rgb_camera/power_line_frequency' has value 3 that is not in the enum { {50Hz: 1} {60Hz: 2} {Disabled: 0} }. Removing this parameter from dynamic reconfigure options. [ INFO] [1663751101.559918979]: Done Setting Dynamic reconfig parameters. [ INFO] [1663751101.561545525]: depth stream is enabled - width: 848, height: 480, fps: 30, Format: Z16 [ INFO] [1663751101.564788930]: color stream is enabled - width: 1280, height: 720, fps: 30, Format: RGB8

[ INFO] [1663751101.574028716]: Expected frequency for depth = 30.00000 [ INFO] [1663751101.686874526]: Expected frequency for color = 30.00000

[ INFO] [1663751101.920285951]: SELECTED BASE:Depth, 0 [ INFO] [1663751101.965916328]: RealSense Node Is Up! 21/09 14:35:02,015 WARNING [546850083200] (ds5-timestamp.cpp:69) UVC metadata payloads not available. Please refer to the installation chapter for details. [ WARN] [1663751102.017399437]: Frame metadata isn't available! (frame_timestamp_domain = RS2_TIMESTAMP_DOMAIN_SYSTEM_TIME) 21/09 14:35:02,335 WARNING [546861736320] (ds5-timestamp.cpp:69) UVC metadata payloads not available. Please refer to the installation chapter for details. [ INFO] [1663751253.778391735]: publishing unordered pointcloud. [ WARN] [1663751253.951885023]: No stream match for pointcloud chosen texture Process - Color [ WARN] [1663751254.480654376]: No stream match for pointcloud chosen texture Process - Color

Output

The warning No stream match for pointcloud chosen texture Process - Color is continuous. Tested it for 30mins Color image = 10hz depth image = 30hz pcl = 6hz

NANO status jtop_with_pcl

vivekmange56 commented 2 years ago

I am planning to test the below configuration

Installing the librealsense2 sdk 2.50 from source and then install the ros wrapper from source compatible with the sdk version and test the configuration

MartyG-RealSense commented 2 years ago

As you have enabled the pointcloud, the No stream match for pointcloud chosen texture Process - Color warning may be occurring because of a known issue with generating pointclouds on Jetson devices that can cause problems with missing color and / or very low FPS (desktop / laptop PCs are not affected by this issue) . Does the warnng still occur if you do not enable the pointcloud?

vivekmange56 commented 2 years ago

The warning is not present when PCL is off

[ INFO] [1663753807.875800013]: RealSense Node Is Up! [ WARN] [1663753807.923580954]: Frame metadata isn't available! (frame_timestamp_domain = RS2_TIMESTAMP_DOMAIN_SYSTEM_TIME) 21/09 15:20:07,922 WARNING [547060617600] (ds5-timestamp.cpp:69) UVC metadata payloads not available. Please refer to the installation chapter for details. 21/09 15:20:08,242 WARNING [547071455616] (ds5-timestamp.cpp:69) UVC metadata payloads not available. Please refer to the installation chapter for details. 21/09 15:20:13,887 ERROR [547052224896] (ds5-options.cpp:88) Asic Temperature value is not valid! 21/09 15:20:14,890 ERROR [547052224896] (ds5-options.cpp:88) Asic Temperature value is not valid! 21/09 15:20:15,829 ERROR [547197280640] (ds5-options.cpp:88) Asic Temperature value is not valid! 21/09 15:20:15,893 ERROR [547052224896] (ds5-options.cpp:88) Asic Temperature value is not valid!

MartyG-RealSense commented 2 years ago

I am unfamiliar with PCL in ROS, unfortunately. Are you using pcl_ros please?

If the pointcloud is being generated by the ROS wrapper's pointcloud filter, what function is PCL performing?

vivekmange56 commented 2 years ago

No I am not using pcl_ros.

I am using the ros wrapper to generate the PCL and will be using it for navigation of the device

MartyG-RealSense commented 2 years ago

The developer of the ROS1 wrapper stated at https://github.com/IntelRealSense/realsense-ros/issues/588#issuecomment-457890773 that the No stream match for pointcloud chosen texture Process - Color warning can occur if there is a frame drop.

As you are using a D455 equipped with an IMU, would it be practical for your project to use Intel's SLAM navigation guide for ROS at the link below for navigation instead of PCL?

https://github.com/IntelRealSense/realsense-ros/wiki/SLAM-with-D435i

MartyG-RealSense commented 2 years ago

Hi @vivek2019 Do you require further assistance with this case, please? Thanks!

MartyG-RealSense commented 2 years ago

Case closed due to no further comments received.