search

NVIDIA-ISAAC-ROS / isaac_ros_compression

NVIDIA-accelerated data compression
https://developer.nvidia.com/isaac-ros-gems
Apache License 2.0
53 stars 7 forks source link

Encoder GFX errors #11

Open mvanlobensels opened 4 months ago

mvanlobensels commented 4 months ago

I am trying to run the encoder to compress my video stream. The v4l2_camera node outputs the video stream in RGB8 format with a resolution of 1920x1080 pixels. This is the complete log when running the encoder:

nvidia@tegra-ubuntu:~/Projects/autonomy$ ros2 launch isaac_ros_h264_encoder isaac_ros_h264_encoder.launch.py
[INFO] [launch]: All log files can be found below /home/nvidia/.ros/log/2024-05-16-13-59-46-379247-tegra-ubuntu-2933
[INFO] [launch]: Default logging verbosity is set to INFO
[INFO] [component_container-1]: process started with pid [2946]
[component_container-1] [INFO] [1715867987.012505907] [encoder_container]: Load Library: /opt/ros/humble/lib/libencoder_node.so
[component_container-1] [INFO] [1715867987.055813639] [encoder_container]: Found class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::h264_encoder::EncoderNode>
[component_container-1] [INFO] [1715867987.055943371] [encoder_container]: Instantiate class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::h264_encoder::EncoderNode>
[component_container-1] [INFO] [1715867987.064485368] [NitrosContext]: [NitrosContext] Creating a new shared context
[component_container-1] [INFO] [1715867987.064770945] [encoder]: [NitrosNode] Initializing NitrosNode
[component_container-1] [INFO] [1715867987.065782273] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/std/libgxf_std.so
[component_container-1] [INFO] [1715867987.075685465] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/libgxf_gxf_helpers.so
[component_container-1] [INFO] [1715867987.080819034] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/libgxf_sight.so
[component_container-1] [INFO] [1715867987.087217412] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/libgxf_atlas.so
[component_container-1] [INFO] [1715867987.093736369] [NitrosContext]: [NitrosContext] Loading application: '/opt/ros/humble/share/isaac_ros_nitros/config/type_adapter_nitros_context_graph.yaml'
[component_container-1] [INFO] [1715867987.095303906] [NitrosContext]: [NitrosContext] Initializing application...
[component_container-1] [INFO] [1715867987.100450149] [NitrosContext]: [NitrosContext] Running application...
[component_container-1] 2024-05-16 13:59:47.100 WARN  gxf/std/program.cpp@514: No system specified. Nothing to do
[component_container-1] [INFO] [1715867987.102732588] [encoder]: [NitrosNode] Starting NitrosNode
[component_container-1] [INFO] [1715867987.102811727] [encoder]: [NitrosNode] Loading built-in preset extension specs
[component_container-1] [INFO] [1715867987.106863438] [encoder]: [NitrosNode] Loading built-in extension specs
[component_container-1] [INFO] [1715867987.106983922] [encoder]: [NitrosNode] Loading preset extension specs
[component_container-1] [INFO] [1715867987.108195640] [encoder]: [NitrosNode] Loading extension specs
[component_container-1] [INFO] [1715867987.108257914] [encoder]: [NitrosNode] Loading generator rules
[component_container-1] [INFO] [1715867987.108761962] [encoder]: [NitrosNode] Loading extensions
[component_container-1] [INFO] [1715867987.109186488] [encoder]: [NitrosContext] Loading extension: gxf/lib/libgxf_message_compositor.so
[component_container-1] [INFO] [1715867987.111568163] [encoder]: [NitrosContext] Loading extension: gxf/lib/multimedia/libgxf_multimedia.so
[component_container-1] [INFO] [1715867987.113300633] [encoder]: [NitrosContext] Loading extension: gxf/lib/cuda/libgxf_cuda.so
[component_container-1] [INFO] [1715867987.115114066] [encoder]: [NitrosContext] Loading extension: gxf/lib/serialization/libgxf_serialization.so
[component_container-1] [INFO] [1715867987.120924329] [encoder]: [NitrosContext] Loading extension: gxf/lib/image_proc/libgxf_tensorops.so
[component_container-1] [INFO] [1715867987.129957222] [encoder]: [NitrosContext] Loading extension: gxf/lib/codec/libgxf_video_encoder_extension.so
[component_container-1] [INFO] [1715867987.133767422] [encoder]: [NitrosNode] Loading graph to the optimizer
[component_container-1] [INFO] [1715867987.137779676] [encoder]: [NitrosNode] Running optimization
[component_container-1] [INFO] [1715867987.154133471] [encoder]: [NitrosNode] Obtaining graph IO group info from the optimizer
[component_container-1] [INFO] [1715867987.155573836] [encoder]: [NitrosNode] Creating negotiated publishers/subscribers
[component_container-1] [INFO] [1715867987.164457188] [encoder]: [NitrosNode] Starting negotiation...
[INFO] [launch_ros.actions.load_composable_nodes]: Loaded node '/encoder' in container '/encoder_container'
[component_container-1] [INFO] [1715867987.265878142] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.273569424] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.278022268] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.282964216] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.287133051] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.300516161] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.314412982] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.321416435] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.327821437] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.353363617] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.361255322] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.369017742] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.378941287] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.393599828] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.410459367] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.426806474] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.443531993] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.459325642] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.477366466] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.503145966] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.520248872] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.532304132] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.553277177] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.563497402] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.589027774] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.603186524] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.624449658] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.634597753] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.652878521] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.669885713] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.686772869] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.694535961] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.719176065] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.737544451] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.753365750] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.770023906] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.788592107] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.823769439] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.828526709] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.857608072] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.869316761] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.874262837] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.900512976] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.906230532] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.941997706] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.949193197] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.955347662] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.968773077] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.977755536] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867987.993826698] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.010489367] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.028241638] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.043269663] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.059706437] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.077097512] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.093798710] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.110184218] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.125980940] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.143423953] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.159436809] [encoder]: [NitrosSubscriber] Received a message but the application receiver's pointer is not yet set.
[component_container-1] [INFO] [1715867988.165345827] [encoder]: [NitrosNode] Starting post negotiation setup
[component_container-1] [INFO] [1715867988.165511465] [encoder]: [NitrosNode] Getting data format negotiation results
[component_container-1] [INFO] [1715867988.165550762] [encoder]: [NitrosSubscriber] Negotiation ended with no results
[component_container-1] [INFO] [1715867988.165571947] [encoder]: [NitrosSubscriber] Use the compatible subscriber: topic_name="/image_raw", data_format="nitros_image_bgr8"
[component_container-1] [INFO] [1715867988.165676270] [encoder]: [NitrosPublisher] Negotiation ended with no results
[component_container-1] [INFO] [1715867988.165699855] [encoder]: [NitrosPublisher] Use only the compatible publisher: topic_name="/image_compressed", data_format="nitros_compressed_image"
[component_container-1] [INFO] [1715867988.168834641] [encoder]: [NitrosNode] Exporting the final graph based on the negotiation results
[component_container-1] [INFO] [1715867988.177364830] [encoder]: [NitrosNode] Wrote the final top level YAML graph to "/tmp/isaac_ros_nitros/graphs/OXBWGRJEFH/OXBWGRJEFH.yaml"
[component_container-1] [INFO] [1715867988.177526019] [encoder]: [NitrosNode] Calling user's pre-load-graph callback
[component_container-1] [INFO] [1715867988.177580997] [encoder]: [EncoderNode] preLoadGraphCallback().
[component_container-1] [INFO] [1715867988.177600741] [encoder]: [NitrosNode] Loading application
[component_container-1] [INFO] [1715867988.177653543] [encoder]: [NitrosContext] Loading application: '/tmp/isaac_ros_nitros/graphs/OXBWGRJEFH/OXBWGRJEFH.yaml'
[component_container-1] [INFO] [1715867988.181164502] [encoder]: [NitrosNode] Linking Nitros pub/sub to the loaded application
[component_container-1] [INFO] [1715867988.181431966] [encoder]: [NitrosNode] Calling user's post-load-graph callback
[component_container-1] [INFO] [1715867988.181463167] [encoder]: [EncoderNode] postLoadGraphCallback().
[component_container-1] [INFO] [1715867988.181557634] [encoder]: [NitrosContext] Initializing application...
[component_container-1] 2024-05-16 13:59:48.540 ERROR /data/jenkins/ros/workspace/ly_debian-compatible-release-2.1/isaac_ros-dev/ros_ws/src/isaac_ros_compression/isaac_ros_h264_encoder/gxf/codec/video_encoder/videoencoder_context.cpp@147: Failed to open device:v4l2_open() failed
[component_container-1] 2024-05-16 13:59:48.540 ERROR /data/jenkins/ros/workspace/ly_debian-compatible-release-2.1/isaac_ros-dev/ros_ws/src/isaac_ros_compression/isaac_ros_h264_encoder/gxf/codec/video_encoder/videoencoder_context.cpp@79: Failed to create default encoder context
[component_container-1] 2024-05-16 13:59:48.540 ERROR gxf/std/entity_warden.cpp@406: Failed to initialize component 00268 (encoder_context)
[component_container-1] 2024-05-16 13:59:48.540 ERROR gxf/core/runtime.cpp@685: Could not initialize entity 'OXBWGRJEFH_global' (E265): GXF_FAILURE
[component_container-1] 2024-05-16 13:59:48.540 ERROR gxf/std/program.cpp@236: Failed to activate entity 00265 named OXBWGRJEFH_global: GXF_FAILURE
[component_container-1] 2024-05-16 13:59:48.540 ERROR gxf/std/program.cpp@238: Deactivating...
[component_container-1] 2024-05-16 13:59:48.551 ERROR gxf/core/runtime.cpp@1384: Graph activation failed with error: GXF_FAILURE
[component_container-1] [ERROR] [1715867988.551915345] [encoder]: [NitrosContext] GxfGraphActivate Error: GXF_FAILURE
[component_container-1] [ERROR] [1715867988.552110679] [encoder]: [NitrosNode] runGraphAsync Error: GXF_FAILURE
[component_container-1] terminate called after throwing an instance of 'std::runtime_error'
[component_container-1]   what():  [NitrosNode] runGraphAsync Error: GXF_FAILURE
[ERROR] [component_container-1]: process has died [pid 2946, exit code -6, cmd '/opt/ros/humble/lib/rclcpp_components/component_container --ros-args --log-level info --ros-args -r __node:=encoder_container -r __ns:=/'].
nvidia@tegra-ubuntu:~/Projects/
wy-chien commented 2 months ago

Hi @mvanlobensels , I am facing the same error with all the launch file. How did you solve the issue? Thank you in advanced.

mvanlobensels commented 2 months ago

I did not

wy-chien commented 2 months ago

Hello @jaiveersinghNV , do you have any clue to solve this issue? I believe this is a bug since I can reproduce it by simply following the Quickstart in the document on multiple different machine.