search

osrf / buildfarm-tools

2 stars 2 forks source link

Buildfarmer log 2024/02/19 - 2024/02/26 #29

Closed github-actions[bot] closed 6 months ago

github-actions[bot] commented 6 months ago

Previous log #27

github-actions[bot] commented 6 months ago

Feb 19

Build regressions ``` nightly_linux_coverage|2285|2024-02-19 04:50:06.485000|Unknown Reason|coverage analysis nightly_linux_repeated|3366|2024-02-19 07:25:01.460000|Packages action_tutorials_cpp action_tutorials_py camera_calibration_parsers camera_info_manager composition demo_nodes_cpp demo_nodes_cpp_native demo_nodes_py dummy_map_server dummy_robot_bringup dummy_sensors examples_rclcpp_async_client examples_rclcpp_cbg_executor examples_rclcpp_minimal_action_client examples_rclcpp_minimal_action_server examples_rclcpp_minimal_client examples_rclcpp_minimal_composition examples_rclcpp_minimal_publisher examples_rclcpp_minimal_service examples_rclcpp_minimal_subscriber examples_rclcpp_minimal_timer examples_rclcpp_multithreaded_executor examples_rclcpp_wait_set examples_rclpy_executors examples_rclpy_guard_conditions examples_rclpy_minimal_action_client examples_rclpy_minimal_action_server examples_rclpy_minimal_client examples_rclpy_minimal_publisher examples_rclpy_minimal_service examples_rclpy_minimal_subscriber examples_rclpy_pointcloud_publisher examples_tf2_py geometry2 image_common image_tools image_transport interactive_markers intra_process_demo laser_geometry launch_ros launch_testing_examples launch_testing_ros lifecycle lifecycle_py logging_demo message_filters pendulum_control point_cloud_transport point_cloud_transport_py quality_of_service_demo_cpp quality_of_service_demo_py rclcpp_action rclcpp_components rclcpp_lifecycle rclpy robot_state_publisher ros2action ros2bag ros2cli ros2cli_common_extensions ros2component ros2doctor ros2interface ros2launch ros2lifecycle ros2lifecycle_test_fixtures ros2multicast ros2node ros2param ros2pkg ros2run ros2service ros2test ros2topic ros2trace ros_testing rosbag2 rosbag2_compression rosbag2_compression_zstd rosbag2_cpp rosbag2_examples_cpp rosbag2_examples_py rosbag2_performance_benchmarking rosbag2_py rosbag2_storage rosbag2_storage_default_plugins rosbag2_storage_mcap rosbag2_storage_sqlite3 rosbag2_test_common rosbag2_tests rosbag2_transport rqt_action rqt_bag rqt_bag_plugins rqt_console rqt_graph rqt_gui rqt_gui_cpp rqt_gui_py rqt_msg rqt_publisher rqt_py_common rqt_py_console rqt_reconfigure rqt_service_caller rqt_shell rqt_srv rqt_topic rviz2 rviz_common rviz_default_plugins rviz_visual_testing_framework sros2 sros2_cmake test_cli test_cli_remapping test_communication test_launch_ros test_quality_of_service test_rclcpp test_ros2trace test_security test_tf2 test_tracetools test_tracetools_launch tf2_bullet tf2_eigen tf2_geometry_msgs tf2_kdl tf2_py tf2_ros tf2_ros_py tf2_sensor_msgs tf2_tools tlsf_cpp topic_monitor topic_statistics_demo tracetools_launch tracetools_test turtlesim Failed|ccache stats (after) Hci__nightly-performance_ubuntu_jammy_amd64|206|2024-02-19 00:53:34.335000|Packages performance_test Failed|build workspace in isolation and install gz-launch8-debbuilder|128|2024-02-18 11:38:33.546000|Failed to compile and install build|install build dependencies from debian/control gz-sim9-debbuilder|132|2024-02-18 11:34:41.235000|Failed to compile and install build|install build dependencies from debian/control gz-tools2-debbuilder|1420|2024-02-19 09:14:42.409000|Failed to compile and install build|install build dependencies from debian/control gz_gui-ci-gz-gui7-homebrew-amd64|21|2024-02-18 15:06:03.114000|Failed to compile and install gz-gui7|install gz-gui7 dependencies ```
Test regressions ``` Excluding 'performance, connext, fastrtps-dynamic' jobs Issue #1 in nightly_win_rep - Failing 35.71% in 5 out of 14 builds projectroot.test_cli_remapping (also in: "nightly_win_rel" job) Issue #2 in nightly_win_rep - Failing 14.29% in 2 out of 14 builds test_cli_remapping.TestCLIRemapping.test_node_name_replacement[C:/ci/ws/build/test_cli_remapping/Release/name_maker_rclcpp.exe] (also in: "nightly_win_rel" job) Issue #3 in nightly_win_rep - Failing 14.29% in 2 out of 14 builds projectroot.message_filters_test_latest_time_policy message_filters.LatestTimePolicy.Leading Issue #4 in gz_sim-ci-ign-gazebo6-focal-amd64 - Failing 25.0% in 1 out of 4 builds ServerRepeat/OdometryPublisherTest.GaussianNoiseTest/0 (also in: "gz_sim-ci-ign-gazebo6-homebrew-amd64" job) Issue #5 in gz_sim-ign-gazebo6-win - Failing 25.0% in 1 out of 4 builds INTEGRATION_multiple_servers.test_ran (also in: "gz_sim-7-win" job) Issue #6 in gz_sim-main-win - Failing 25.0% in 1 out of 4 builds INTEGRATION_save_world.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) Issue #7 in gz_transport-ci-gz-transport13-homebrew-amd64 - Failing 25.0% in 1 out of 4 builds INTEGRATION_callback_scope_TEST.test_ran .gz-transport.python.test.requester_TEST .gz-transport.python.test.pubSub_TEST .gz-transport.python.test.options_TEST Issue #8 in gz_fuel_tools-ci-ign-fuel-tools7-focal-amd64 - Failing 25.0% in 1 out of 4 builds UNIT_gz_TEST.test_ran (also in: "gz_transport-ci-ign-transport11-homebrew-amd64" job) (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) (also in: "gz_fuel_tools-ci-ign-fuel-tools7-focal-amd64" job) Issue #9 in gz_transport-ci-gz-transport13-homebrew-amd64 - Failing 25.0% in 1 out of 4 builds UNIT_Recorder_TEST.test_ran (also in: "gz_transport-ci-main-jammy-amd64" job) (also in: "gz_transport-ci-ign-transport11-homebrew-amd64" job) (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) Issue #10 in gz_transport-ci-gz-transport13-homebrew-amd64 - Failing 25.0% in 1 out of 4 builds UNIT_Node_TEST.test_ran (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) (also in: "gz_transport-ci-ign-transport11-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) (also in: "gz_rendering-ci-ign-rendering6-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) (also in: "gz_rendering-ci-ign-rendering3-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) Issue #11 in gz_transport-ci-gz-transport13-homebrew-amd64 - Failing 25.0% in 1 out of 4 builds INTEGRATION_twoProcsPubSub.test_ran (also in: "gz_transport-ci-ign-transport11-homebrew-amd64" job) (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) Issue #12 in gz_transport-ci-gz-transport13-homebrew-amd64 - Failing 25.0% in 1 out of 4 builds UNIT_result_TEST.test_ran UNIT_gz_src_TEST.test_ran (known issue in: https://github.com/gazebosim/gz-fuel-tools/issues/307 - CLOSED | https://github.com/gazebosim/gz-fuel-tools/issues/315 - CLOSED) UNIT_Uuid_TEST.test_ran UNIT_Utils_TEST.test_ran UNIT_TopicUtils_TEST.test_ran UNIT_TopicStorage_TEST.test_ran UNIT_TopicStatistics_TEST.test_ran UNIT_SubscribeOptions_TEST.test_ran UNIT_SqlStatement_TEST.test_ran UNIT_Registry_TEST.test_ran UNIT_QueryOptions_TEST.test_ran UNIT_QualifiedTime_TEST.test_ran UNIT_Publisher_TEST.test_ran UNIT_Playback_TEST.test_ran UNIT_ParamCommandAPI_TEST.test_ran UNIT_NodeOptions_TEST.test_ran UNIT_NetUtils_TEST.test_ran UNIT_Message_TEST.test_ran UNIT_MessageInfo_TEST.test_ran UNIT_Log_TEST.test_ran UNIT_LogCommandAPI_TEST.test_ran UNIT_Helpers_TEST.test_ran UNIT_HandlerStorage_TEST.test_ran UNIT_Discovery_TEST.test_ran UNIT_Descriptor_TEST.test_ran UNIT_Clock_TEST.test_ran UNIT_Client_TEST.test_ran UNIT_CIface_TEST.test_ran UNIT_Batch_TEST.test_ran UNIT_AdvertiseOptions_TEST.test_ran INTEGRATION_twoProcsSrvCallWithoutOutputStress.test_ran INTEGRATION_twoProcsSrvCallWithoutOutput.test_ran INTEGRATION_twoProcsSrvCallWithoutInputSync1.test_ran INTEGRATION_twoProcsSrvCallWithoutInputStress.test_ran INTEGRATION_twoProcsSrvCallWithoutInput.test_ran INTEGRATION_twoProcsSrvCallSync1.test_ran INTEGRATION_twoProcsSrvCallStress.test_ran INTEGRATION_twoProcsSrvCall.test_ran INTEGRATION_statistics.test_ran INTEGRATION_scopedTopic.test_ran INTEGRATION_recorder.test_ran INTEGRATION_query.test_ran INTEGRATION_playback.test_ran INTEGRATION_authPubSub.test_ran (also in: "gz_transport-ci-ign-transport11-homebrew-amd64" job) (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) Issue #13 in gz_transport-main-win - Failing 25.0% in 1 out of 4 builds playback.ReplayStep (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED | https://github.com/gazebosim/gz-transport/issues/195 - OPEN) (also in: "gz_transport-13-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED | https://github.com/gazebosim/gz-transport/issues/195 - OPEN) (also in: "gz_transport-12-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED | https://github.com/gazebosim/gz-transport/issues/195 - OPEN) Issue #14 in nightly_win_deb - Failing 16.67% in 1 out of 6 builds rclcpp.TestTimersManager.check_one_timer_cancel_doesnt_affect_other_timers (also in: "nightly_win_rep" job) (also in: "nightly_win_rel" job) (also in: "nightly_win_deb" job) Issue #15 in nightly_win_deb - Failing 16.67% in 1 out of 6 builds projectroot.test.rclcpp.test_timers_manager (also in: "nightly_win_rep" job) (also in: "nightly_win_rel" job) (also in: "nightly_win_deb" job) ```
github-actions[bot] commented 6 months ago

Feb 20

Build regressions ``` ```
Test regressions ``` Excluding 'performance, connext, fastrtps-dynamic' jobs Issue #1 in nightly_win_rep - Failing 38.46% in 5 out of 13 builds projectroot.test_cli_remapping (also in: "nightly_win_rel" job) Issue #2 in nightly_win_rep - Failing 15.38% in 2 out of 13 builds test_cli_remapping.TestCLIRemapping.test_node_name_replacement[C:/ci/ws/build/test_cli_remapping/Release/name_maker_rclcpp.exe] (also in: "nightly_win_rel" job) Issue #3 in nightly_win_rep - Failing 15.38% in 2 out of 13 builds projectroot.message_filters_test_latest_time_policy message_filters.LatestTimePolicy.Leading Issue #4 in gz_sim-ci-ign-gazebo6-focal-amd64 - Failing 25.0% in 1 out of 4 builds ServerRepeat/OdometryPublisherTest.GaussianNoiseTest/0 (also in: "gz_sim-ci-ign-gazebo6-homebrew-amd64" job) Issue #5 in gz_sim-ign-gazebo6-win - Failing 25.0% in 1 out of 4 builds INTEGRATION_multiple_servers.test_ran Issue #6 in gz_sim-main-win - Failing 33.33% in 1 out of 3 builds INTEGRATION_save_world.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) Issue #7 in gz_transport-ci-gz-transport13-homebrew-amd64 - Failing 25.0% in 1 out of 4 builds INTEGRATION_callback_scope_TEST.test_ran .gz-transport.python.test.requester_TEST .gz-transport.python.test.pubSub_TEST .gz-transport.python.test.options_TEST Issue #8 in gz_fuel_tools-ci-ign-fuel-tools7-focal-amd64 - Failing 25.0% in 1 out of 4 builds UNIT_gz_TEST.test_ran (also in: "gz_transport-ci-ign-transport11-homebrew-amd64" job) (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) (also in: "gz_fuel_tools-ci-ign-fuel-tools7-focal-amd64" job) Issue #9 in gz_transport-ci-gz-transport13-homebrew-amd64 - Failing 25.0% in 1 out of 4 builds UNIT_Recorder_TEST.test_ran (also in: "gz_transport-ci-main-jammy-amd64" job) (also in: "gz_transport-ci-ign-transport11-homebrew-amd64" job) (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) Issue #10 in gz_transport-ci-gz-transport13-homebrew-amd64 - Failing 25.0% in 1 out of 4 builds UNIT_Node_TEST.test_ran (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) (also in: "gz_transport-ci-ign-transport11-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) (also in: "gz_rendering-ci-ign-rendering6-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) (also in: "gz_rendering-ci-ign-rendering3-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) Issue #11 in gz_transport-ci-gz-transport13-homebrew-amd64 - Failing 25.0% in 1 out of 4 builds INTEGRATION_twoProcsPubSub.test_ran (also in: "gz_transport-ci-ign-transport11-homebrew-amd64" job) (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) Issue #12 in gz_transport-ci-gz-transport13-homebrew-amd64 - Failing 25.0% in 1 out of 4 builds UNIT_result_TEST.test_ran UNIT_gz_src_TEST.test_ran (known issue in: https://github.com/gazebosim/gz-fuel-tools/issues/307 - CLOSED | https://github.com/gazebosim/gz-fuel-tools/issues/315 - CLOSED) UNIT_Uuid_TEST.test_ran UNIT_Utils_TEST.test_ran UNIT_TopicUtils_TEST.test_ran UNIT_TopicStorage_TEST.test_ran UNIT_TopicStatistics_TEST.test_ran UNIT_SubscribeOptions_TEST.test_ran UNIT_SqlStatement_TEST.test_ran UNIT_Registry_TEST.test_ran UNIT_QueryOptions_TEST.test_ran UNIT_QualifiedTime_TEST.test_ran UNIT_Publisher_TEST.test_ran UNIT_Playback_TEST.test_ran UNIT_ParamCommandAPI_TEST.test_ran UNIT_NodeOptions_TEST.test_ran UNIT_NetUtils_TEST.test_ran UNIT_Message_TEST.test_ran UNIT_MessageInfo_TEST.test_ran UNIT_Log_TEST.test_ran UNIT_LogCommandAPI_TEST.test_ran UNIT_Helpers_TEST.test_ran UNIT_HandlerStorage_TEST.test_ran UNIT_Discovery_TEST.test_ran UNIT_Descriptor_TEST.test_ran UNIT_Clock_TEST.test_ran UNIT_Client_TEST.test_ran UNIT_CIface_TEST.test_ran UNIT_Batch_TEST.test_ran UNIT_AdvertiseOptions_TEST.test_ran INTEGRATION_twoProcsSrvCallWithoutOutputStress.test_ran INTEGRATION_twoProcsSrvCallWithoutOutput.test_ran INTEGRATION_twoProcsSrvCallWithoutInputSync1.test_ran INTEGRATION_twoProcsSrvCallWithoutInputStress.test_ran INTEGRATION_twoProcsSrvCallWithoutInput.test_ran INTEGRATION_twoProcsSrvCallSync1.test_ran INTEGRATION_twoProcsSrvCallStress.test_ran INTEGRATION_twoProcsSrvCall.test_ran INTEGRATION_statistics.test_ran INTEGRATION_scopedTopic.test_ran INTEGRATION_recorder.test_ran INTEGRATION_query.test_ran INTEGRATION_playback.test_ran INTEGRATION_authPubSub.test_ran (also in: "gz_transport-ci-ign-transport11-homebrew-amd64" job) (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) Issue #13 in gz_transport-main-win - Failing 25.0% in 1 out of 4 builds playback.ReplayStep (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED | https://github.com/gazebosim/gz-transport/issues/195 - OPEN) (also in: "gz_transport-13-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED | https://github.com/gazebosim/gz-transport/issues/195 - OPEN) (also in: "gz_transport-12-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED | https://github.com/gazebosim/gz-transport/issues/195 - OPEN) Issue #14 in nightly_win_deb - Failing 16.67% in 1 out of 6 builds rclcpp.TestTimersManager.check_one_timer_cancel_doesnt_affect_other_timers (also in: "nightly_win_rep" job) (also in: "nightly_win_rel" job) (also in: "nightly_win_deb" job) Issue #15 in nightly_win_deb - Failing 16.67% in 1 out of 6 builds projectroot.test.rclcpp.test_timers_manager (also in: "nightly_win_rep" job) (also in: "nightly_win_rel" job) (also in: "nightly_win_deb" job) ```

@Crola1702 comment:

DatabaseFetcher failed today, so these are not the latest issues

github-actions[bot] commented 6 months ago

Feb 21

Build regressions ``` gz-launch8-debbuilder|133|2024-02-20 12:17:48.654000|Failed to compile and install build|install build dependencies from debian/control gz-physics8-debbuilder|139|2024-02-20 12:08:24.556000|Failed to compile and install build|install build dependencies from debian/control gz-sim9-debbuilder|136|2024-02-20 12:12:48.017000|Failed to compile and install build|install build dependencies from debian/control nightly_linux-rhel_repeated|1810|2024-02-21 04:00:01.535000|Jenkins channel closing down (Agent disconnected)|test Rci__nightly-release_ubuntu_jammy_amd64|750|2024-02-20 19:06:33.681000|Build timed out after 300 minutes|run tests gz-tools2-debbuilder|1427|2024-02-21 09:14:05.026000|Failed to compile and install build|install build dependencies from debian/control gz_sim-7-win|32|2024-02-20 23:06:11.217000|Jenkins channel closing down (Agent disconnected)|colcon compilation with tests for gz-sim7 Rci__nightly-fastrtps-dynamic_ubuntu_jammy_amd64|724|2024-02-20 14:06:12.476000|Build timed out after 300 minutes|run tests Rci__nightly-fastrtps_ubuntu_jammy_amd64|740|2024-02-20 14:06:12.481000|Number of failed test exceeds the threshold|run tests ```
Test regressions ``` Excluding 'performance, connext, fastrtps-dynamic' jobs Issue #1 in nightly_win_rep - Failing 76.92% in 10 out of 13 builds rclcpp.TestGuardCondition.construction_and_destruction projectroot.test.rclcpp.test_guard_condition Issue #2 in nightly_win_rep - Failing 61.54% in 8 out of 13 builds projectroot.test.rclcpp.test_timers_manager (also in: "nightly_win_rel" job) (also in: "nightly_win_deb" job) Issue #3 in nightly_win_rep - Failing 53.85% in 7 out of 13 builds rclcpp.TestTimersManager.check_one_timer_cancel_doesnt_affect_other_timers (also in: "nightly_win_rel" job) (also in: "nightly_win_deb" job) Issue #4 in nightly_linux_repeated - Failing 28.57% in 4 out of 14 builds ros2topic.ros2topic.test.test_cli.test_cli (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED) Issue #5 in nightly_linux-aarch64_repeated - Failing 13.33% in 2 out of 15 builds test_rclcpp.TestTwoExecutablesAfterShutdown.test_node_name projectroot.test_node_name__rmw_fastrtps_cpp Issue #6 in nightly_win_rep - Failing 15.38% in 2 out of 13 builds rosidl_typesupport_introspection_tests.ArraysServiceIntrospectionTest/0.CanWriteTypeErasedResponseMessage projectroot.test_arrays_service_introspection Issue #7 in gz_fuel_tools-8-win - Failing 25.0% in 1 out of 4 builds FuelClientTest/FuelClientDownloadTest.DownloadModel/1 Issue #8 in gz_sim-ci-ign-gazebo3-focal-amd64 - Failing 25.0% in 1 out of 4 builds ServerRepeat/AckermannSteeringTest.TfPublishes/0 (known issue in: https://github.com/gazebosim/gz-sim/issues/1993 - CLOSED) INTEGRATION_gpu_lidar.test_ran Issue #9 in gz_sim-ci-ign-gazebo6-focal-amd64 - Failing 25.0% in 1 out of 4 builds ServerRepeat/OdometryPublisherTest.GaussianNoiseTest/0 (also in: "gz_sim-ci-ign-gazebo6-homebrew-amd64" job) Issue #10 in gz_sim-8-win - Failing 20.0% in 1 out of 5 builds INTEGRATION_save_world.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) (also in: "gz_sim-main-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) (also in: "gz_sim-8-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) Issue #11 in gz_sim-ign-gazebo6-win - Failing 25.0% in 1 out of 4 builds INTEGRATION_multiple_servers.test_ran (also in: "gz_sim-main-win" job) (also in: "gz_sim-ign-gazebo6-win" job) Issue #12 in gz_transport-ci-gz-transport13-homebrew-amd64 - Failing 25.0% in 1 out of 4 builds INTEGRATION_callback_scope_TEST.test_ran .gz-transport.python.test.requester_TEST .gz-transport.python.test.pubSub_TEST .gz-transport.python.test.options_TEST Issue #13 in gz_fuel_tools-ci-ign-fuel-tools7-focal-amd64 - Failing 25.0% in 1 out of 4 builds UNIT_gz_TEST.test_ran (also in: "gz_transport-ci-ign-transport11-homebrew-amd64" job) (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) (also in: "gz_fuel_tools-ci-ign-fuel-tools7-focal-amd64" job) Issue #14 in gz_transport-ci-gz-transport13-homebrew-amd64 - Failing 25.0% in 1 out of 4 builds UNIT_Recorder_TEST.test_ran (also in: "gz_transport-ci-main-jammy-amd64" job) (also in: "gz_transport-ci-ign-transport11-homebrew-amd64" job) (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) Issue #15 in gz_transport-ci-gz-transport13-homebrew-amd64 - Failing 25.0% in 1 out of 4 builds UNIT_Node_TEST.test_ran (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) (also in: "gz_transport-ci-ign-transport11-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) (also in: "gz_rendering-ci-ign-rendering6-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) (also in: "gz_rendering-ci-ign-rendering3-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) Issue #16 in gz_transport-ci-gz-transport13-homebrew-amd64 - Failing 25.0% in 1 out of 4 builds INTEGRATION_twoProcsPubSub.test_ran (also in: "gz_transport-ci-ign-transport11-homebrew-amd64" job) (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) Issue #17 in gz_transport-ci-gz-transport13-homebrew-amd64 - Failing 25.0% in 1 out of 4 builds UNIT_result_TEST.test_ran UNIT_gz_src_TEST.test_ran (known issue in: https://github.com/gazebosim/gz-fuel-tools/issues/307 - CLOSED | https://github.com/gazebosim/gz-fuel-tools/issues/315 - CLOSED) UNIT_Uuid_TEST.test_ran UNIT_Utils_TEST.test_ran UNIT_TopicUtils_TEST.test_ran UNIT_TopicStorage_TEST.test_ran UNIT_TopicStatistics_TEST.test_ran UNIT_SubscribeOptions_TEST.test_ran UNIT_SqlStatement_TEST.test_ran UNIT_Registry_TEST.test_ran UNIT_QueryOptions_TEST.test_ran UNIT_QualifiedTime_TEST.test_ran UNIT_Publisher_TEST.test_ran UNIT_Playback_TEST.test_ran UNIT_ParamCommandAPI_TEST.test_ran UNIT_NodeOptions_TEST.test_ran UNIT_NetUtils_TEST.test_ran UNIT_Message_TEST.test_ran UNIT_MessageInfo_TEST.test_ran UNIT_Log_TEST.test_ran UNIT_LogCommandAPI_TEST.test_ran UNIT_Helpers_TEST.test_ran UNIT_HandlerStorage_TEST.test_ran UNIT_Discovery_TEST.test_ran UNIT_Descriptor_TEST.test_ran UNIT_Clock_TEST.test_ran UNIT_Client_TEST.test_ran UNIT_CIface_TEST.test_ran UNIT_Batch_TEST.test_ran UNIT_AdvertiseOptions_TEST.test_ran INTEGRATION_twoProcsSrvCallWithoutOutputStress.test_ran INTEGRATION_twoProcsSrvCallWithoutOutput.test_ran INTEGRATION_twoProcsSrvCallWithoutInputSync1.test_ran INTEGRATION_twoProcsSrvCallWithoutInputStress.test_ran INTEGRATION_twoProcsSrvCallWithoutInput.test_ran INTEGRATION_twoProcsSrvCallSync1.test_ran INTEGRATION_twoProcsSrvCallStress.test_ran INTEGRATION_twoProcsSrvCall.test_ran INTEGRATION_statistics.test_ran INTEGRATION_scopedTopic.test_ran INTEGRATION_recorder.test_ran INTEGRATION_query.test_ran INTEGRATION_playback.test_ran INTEGRATION_authPubSub.test_ran (also in: "gz_transport-ci-ign-transport11-homebrew-amd64" job) (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) Issue #18 in gz_transport-main-win - Failing 25.0% in 1 out of 4 builds playback.ReplayStep (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED | https://github.com/gazebosim/gz-transport/issues/195 - OPEN) (also in: "gz_transport-13-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED | https://github.com/gazebosim/gz-transport/issues/195 - OPEN) (also in: "gz_transport-12-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED | https://github.com/gazebosim/gz-transport/issues/195 - OPEN) Issue #19 in nightly_linux_coverage - Failing 8.33% in 1 out of 12 builds test_security.TestSecurePublisherSubscriberAfterShutdown.test_processes_finished_gracefully (also in: "nightly_win_rep" job) Issue #20 in nightly_linux_coverage - Failing 8.33% in 1 out of 12 builds test_security.TestSecurePublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_not_connecting_1 projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_not_connecting_0 projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_3 projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_2 projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_1 projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_0 projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_not_connecting_1 projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_not_connecting_0 projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_3 projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_2 projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_1 projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_0 Issue #21 in nightly_win_rep - Failing 7.69% in 1 out of 13 builds rcl.TestEventFixture.test_pubsub_liveliness_kill_pub projectroot.test_test_lifecycle.py lifecycle.TestLifecyclePubSub.test_talker_lifecycle ```
Crola1702 commented 6 months ago

ci.ros2.org | Hung nightlies | Investigating :detective:

Reference builds:

Given the fact that fastrtps jobs are failing, it might be a problem from fastrtps

Log output:

03:30:10.768 test/test_copyright.py .                                                 [  0%]
03:30:11.918 test/test_flake8.py .                                                    [  1%]
03:30:12.080 test/test_pep257.py .                                                    [  2%]
03:31:02.221 test/test_launch_ros/actions/test_composable_node_container.py RRF..RRFR [  5%]
03:31:22.263 RF                                                                       [  5%]
03:31:22.265 test/test_launch_ros/actions/test_lifecycle_node.py ..                   [  7%]
03:31:22.267 test/test_launch_ros/actions/test_lifecycle_transition.py ..             [  8%]
03:31:22.815 test/test_launch_ros/actions/test_load_composable_nodes.py RRERRERRERRER [ 12%]
03:31:23.239 RERRERRERRE                                                              [ 14%]
03:31:25.586 test/test_launch_ros/actions/test_node.py ..............                 [ 24%]
03:31:25.602 test/test_launch_ros/actions/test_push_ros_namespace.py ................ [ 36%]
03:31:25.606 ....
Compare build repos output: ```diff @@ -5,7 +5,7 @@ repositories: ament/ament_cmake: type: git url: https://github.com/ament/ament_cmake.git - version: dc3df2f692f75b0b4d096da68bc81da5bd73aaeb + version: cf8d4d3d3e7e50cfe552520ade264dea404f228c ament/ament_index: type: git url: https://github.com/ament/ament_index.git @@ -37,7 +37,7 @@ repositories: eProsima/Fast-DDS: type: git url: https://github.com/eProsima/Fast-DDS.git - version: f0df89d27cb4522b1e896d411210e364ce9883a6 + version: 5f65a65196dff2453ff86df711db018fefed1e54 eProsima/foonathan_memory_vendor: type: git url: https://github.com/eProsima/foonathan_memory_vendor.git @@ -69,7 +69,7 @@ repositories: ros-perception/image_common: type: git url: https://github.com/ros-perception/image_common.git - version: 3141ce5a4eafa0fce623fa9b50876eaaab14ef67 + version: 1a559edc0587dec064d095f0a711405c4d7dfb1b ros-perception/laser_geometry: type: git url: https://github.com/ros-perception/laser_geometry.git @@ -97,11 +97,11 @@ repositories: ros-visualization/python_qt_binding: type: git url: https://github.com/ros-visualization/python_qt_binding.git - version: 180f42738aca63d17561338b2b11056c08a48bc9 + version: 5408ecf63cfbeb0dbc11393b2c34df9c05b21f70 ros-visualization/qt_gui_core: type: git url: https://github.com/ros-visualization/qt_gui_core.git - version: dbc7b93c599f6e5ec78d733262c024dcd5bbee41 + version: 2b5416394be1c275d5ae3c656ab07b10bd46b6f2 ros-visualization/rqt: type: git url: https://github.com/ros-visualization/rqt.git @@ -281,7 +281,7 @@ repositories: ros2/rclcpp: type: git url: https://github.com/ros2/rclcpp.git - version: 10252e9f66ac87f3903f301b64320d32457f0658 + version: 1981e1f12acfcbdc5d9202cd3e636cb692621971 ros2/rclpy: type: git url: https://github.com/ros2/rclpy.git @@ -317,7 +317,7 @@ repositories: ros2/rmw_fastrtps: type: git url: https://github.com/ros2/rmw_fastrtps.git - version: 117c64855f3d49544c04feacdb67e8f39ae9a82a + version: e21254c78a659643828233fd019e918dc380404b ros2/rmw_implementation: type: git url: https://github.com/ros2/rmw_implementation.git @@ -345,7 +345,7 @@ repositories: ros2/rosidl: type: git url: https://github.com/ros2/rosidl.git - version: 6f6910a764316f67f64a820a45ceccee15e10022 + version: 0425e869022b36fa7c5ce30696093546edad488f ros2/rosidl_core: type: git url: https://github.com/ros2/rosidl_core.git @@ -377,7 +377,7 @@ repositories: ros2/rosidl_typesupport: type: git url: https://github.com/ros2/rosidl_typesupport.git - version: d26e38262bb26c223c0550bff8f8bfd2fac0d65e + version: d5d56e65f0efcf0aaf7aa60e63e1acb107c4211a ros2/rosidl_typesupport_fastrtps: type: git url: https://github.com/ros2/rosidl_typesupport_fastrtps.git @@ -389,7 +389,7 @@ repositories: ros2/rviz: type: git url: https://github.com/ros2/rviz.git - version: fdf195771a948d510768ec2ccb08b0c78fdc2b14 + version: ad1990bfa180f39b4cf04116438453783bb125f9 ros2/spdlog_vendor: type: git url: https://github.com/ros2/spdlog_vendor.git ```
Compare pip freeze output: ```diff @@ -141,7 +2249,7 @@ colcon-ros==0.4.1 colcon-ros-domain-id-coordinator==0.2.0 colcon-test-result==0.3.8 colcon-zsh==0.5.0 -coverage==7.4.1 +coverage==7.4.2 cryptography==3.4.8 distlib==0.3.8 docutils==0.20.1 ```
github-actions[bot] commented 6 months ago

Feb 22

Build regressions ``` nightly_linux-rhel_repeated|1811|2024-02-21 13:25:24.215000|Jenkins channel closing down (Agent disconnected)|test Hci__nightly-performance_ubuntu_jammy_amd64|207|2024-02-21 23:31:34.504000|Packages performance_test Failed|build workspace in isolation and install Rci__nightly-fastrtps-dynamic_ubuntu_jammy_amd64|725|2024-02-21 13:37:02.688000|Number of failed test exceeds the threshold|run tests gz-tools2-debbuilder|1429|2024-02-22 09:17:38.586000|Failed to compile and install build|install build dependencies from debian/control gz_common-ci-main-homebrew-amd64|24|2024-02-22 10:06:09.517000|Failed to compile and install gz-common6|install gz-common6 dependencies gz_fuel_tools-ci-main-homebrew-amd64|24|2024-02-21 23:06:17.423000|Failed to compile and install gz-fuel-tools10|install gz-fuel-tools10 dependencies gz_math-ci-main-homebrew-amd64|23|2024-02-22 03:06:14.654000|Failed to compile and install gz-math8|install gz-math8 dependencies gz_plugin-ci-main-homebrew-amd64|24|2024-02-22 06:06:06.903000|Failed to compile and install gz-plugin3|install gz-plugin3 dependencies gz_sensors-ci-main-homebrew-amd64|23|2024-02-21 23:06:17.805000|Failed to compile and install gz-sensors9|install gz-sensors9 dependencies gz_sensors-main-win|22|2024-02-22 09:06:16.272000|Jenkins channel closing down (Agent disconnected)|colcon compilation with tests for gz-sensors9 gz_sim-ci-main-homebrew-amd64|27|2024-02-21 23:06:18.293000|Failed to compile and install gz-sim9|install gz-sim9 dependencies gz_transport-ci-main-homebrew-amd64|23|2024-02-22 02:06:04.553000|Failed to compile and install gz-transport14|install gz-transport14 dependencies gz_common-ci-gz-common5-homebrew-amd64|23|2024-02-21 18:06:05.132000|Failed to compile and install gz-common5|install gz-common5 dependencies gz_rendering-ci-gz-rendering8-homebrew-amd64|24|2024-02-22 09:06:16.075000|Failed to compile and install gz-rendering8|install gz-rendering8 dependencies gz_transport-ci-gz-transport13-homebrew-amd64|23|2024-02-22 09:06:16.267000|Failed to compile and install gz-transport13|install gz-transport13 dependencies gz_common-ci-ign-common4-homebrew-amd64|25|2024-02-22 10:06:09.500000|Failed to compile and install gz-common4|install gz-common4 dependencies gz_rendering-ci-ign-rendering6-homebrew-amd64|24|2024-02-21 20:06:06.099000|Failed to compile and install gz-rendering6|install gz-rendering6 dependencies ```
Test regressions ``` Excluding 'performance, connext, fastrtps-dynamic' jobs Issue #1 in gz_transport-ci-ign-transport11-homebrew-amd64 - Failing 66.67% in 2 out of 3 builds INTEGRATION_twoProcsPubSub.test_ran (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) Issue #2 in gz_fuel_tools-8-win - Failing 25.0% in 1 out of 4 builds FuelClientTest/FuelClientDownloadTest.DownloadModel/1 Issue #3 in gz_sim-ci-ign-gazebo3-focal-amd64 - Failing 25.0% in 1 out of 4 builds ServerRepeat/AckermannSteeringTest.TfPublishes/0 (known issue in: https://github.com/gazebosim/gz-sim/issues/1993 - CLOSED) INTEGRATION_gpu_lidar.test_ran Issue #4 in gz_sim-ci-ign-gazebo6-focal-amd64 - Failing 33.33% in 1 out of 3 builds ServerRepeat/OdometryPublisherTest.GaussianNoiseTest/0 (also in: "gz_sim-ci-ign-gazebo6-homebrew-amd64" job) Issue #5 in gz_sim-8-win - Failing 20.0% in 1 out of 5 builds INTEGRATION_save_world.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) (also in: "gz_sim-main-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) (also in: "gz_sim-8-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) Issue #6 in gz_sim-ign-gazebo6-win - Failing 33.33% in 1 out of 3 builds INTEGRATION_multiple_servers.test_ran (also in: "gz_sim-main-win" job) (also in: "gz_sim-ign-gazebo6-win" job) Issue #7 in gz_transport-ci-ign-transport11-homebrew-amd64 - Failing 33.33% in 1 out of 3 builds UNIT_gz_TEST.test_ran (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) (also in: "gz_fuel_tools-ci-ign-fuel-tools7-focal-amd64" job) Issue #8 in gz_transport-ci-ign-transport11-homebrew-amd64 - Failing 33.33% in 1 out of 3 builds UNIT_Recorder_TEST.test_ran (also in: "gz_transport-ci-main-jammy-amd64" job) (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) Issue #9 in gz_transport-ci-ign-transport11-homebrew-amd64 - Failing 33.33% in 1 out of 3 builds UNIT_Node_TEST.test_ran (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) (also in: "gz_rendering-ci-ign-rendering6-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) (also in: "gz_rendering-ci-ign-rendering3-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-rendering/issues/847 - CLOSED | https://github.com/gazebosim/gz-rendering/issues/847 - OPEN) Issue #10 in gz_transport-ci-ign-transport11-homebrew-amd64 - Failing 33.33% in 1 out of 3 builds UNIT_result_TEST.test_ran UNIT_gz_src_TEST.test_ran (known issue in: https://github.com/gazebosim/gz-fuel-tools/issues/307 - CLOSED | https://github.com/gazebosim/gz-fuel-tools/issues/315 - CLOSED) UNIT_Uuid_TEST.test_ran UNIT_Utils_TEST.test_ran UNIT_TopicUtils_TEST.test_ran UNIT_TopicStorage_TEST.test_ran UNIT_TopicStatistics_TEST.test_ran UNIT_SubscribeOptions_TEST.test_ran UNIT_SqlStatement_TEST.test_ran UNIT_Registry_TEST.test_ran UNIT_QueryOptions_TEST.test_ran UNIT_QualifiedTime_TEST.test_ran UNIT_Publisher_TEST.test_ran UNIT_Playback_TEST.test_ran UNIT_ParamCommandAPI_TEST.test_ran UNIT_NodeOptions_TEST.test_ran UNIT_NetUtils_TEST.test_ran UNIT_Message_TEST.test_ran UNIT_MessageInfo_TEST.test_ran UNIT_Log_TEST.test_ran UNIT_LogCommandAPI_TEST.test_ran UNIT_Helpers_TEST.test_ran UNIT_HandlerStorage_TEST.test_ran UNIT_Discovery_TEST.test_ran UNIT_Descriptor_TEST.test_ran UNIT_Clock_TEST.test_ran UNIT_Client_TEST.test_ran UNIT_CIface_TEST.test_ran UNIT_Batch_TEST.test_ran UNIT_AdvertiseOptions_TEST.test_ran INTEGRATION_twoProcsSrvCallWithoutOutputStress.test_ran INTEGRATION_twoProcsSrvCallWithoutOutput.test_ran INTEGRATION_twoProcsSrvCallWithoutInputSync1.test_ran INTEGRATION_twoProcsSrvCallWithoutInputStress.test_ran INTEGRATION_twoProcsSrvCallWithoutInput.test_ran INTEGRATION_twoProcsSrvCallSync1.test_ran INTEGRATION_twoProcsSrvCallStress.test_ran INTEGRATION_twoProcsSrvCall.test_ran INTEGRATION_statistics.test_ran INTEGRATION_scopedTopic.test_ran INTEGRATION_recorder.test_ran INTEGRATION_query.test_ran INTEGRATION_playback.test_ran INTEGRATION_authPubSub.test_ran (also in: "gz_transport-ci-gz-transport13-homebrew-amd64" job) ```
Blast545 commented 6 months ago

Feb 22nd, broken homewbrew bottles, affecting all Gazebo CI jobs, see;

https://osrf.slack.com/archives/C04RCL0CE1H/p1708628710251089

Fixed after: https://github.com/gazebo-tooling/release-tools/pull/1118 Follow up: https://github.com/gazebo-tooling/release-tools/pull/1119

Tested on: https://build.osrfoundation.org/job/gz_physics-ci-ign-physics5-homebrew-amd64/24/ https://build.osrfoundation.org/job/gz_rendering-ci-ign-rendering6-homebrew-amd64/25/

github-actions[bot] commented 6 months ago

Feb 23

Build regressions ``` Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64|101|2024-02-22 22:26:32.594000|Number of failed test exceeds the threshold|run tests Ici__nightly-fastrtps_ubuntu_jammy_amd64|100|2024-02-23 00:17:36.224000|Number of failed test exceeds the threshold|run tests Ici__nightly-release_ubuntu_jammy_amd64|99|2024-02-23 00:19:17.504000|Number of failed test exceeds the threshold|run tests gz-tools2-debbuilder|1433|2024-02-23 09:14:13.893000|Failed to compile and install build|install build dependencies from debian/control gz_tools-ci-gz-tools2-homebrew-amd64|23|2024-02-22 18:06:08.577000|Failed to compile and install gz-tools2|install gz-tools2 dependencies gz_gui-7-win|22|2024-02-23 07:06:14.675000|Jenkins channel closing down (Agent disconnected)|colcon compilation with tests for gz-gui7 gz_math-ci-ign-math6-homebrew-amd64|23|2024-02-22 13:06:10.335000|Failed to compile and install gz-math6|install gz-math6 dependencies gz_physics-ci-ign-physics5-homebrew-amd64|23|2024-02-23 00:06:09.207000|Failed to compile and install gz-physics5|install gz-physics5 dependencies gz_transport-ci-ign-transport11-homebrew-amd64|22|2024-02-22 14:06:09.263000|Failed to compile and install gz-transport11|install gz-transport11 dependencies sdformat-ci-sdf12-homebrew-amd64|24|2024-02-22 16:06:09.889000|Failed to compile and install sdformat12|install sdformat12 dependencies ```
Test regressions ``` Excluding 'performance, connext, fastrtps-dynamic' jobs Issue #1 in nightly_win_rep - Failing 84.62% in 11 out of 13 builds rclcpp.TestGuardCondition.construction_and_destruction projectroot.test.rclcpp.test_guard_condition Issue #2 in nightly_win_rep - Failing 69.23% in 9 out of 13 builds projectroot.test.rclcpp.test_timers_manager (also in: "nightly_win_rel" job) (also in: "nightly_win_deb" job) Issue #3 in nightly_win_rep - Failing 61.54% in 8 out of 13 builds rclcpp.TestTimersManager.check_one_timer_cancel_doesnt_affect_other_timers (also in: "nightly_win_rel" job) (also in: "nightly_win_deb" job) Issue #4 in nightly_linux_repeated - Failing 30.77% in 4 out of 13 builds ros2topic.ros2topic.test.test_cli.test_cli (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED) Issue #5 in gz_fuel_tools-8-win - Failing 25.0% in 1 out of 4 builds FuelClientTest/FuelClientDownloadTest.DownloadModel/1 Issue #6 in gz_sim-ci-ign-gazebo3-focal-amd64 - Failing 25.0% in 1 out of 4 builds ServerRepeat/AckermannSteeringTest.TfPublishes/0 (known issue in: https://github.com/gazebosim/gz-sim/issues/1993 - CLOSED) INTEGRATION_gpu_lidar.test_ran Issue #7 in gz_sim-8-win - Failing 25.0% in 1 out of 4 builds INTEGRATION_save_world.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) (also in: "gz_sim-main-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) (also in: "gz_sim-ign-gazebo6-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) (also in: "gz_sim-8-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) Issue #8 in gz_sim-main-win - Failing 25.0% in 1 out of 4 builds INTEGRATION_multiple_servers.test_ran (also in: "gz_sim-ign-gazebo6-win" job) Issue #9 in nightly_linux_repeated - Failing 7.69% in 1 out of 13 builds test_rclcpp.TestTwoExecutablesAfterShutdown.test_node_name projectroot.test_node_name__rmw_fastrtps_cpp (also in: "nightly_linux-aarch64_repeated" job) Issue #10 in sdformat-ci-sdf14-homebrew-amd64 - Failing 20.0% in 1 out of 5 builds .sdformat.python.test.pyWorld_TEST .sdformat.python.test.pyVisual_TEST .sdformat.python.test.pySurface_TEST .sdformat.python.test.pySphere_TEST .sdformat.python.test.pySky_TEST .sdformat.python.test.pySensor_TEST .sdformat.python.test.pySemanticPose_TEST .sdformat.python.test.pyScene_TEST .sdformat.python.test.pyRoot_TEST .sdformat.python.test.pyProjector_TEST .sdformat.python.test.pyPrintConfig_TEST .sdformat.python.test.pyPolyline_TEST .sdformat.python.test.pyPlugin_TEST .sdformat.python.test.pyPlane_TEST .sdformat.python.test.pyPhysics_TEST .sdformat.python.test.pyPbr_TEST .sdformat.python.test.pyParticleEmitter_TEST .sdformat.python.test.pyParserConfig_TEST .sdformat.python.test.pyParam_TEST .sdformat.python.test.pyNoise_TEST .sdformat.python.test.pyNavSat_TEST .sdformat.python.test.pyModel_TEST .sdformat.python.test.pyMesh_TEST .sdformat.python.test.pyMaterial_TEST .sdformat.python.test.pyMagnetometer_TEST .sdformat.python.test.pyLink_TEST .sdformat.python.test.pyLight_TEST .sdformat.python.test.pyLidar_TEST .sdformat.python.test.pyJoint_TEST .sdformat.python.test.pyJointAxis_TEST .sdformat.python.test.pyIMU_TEST .sdformat.python.test.pyHeightmap_TEST .sdformat.python.test.pyGui_TEST .sdformat.python.test.pyGeometry_TEST .sdformat.python.test.pyFrame_TEST .sdformat.python.test.pyForceTorque_TEST .sdformat.python.test.pyError_TEST .sdformat.python.test.pyEllipsoid_TEST .sdformat.python.test.pyElement_TEST .sdformat.python.test.pyCylinder_TEST .sdformat.python.test.pyCollision_TEST .sdformat.python.test.pyCapsule_TEST .sdformat.python.test.pyCamera_TEST .sdformat.python.test.pyBox_TEST .sdformat.python.test.pyAtmosphere_TEST .sdformat.python.test.pyAltimeter_TEST .sdformat.python.test.pyAirSpeed_TEST .sdformat.python.test.pyAirPressure_TEST ```
Crola1702 commented 6 months ago

Nightly_win_rep | Flaky test regression | Investigating :detective:

Reference build: https://ci.ros2.org/view/nightly/job/nightly_win_rep/3273/#showFailuresLink

Test regressions:

Log output:

[ RUN      ] TestGuardCondition.construction_and_destruction
unknown file: error: SEH exception with code 0xc0000005 thrown in the test body.
Stack trace:

[  FAILED  ] TestGuardCondition.construction_and_destruction (0 ms)

Reported in: https://github.com/ros2/rclcpp/issues/2435

github-actions[bot] commented 6 months ago

Feb 24

Build regressions ``` nightly_linux_coverage|2290|2024-02-24 04:07:20.938000|Network error: Failed to clone github repo|import repositories nightly_linux_debug|2975|2024-02-24 04:08:01.039000|Early fail|No last section nightly_linux_humble_coverage|719|2024-02-24 04:07:59.032000|Packages shared_queues_vendor Failed|build nightly_linux_release|2992|2024-02-24 04:11:14.385000|Packages shared_queues_vendor Failed|build nightly_linux_repeated|3371|2024-02-24 04:12:17.899000|Network error: Failed to clone github repo|import repositories nightly_linux-aarch64_debug|2685|2024-02-24 04:00:01.016000|Early fail|No last section nightly_linux-aarch64_repeated|2676|2024-02-24 04:00:01.027000|Network error: Failed to clone github repo|import repositories packaging_linux-aarch64|2704|2024-02-24 04:00:01.873000|Network error: Failed to clone github repo|import repositories nightly_linux-rhel_debug|1829|2024-02-24 04:00:01.036000|Network error: Failed to clone github repo|import repositories nightly_linux-rhel_release|1811|2024-02-24 04:00:01.299000|Packages shared_queues_vendor Failed|build nightly_linux-rhel_repeated|1815|2024-02-24 04:00:01.304000|Network error: Failed to clone github repo|import repositories nightly_win_deb|3013|2024-02-24 04:00:01.855000|Network error: Failed to clone github repo|import repositories nightly_win_rel|2965|2024-02-24 04:00:01.859000|Packages libyaml_vendor Failed|build nightly_win_rep|3274|2024-02-24 04:00:01.865000|Network error: Failed to clone github repo|import repositories packaging_windows|3159|2024-02-24 04:00:01.879000|Network error: Failed to clone github repo|import repositories gz-cmake4-debbuilder|155|2024-02-24 09:13:48.356000|Unknown Reason|see Dockerfile gz-common6-debbuilder|146|2024-02-24 09:19:56.690000|Unknown Reason|see Dockerfile gz-fuel-tools10-debbuilder|149|2024-02-24 09:22:00.007000|Unknown Reason|see Dockerfile gz-gui9-debbuilder|149|2024-02-24 09:23:00.569000|Unknown Reason|see Dockerfile gz-launch8-debbuilder|141|2024-02-24 09:25:06.075000|Unknown Reason|see Dockerfile gz-math8-debbuilder|152|2024-02-24 09:18:57.190000|Unknown Reason|see Dockerfile gz-msgs11-debbuilder|152|2024-02-24 09:20:27.717000|Unknown Reason|see Dockerfile gz-physics8-debbuilder|147|2024-02-24 09:24:00.299000|Unknown Reason|see Dockerfile gz-plugin3-debbuilder|148|2024-02-24 09:19:27.350000|Unknown Reason|see Dockerfile gz-rendering9-debbuilder|148|2024-02-24 09:20:57.264000|Unknown Reason|see Dockerfile gz-sensors9-debbuilder|146|2024-02-24 09:23:30.634000|Unknown Reason|see Dockerfile gz-sim9-debbuilder|144|2024-02-24 09:24:32.151000|Unknown Reason|see Dockerfile gz-tools2-debbuilder|1437|2024-02-24 09:17:56.364000|Unknown Reason|see Dockerfile gz-tools2-debbuilder|1436|2024-02-24 09:14:24.251000|Failed to compile and install build|install build dependencies from debian/control gz-transport14-debbuilder|150|2024-02-24 09:22:29.501000|Unknown Reason|see Dockerfile gz-utils3-debbuilder|154|2024-02-24 09:18:28.440000|Unknown Reason|see Dockerfile sdformat15-debbuilder|147|2024-02-24 09:21:29.586000|Unknown Reason|see Dockerfile sdformat-ci-sdf14-homebrew-amd64|26|2024-02-24 05:33:32.832000|Early fail|No last section gz_utils-ci-ign-utils1-homebrew-amd64|24|2024-02-24 06:10:41.979000|Early fail|No last section gz_utils-ci-ign-utils1-homebrew-amd64|23|2024-02-24 04:06:08.673000|Early fail|No last section sdformat-sdf9-win|22|2024-02-24 07:06:18.391000|Jenkins channel closing down (Agent disconnected)|Compiling sdformat ```
Test regressions ``` Excluding 'performance, connext, fastrtps-dynamic' jobs Issue #1 in gz_gui-ci-ign-gui6-focal-amd64 - Failing 25.0% in 1 out of 4 builds INTEGRATION_scene3d.test_ran INTEGRATION_minimal_scene.test_ran (known issue in: https://github.com/gazebosim/gz-gui/issues/562 - CLOSED) INTEGRATION_marker_manager.test_ran INTEGRATION_camera_tracking.test_ran Issue #2 in gz_sim-8-win - Failing 33.33% in 1 out of 3 builds INTEGRATION_save_world.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) (also in: "gz_sim-main-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) (also in: "gz_sim-ign-gazebo6-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) (also in: "gz_sim-8-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) Issue #3 in gz_sim-main-win - Failing 33.33% in 1 out of 3 builds INTEGRATION_multiple_servers.test_ran (also in: "gz_sim-ign-gazebo6-win" job) ```
github-actions[bot] commented 6 months ago

Feb 25

Build regressions ``` nightly_linux-rhel_release|1812|2024-02-25 04:00:01.204000|Jenkins channel closing down (Agent disconnected)|build Hci__nightly-performance_ubuntu_jammy_amd64|208|2024-02-24 23:56:35.141000|Packages performance_test Failed|build workspace in isolation and install gz-cmake4-debbuilder|157|2024-02-25 09:48:35.609000|Unknown Reason|see Dockerfile gz-common6-debbuilder|149|2024-02-25 09:55:26.825000|Unknown Reason|see Dockerfile gz-fuel-tools10-debbuilder|151|2024-02-25 09:57:39.964000|Unknown Reason|see Dockerfile gz-gui9-debbuilder|151|2024-02-25 09:58:42.017000|Unknown Reason|see Dockerfile gz-launch8-debbuilder|143|2024-02-25 10:00:45.203000|Unknown Reason|see Dockerfile gz-math8-debbuilder|155|2024-02-25 09:54:15.855000|Unknown Reason|see Dockerfile gz-msgs11-debbuilder|155|2024-02-25 09:55:57.270000|Unknown Reason|see Dockerfile gz-physics8-debbuilder|149|2024-02-25 09:59:43.474000|Unknown Reason|see Dockerfile gz-plugin3-debbuilder|151|2024-02-25 09:54:52.664000|Unknown Reason|see Dockerfile gz-rendering9-debbuilder|150|2024-02-25 09:56:28.316000|Unknown Reason|see Dockerfile gz-sensors9-debbuilder|148|2024-02-25 09:59:12.300000|Unknown Reason|see Dockerfile gz-sim9-debbuilder|146|2024-02-25 10:00:14.236000|Unknown Reason|see Dockerfile gz-tools2-debbuilder|1440|2024-02-25 09:53:10.575000|Unknown Reason|see Dockerfile gz-tools2-debbuilder|1439|2024-02-25 09:49:10.233000|Failed to compile and install build|install build dependencies from debian/control gz-transport14-debbuilder|152|2024-02-25 09:58:11.616000|Unknown Reason|see Dockerfile gz-utils3-debbuilder|156|2024-02-25 09:53:40.986000|Unknown Reason|see Dockerfile sdformat15-debbuilder|149|2024-02-25 09:56:59.525000|Unknown Reason|see Dockerfile ```
Test regressions ``` Excluding 'performance, connext, fastrtps-dynamic' jobs Issue #1 in nightly_win_rep - Failing 75.0% in 9 out of 12 builds projectroot.test.rclcpp.test_time (known issue in: https://github.com/ros2/rclcpp/issues/2436 - OPEN) (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rclcpp/issues/2436 - OPEN) (also in: "nightly_win_deb" job) (known issue in: https://github.com/ros2/rclcpp/issues/2436 - OPEN) (also in: "Rci__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/rclcpp/issues/2436 - OPEN) Issue #2 in nightly_win_rep - Failing 25.0% in 3 out of 12 builds projectroot.test.rclcpp.test_executors (also in: "nightly_win_deb" job) (also in: "nightly_linux_repeated" job) (also in: "nightly_linux-rhel_repeated" job) (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) Issue #3 in nightly_win_rep - Failing 25.0% in 3 out of 12 builds projectroot.test.rclcpp.test_executor (also in: "nightly_win_deb" job) (also in: "nightly_linux_repeated" job) (also in: "nightly_linux_humble_coverage" job) (also in: "nightly_linux-rhel_repeated" job) (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) Issue #4 in nightly_win_rep - Failing 25.0% in 3 out of 12 builds demo_nodes_cpp.TestExecutablesTutorial.test_processes_output Issue #5 in nightly_linux_repeated - Failing 15.38% in 2 out of 13 builds rclcpp.test_executors_timer_cancel_behavior.gtest.missing_result (also in: "nightly_win_deb" job) (also in: "nightly_linux_repeated" job) (also in: "nightly_linux-rhel_repeated" job) Issue #6 in nightly_win_rep - Failing 16.67% in 2 out of 12 builds test_launch_ros.test.test_launch_ros.utilities.test_track_node_names.test_launch_nodes_with_different_names[3-3] Issue #7 in nightly_win_deb - Failing 18.18% in 2 out of 11 builds rclcpp.TestTimersManager.check_one_timer_cancel_doesnt_affect_other_timers (known issue in: https://github.com/ros2/rclcpp/issues/2436 - OPEN) projectroot.test.rclcpp.test_timers_manager (known issue in: https://github.com/ros2/rclcpp/issues/2436 - OPEN) projectroot.test.rclcpp.test_timer (known issue in: https://github.com/ros2/rclcpp/issues/2436 - OPEN) (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/rclcpp/issues/2436 - OPEN) (also in: "nightly_win_rel" job) (known issue in: https://github.com/ros2/rclcpp/issues/2436 - OPEN) (also in: "nightly_win_deb" job) (known issue in: https://github.com/ros2/rclcpp/issues/2436 - OPEN) Issue #8 in nightly_linux_repeated - Failing 15.38% in 2 out of 13 builds projectroot.test.rclcpp.test_executors_timer_cancel_behavior (also in: "nightly_win_rep" job) (also in: "nightly_win_deb" job) (also in: "nightly_linux_repeated" job) (also in: "nightly_linux-rhel_repeated" job) Issue #9 in gz_gui-ci-ign-gui6-focal-amd64 - Failing 25.0% in 1 out of 4 builds INTEGRATION_scene3d.test_ran INTEGRATION_minimal_scene.test_ran (known issue in: https://github.com/gazebosim/gz-gui/issues/562 - CLOSED) INTEGRATION_marker_manager.test_ran INTEGRATION_camera_tracking.test_ran Issue #10 in gz_sim-ign-gazebo6-win - Failing 25.0% in 1 out of 4 builds INTEGRATION_save_world.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) (also in: "gz_sim-main-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) (also in: "gz_sim-8-win" job) (known issue in: https://github.com/gazebosim/gz-sim/issues/2177 - CLOSED) Issue #11 in gz_transport-13-win - Failing 25.0% in 1 out of 4 builds playback.ReplayStep (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED | https://github.com/gazebosim/gz-transport/issues/195 - OPEN) (also in: "gz_transport-main-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED | https://github.com/gazebosim/gz-transport/issues/195 - OPEN) (also in: "gz_transport-12-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED | https://github.com/gazebosim/gz-transport/issues/195 - OPEN) Issue #12 in nightly_linux-aarch64_repeated - Failing 7.14% in 1 out of 14 builds launch_pytest.test.launch_pytest.tools.test_process.test_sync_process_tools[2-3] Issue #13 in nightly_linux-rhel_debug - Failing 7.14% in 1 out of 14 builds test_tracetools_launch.test_tracetools_launch.test.test_tracetools_launch.test_trace_action.TestTraceAction.test_action (also in: "nightly_linux_release" job) (also in: "nightly_linux-rhel_repeated" job) (also in: "nightly_linux-rhel_release" job) (also in: "nightly_linux-aarch64_debug" job) Issue #14 in nightly_linux-rhel_debug - Failing 7.14% in 1 out of 14 builds test_ros2trace.test_ros2trace.test.test_ros2trace.test_trace.TestROS2TraceCLI.test_pause_resume_stop_bad_session_name test_ros2trace.test_ros2trace.test.test_ros2trace.test_trace.TestROS2TraceCLI.test_env_var_ros_home test_ros2trace.test_ros2trace.test.test_ros2trace.test_trace.TestROS2TraceCLI.test_empty_session_name Issue #15 in nightly_linux-aarch64_repeated - Failing 7.14% in 1 out of 14 builds launch_testing_examples.launch_testing_examples.hello_world_launch_test.launch_testing_examples.hello_world_launch_test (also in: "nightly_linux-rhel_debug" job) (also in: "nightly_linux-aarch64_repeated" job) Issue #16 in nightly_linux-aarch64_debug - Failing 7.14% in 1 out of 14 builds test_tracetools_launch.test_tracetools_launch.test.test_tracetools_launch.test_trace_action.TestTraceAction.test_action_substitutions (also in: "nightly_linux-rhel_release" job) (also in: "nightly_linux-aarch64_debug" job) Issue #17 in nightly_linux-rhel_release - Failing 7.14% in 1 out of 14 builds test_ros2trace.test_ros2trace.test.test_ros2trace.test_trace.TestROS2TraceCLI.test_env_var_ros_trace_dir Issue #18 in nightly_linux-aarch64_repeated - Failing 7.14% in 1 out of 14 builds test_tracetools.test_tracetools.test.test_timer.TestTimer.test_all projectroot.test_timer (also in: "nightly_linux-rhel_release" job) (also in: "nightly_linux-aarch64_repeated" job) Issue #19 in nightly_linux-rhel_repeated - Failing 7.69% in 1 out of 13 builds test_tracetools_launch.test_tracetools_launch.test.test_tracetools_launch.test_trace_action.TestTraceAction.test_action_frontend_yaml test_ros2trace.test_ros2trace.test.test_ros2trace.test_trace.TestROS2TraceCLI.test_unknown_context_field Issue #20 in nightly_linux-rhel_repeated - Failing 7.69% in 1 out of 13 builds ros2topic.ros2topic.test.test_cli.test_cli (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED) (also in: "nightly_linux_repeated" job) (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED) Issue #21 in nightly_linux-rhel_debug - Failing 7.14% in 1 out of 14 builds launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test (also in: "nightly_linux-rhel_repeated" job) (also in: "nightly_linux-rhel_debug" job) (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job) Issue #22 in nightly_linux_release - Failing 7.14% in 1 out of 14 builds test_tracetools_launch.test_tracetools_launch.test.test_tracetools_launch.test_trace_action.TestTraceAction.test_action_ld_preload test_ros2trace.test_ros2trace.test.test_ros2trace.test_trace.TestROS2TraceCLI.test_default_tracing test_ros2trace.test_ros2trace.test.test_ros2trace.test_trace.TestROS2TraceCLI.test_default Issue #23 in nightly_linux_repeated - Failing 7.69% in 1 out of 13 builds ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[3-3] ros2cli.ros2cli.test.test_strategy.test_enforce_no_daemon[3-3] ros2cli.ros2cli.test.test_strategy.test_enforce_no_daemon[2-3] ros2cli.ros2cli.test.test_strategy.test_enforce_no_daemon[1-3] Issue #24 in nightly_linux-aarch64_repeated - Failing 7.14% in 1 out of 14 builds test_tracetools.test_tracetools.test.test_lifecycle_node.TestLifecycleNode.test_all projectroot.test_lifecycle_node (also in: "nightly_linux_repeated" job) (also in: "nightly_linux-rhel_repeated" job) (also in: "nightly_linux-aarch64_repeated" job) Issue #25 in nightly_win_deb - Failing 9.09% in 1 out of 11 builds test_rclcpp.test_subscription.subscription_and_spinning test_msgs.cpplint_rosidl_generated_cpp.xunit.missing_result rosidl_generator_tests.cpplint_rosidl_generated_cpp.xunit.missing_result projectroot.cpplint_rosidl_generated_cpp Issue #26 in nightly_win_rel - Failing 7.14% in 1 out of 14 builds launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job) Issue #27 in nightly_win_rep - Failing 8.33% in 1 out of 12 builds rclcpp.test_executor.gtest.missing_result (also in: "nightly_linux_humble_coverage" job) Issue #28 in nightly_win_rep - Failing 8.33% in 1 out of 12 builds rclcpp.TestSubscription.on_new_message_callback (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job) Issue #29 in nightly_win_rep - Failing 8.33% in 1 out of 12 builds rclcpp.TestTimeSource.clock projectroot.test.rclcpp.test_time_source (also in: "Rci__nightly-connext_ubuntu_jammy_amd64" job) Issue #30 in nightly_win_rep - Failing 8.33% in 1 out of 12 builds projectroot.test.rclcpp.test_subscription_topic_statistics (also in: "Rci__nightly-connext_ubuntu_jammy_amd64" job) Issue #31 in nightly_win_rep - Failing 8.33% in 1 out of 12 builds projectroot.test.rclcpp.test_subscription (also in: "Rci__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job) Issue #32 in nightly_win_rep - Failing 8.33% in 1 out of 12 builds test_security.TestInitializationFails/TestSecureNodes.test_invalid_keystore/test_invalid_cert (test_invalid_cert) rclpy.test_action_server.xunit.missing_result rclcpp.TestWaitSet.add_remove_wait rclcpp.TestWaitSet.add_guard_condition_to_two_different_wait_set rclcpp.TestUtilities.wait_for_message_twice_one_sub rclcpp.TestUtilities.wait_for_message_indefinitely rclcpp.TestUtilities.wait_for_message rclcpp.TestTypeSupport.test_service_ts_set_params_srv rclcpp.TestTypeSupport.test_service_ts_set_params_atomically_srv rclcpp.TestTypeSupport.test_service_ts_list_params_srv rclcpp.TestTypeSupport.test_service_ts_get_params_srv_type rclcpp.TestTypeSupport.test_service_ts_get_params_srv rclcpp.TestTypeSupport.test_service_ts_get_parameters_types_srv rclcpp.TestTypeSupport.test_service_ts_describe_params_srv rclcpp.TestTypeSupport.basic_getters rclcpp.TestTimerCancelBehavior/SingleThreadedExecutor.testTimer2CancelledWithExecutorSpin rclcpp.TestTimerCancelBehavior/SingleThreadedExecutor.testTimer1CancelledWithExecutorSpin rclcpp.TestTimerCancelBehavior/SingleThreadedExecutor.testHeadTimerCancelThenResetBehavior rclcpp.TestTimerCancelBehavior/SingleThreadedExecutor.testBothTimerCancelThenResetT2Behavior rclcpp.TestTimerCancelBehavior/SingleThreadedExecutor.testBothTimerCancelThenResetT1Behavior rclcpp.TestTimerCancelBehavior/SingleThreadedExecutor.testBackTimerCancelThenResetBehavior rclcpp.TestTimeSource.reattach rclcpp.TestTimeSource.parameter_activation rclcpp.TestTimeSource.no_pre_jump_callback rclcpp.TestTimeSource.detachUnattached rclcpp.TestTimeSource.clock_sleep_until_with_ros_time_basic rclcpp.TestTimeSource.check_use_clock_thread_value rclcpp.TestTimeSource.check_clock_thread_status rclcpp.TestTimeSource.callbacks rclcpp.TestTimeSource.callback_handler_erasure rclcpp.TestTimeSource.ROS_time_valid_wall_time rclcpp.TestTimeSource.ROS_time_valid_sim_time rclcpp.TestTimeSource.ROS_time_valid_attach_detach rclcpp.TestTimeSource.ROS_invalid_sim_time rclcpp.TestThreadSafeStorage.wait_waitable rclcpp.TestThreadSafeStorage.wait_timer rclcpp.TestThreadSafeStorage.wait_subscription rclcpp.TestThreadSafeStorage.wait_client_service rclcpp.TestThreadSafeStorage.iterables_construct_destruct rclcpp.TestThreadSafeStorage.default_construct_destruct rclcpp.TestThreadSafeStorage.add_remove_out_of_scope rclcpp.TestThreadSafeStorage.add_remove_nullptr rclcpp.TestThreadSafeStorage.add_remove_dynamically rclcpp.TestSubscriptionTopicStatisticsFixture.test_invalid_publish_period rclcpp.TestSubscriptionPublisherCount/one_context_test.increasing_and_decreasing_counts rclcpp.TestSubscriptionOptions.topic_statistics_options_node_default_mode rclcpp.TestSubscription.various_creation_signatures rclcpp.TestSubscription.take_serialized rclcpp.TestSubscription.take rclcpp.TestSubscription.rcl_take_type_erased_error rclcpp.TestSubscription.rcl_take_serialized_message_error rclcpp.TestSubscription.rcl_subscription_init_error rclcpp.TestSubscription.rcl_subscription_get_publisher_count_error rclcpp.TestSubscription.rcl_subscription_get_actual_qos_error rclcpp.TestSubscription.rcl_subscription_fini_error rclcpp.TestSubscription.on_new_intra_process_message_callback rclcpp.TestSubscription.handle_loaned_message rclcpp.TestSubscription.get_network_flow_endpoints_errors rclcpp.TestSubscription.construction_and_destruction rclcpp.TestSubscription.callback_bind rclcpp.TestStoragePolicyCommon.rcl_wait_set_resize_error rclcpp.TestStoragePolicyCommon.rcl_wait_set_fini_error rclcpp.TestStoragePolicyCommon.rcl_wait_set_clear_error rclcpp.TestStoragePolicyCommon.rcl_wait_set_add_timer_error rclcpp.TestStoragePolicyCommon.rcl_wait_set_add_subscription_error rclcpp.TestStoragePolicyCommon.rcl_wait_set_add_service_error rclcpp.TestStoragePolicyCommon.rcl_wait_set_add_guard_condition_error rclcpp.TestStoragePolicyCommon.rcl_wait_set_add_client_error rclcpp.TestStoragePolicyCommon.add_waitable_error rclcpp.TestStaticStorage.wait_waitable rclcpp.TestStaticStorage.wait_timer rclcpp.TestStaticStorage.wait_subscription rclcpp.TestStaticStorage.wait_guard_condition rclcpp.TestStaticStorage.wait_client_service rclcpp.TestStaticStorage.iterables_construct_destruct rclcpp.TestStaticStorage.fixed_storage_needs_pruning rclcpp.TestStaticSingleThreadedExecutor.add_callback_group_trigger_guard_failed rclcpp.TestStaticExecutorEntitiesCollector.add_remove_node rclcpp.TestRosoutSubscription.test_rosoutsubscription_parent_log rclcpp.TestRosoutSubscription.test_rosoutsubscription_node_rosout_disabled rclcpp.TestRosoutSubscription.test_rosoutsubscription_getchild_hierarchy rclcpp.TestRosoutSubscription.test_rosoutsubscription_getchild rclcpp.TestRosoutSubscription.test_rosoutsubscription_child_log rclcpp.TestMultiThreadedExecutor.timer_over_take rclcpp.TestLoggerService.check_connect_get_logger_service rclcpp.TestLogger.get_node_logger rclcpp.TestIntraprocessExecutors/SingleThreadedExecutor.testIntraprocessRetrigger rclcpp.TestInterfaceTraits.has_node_base_interface rclcpp.TestGraphListener.construction_and_destruction rclcpp.TestFindWeakNodes.allocator_strategy_with_weak_nodes rclcpp.TestFindWeakNodes.allocator_strategy_no_weak_nodes rclcpp.TestExternallyDefinedServices.extern_defined_uninitialized rclcpp.TestExternallyDefinedServices.extern_defined_initialized rclcpp.TestExternallyDefinedServices.extern_defined_destructor rclcpp.TestExternallyDefinedServices.default_behavior rclcpp.TestExecutors/SingleThreadedExecutor.detachOnDestruction rclcpp.TestExecutorNotifyWaitable.add_remove_guard_conditions rclcpp.TestExecutorEntitiesCollector.add_remove_node rclcpp.TestEventsExecutor.run_pub_sub rclcpp.TestDynamicStorage.wait_waitable rclcpp.TestDynamicStorage.wait_timer rclcpp.TestDynamicStorage.wait_subscription rclcpp.TestDynamicStorage.wait_client_service rclcpp.TestDynamicStorage.iterables_construct_destruct rclcpp.TestDynamicStorage.default_construct_destruct rclcpp.TestDynamicStorage.add_remove_out_of_scope rclcpp.TestDynamicStorage.add_remove_nullptr rclcpp.TestDynamicStorage.add_remove_dynamically rclcpp.TestContentFilterSubscription.set_content_filter_error rclcpp.TestContentFilterSubscription.set_content_filter rclcpp.TestContentFilterSubscription.is_cft_enabled rclcpp.TestContentFilterSubscription.get_content_filter_error rclcpp.TestContentFilterSubscription.get_content_filter rclcpp.TestContentFilterSubscription.content_filter_reset rclcpp.TestContentFilterSubscription.content_filter_get_later rclcpp.TestContentFilterSubscription.content_filter_get_begin rclcpp.TestClockSleep.bad_clock_type rclcpp.PerTimerType/TestTimer.test_simple_cancel/wall_timer (4-byte object <00-00 00-00>) projectroot.test_security_nodes_c__rmw_fastrtps_cpp projectroot.test_action_server projectroot.test.rclcpp.test_wait_set projectroot.test.rclcpp.test_wait_for_message projectroot.test.rclcpp.test_type_support projectroot.test.rclcpp.test_thread_safe_synchronization projectroot.test.rclcpp.test_subscription_publisher_count_api projectroot.test.rclcpp.test_subscription_options projectroot.test.rclcpp.test_subscription_content_filter__rmw_fastrtps_cpp projectroot.test.rclcpp.test_storage_policy_common projectroot.test.rclcpp.test_static_storage projectroot.test.rclcpp.test_static_single_threaded_executor projectroot.test.rclcpp.test_static_executor_entities_collector projectroot.test.rclcpp.test_rosout_subscription projectroot.test.rclcpp.test_multi_threaded_executor projectroot.test.rclcpp.test_logger_service projectroot.test.rclcpp.test_logger projectroot.test.rclcpp.test_interface_traits projectroot.test.rclcpp.test_graph_listener projectroot.test.rclcpp.test_find_weak_nodes projectroot.test.rclcpp.test_externally_defined_services projectroot.test.rclcpp.test_executors_intraprocess projectroot.test.rclcpp.test_executor_notify_waitable projectroot.test.rclcpp.test_events_executor projectroot.test.rclcpp.test_entities_collector projectroot.test.rclcpp.test_dynamic_storage ```