Jul 15

Build regressions

``` job_name|build_number|build_datetime|failure_reason|last_section nightly_linux_coverage|2460|2024-07-15 04:00:56.950000|Early fail|No last section nightly_linux_humble_coverage|862|2024-07-15 04:01:11.480000|Early fail|No last section nightly_linux_iron_coverage|496|2024-07-15 04:01:26.326000|Early fail|No last section nightly_linux_release|3139|2024-07-15 04:02:11.777000|Early fail|No last section nightly_linux_repeated|3519|2024-07-15 04:02:33.796000|Early fail|No last section packaging_linux|3504|2024-07-15 04:03:23.237000|Early fail|No last section nightly_linux-aarch64_repeated|2820|2024-07-15 04:00:01.448000|Jenkins channel closing down (Agent disconnected)|test nightly_linux-rhel_release|1957|2024-07-15 04:00:01.458000|Early fail|No last section packaging_linux-rhel|2005|2024-07-15 04:03:35.504000|Early fail|No last section nightly_win_rep|3416|2024-07-15 04:00:01.480000|Number of failed test exceeds the threshold|test ```

Test regressions

``` Excluding 'performance, connext, fastrtps-dynamic' jobs Issue #1 in nightly_linux-rhel_repeated - Failing 43.75% in 7 out of 16 builds (also in: "nightly_linux-aarch64_repeated" job) (also in: "nightly_linux-rhel_repeated" job) (also in: "nightly_linux_repeated" job) (also in: "nightly_win_rep" job) test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3] test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3] Issue #2 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64 - Failing 100.0% in 5 out of 5 builds (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job) (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job) (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) (also in: "nightly_linux-rhel_debug" job) (also in: "nightly_linux-rhel_release" job) (also in: "nightly_linux-rhel_repeated" job) (also in: "nightly_linux_repeated" job) test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all Issue #3 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64 - Failing 100.0% in 5 out of 5 builds (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED) (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED) (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED) (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED) projectroot.test_publisher (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED) projectroot.test_subscription Issue #4 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64 - Failing 100.0% in 5 out of 5 builds (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job) (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job) projectroot.test_pub_sub test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all Issue #5 in nightly_win_deb - Failing 35.71% in 5 out of 14 builds (also in: "nightly_win_rep" job) projectroot.test_tutorial_use_logger_service__rmw_connextdds Issue #6 in Hci__nightly-connext_ubuntu_jammy_amd64 - Failing 60.0% in 3 out of 5 builds (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "nightly_linux-aarch64_repeated" job) test_tf2.BufferClientTestAfterShutdown.test_exit_code Issue #7 in Hci__nightly-connext_ubuntu_jammy_amd64 - Failing 100.0% in 3 out of 3 builds projectroot.test.rclcpp.test_qos_event rclcpp.TestQosEvent.test_invalid_on_new_event_callback rclcpp.TestQosEvent.test_on_new_event_callback Issue #8 in Ici__nightly-connext_ubuntu_jammy_amd64 - Failing 100.0% in 3 out of 3 builds (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "nightly_linux-aarch64_repeated" job) (also in: "nightly_win_rep" job) launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test Issue #9 in Ici__nightly-connext_ubuntu_jammy_amd64 - Failing 100.0% in 3 out of 3 builds (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test Issue #10 in Ici__nightly-connext_ubuntu_jammy_amd64 - Failing 100.0% in 3 out of 3 builds (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "nightly_linux-aarch64_debug" job) (also in: "nightly_linux-aarch64_repeated" job) (also in: "nightly_linux-rhel_repeated" job) (also in: "nightly_linux_repeated" job) launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test Issue #11 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64 - Failing 100.0% in 3 out of 3 builds projectroot.test_generic_subscription test_tracetools.test_tracetools.test.test_generic_subscription.TestGenericSubscription.test_all Issue #12 in Jci__nightly-release_ubuntu_noble_amd64 - Failing 100.0% in 3 out of 3 builds 1 clang-tidy warnings 1 gcc warnings Issue #13 in Rci__nightly-connext_ubuntu_noble_amd64 - Failing 100.0% in 3 out of 3 builds (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset Issue #14 in Rci__nightly-connext_ubuntu_noble_amd64 - Failing 100.0% in 3 out of 3 builds (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) (also in: "nightly_win_rep" job) projectroot.test.rclcpp.test_subscription_topic_statistics Issue #15 in gz_transport-ci-gz-transport12-homebrew-amd64 - Failing 60.0% in 3 out of 5 builds UNIT_gz_TEST.xml.[failed-to-read] Issue #16 in Hci__nightly-connext_ubuntu_jammy_amd64 - Failing 40.0% in 2 out of 5 builds (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) projectroot.test_buffer_client_tester.launch.py Issue #17 in Ici__nightly-performance_ubuntu_jammy_amd64 - Failing 100.0% in 2 out of 2 builds (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job) 4 cmake warnings performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23) projectroot.lint_cmake Issue #18 in Jci__nightly-connext_ubuntu_noble_amd64 - Failing 40.0% in 2 out of 5 builds (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) projectroot.test.rclcpp.test_service_introspection rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events Issue #19 in Rci__benchmark_ubuntu_noble_amd64 - Failing 100.0% in 2 out of 2 builds (also in: "Jci__benchmark_ubuntu_noble_amd64" job) projectroot.benchmark_string_conversions Issue #20 in Rci__nightly-performance_ubuntu_noble_amd64 - Failing 100.0% in 2 out of 2 builds (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job) (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job) (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job) projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m Issue #21 in Rci__nightly-performance_ubuntu_noble_amd64 - Failing 100.0% in 2 out of 2 builds (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job) (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job) (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job) projectroot.test.test_performance_CycloneDDS_sync_Array8m Issue #22 in Rci__nightly-performance_ubuntu_noble_amd64 - Failing 100.0% in 2 out of 2 builds (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job) (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job) (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job) buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS Issue #23 in Rci__nightly-performance_ubuntu_noble_amd64 - Failing 100.0% in 2 out of 2 builds (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job) 2 cmake warnings Issue #24 in Rci__nightly-performance_ubuntu_noble_amd64 - Failing 100.0% in 2 out of 2 builds (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job) (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job) (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job) 2 clang-tidy warnings 30 gcc warnings performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19) performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp projectroot.cpplint (known issue in: https://github.com/ros2/rosidl/issues/790 - CLOSED) projectroot.uncrustify Issue #25 in gz_transport-ci-ign-transport11-homebrew-amd64 - Failing 40.0% in 2 out of 5 builds ignTest.TopicInfo Issue #26 in nightly_linux-rhel_repeated - Failing 12.5% in 2 out of 16 builds (also in: "nightly_win_rel" job) rclcpp.TestAddCallbackGroupsToExecutorStable/SingleThreadedExecutor.subscriber_triggered_to_receive_message Issue #27 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64 - Failing 33.33% in 1 out of 3 builds (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) (also in: "nightly_linux-rhel_debug" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) (also in: "nightly_linux-rhel_release" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) (also in: "nightly_linux-rhel_repeated" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) (also in: "nightly_linux_coverage" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) (also in: "nightly_linux_debug" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) (also in: "nightly_linux_release" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) (also in: "nightly_linux_repeated" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) Issue #28 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64 - Failing 33.33% in 1 out of 3 builds (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) projectroot.test_generic_pub_sub (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) Issue #29 in Rci__nightly-connext_ubuntu_noble_amd64 - Failing 20.0% in 1 out of 5 builds (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) rclpy.rclpy.test.test_client.TestClient.test_service_timestamps Issue #30 in Rci__nightly-connext_ubuntu_noble_amd64 - Failing 20.0% in 1 out of 5 builds (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) (also in: "nightly_win_deb" job) (also in: "nightly_win_rep" job) projectroot.test_client Issue #31 in gz_gui-ci-ign-gui6-focal-amd64 - Failing 25.0% in 1 out of 4 builds UNIT_Publisher_TEST.test_ran UNIT_Screenshot_TEST.test_ran UNIT_ShutdownButton_TEST.test_ran Issue #32 in gz_sensors-ci-main-homebrew-amd64 - Failing 14.29% in 1 out of 7 builds DopplerVelocityLogTests/DopplerVelocityLogTest.BottomTrackingWhileInMotion/ogre Issue #33 in gz_sim-ci-main-homebrew-amd64 - Failing 16.67% in 1 out of 6 builds (also in: "gz_sim-main-win" job) INTEGRATION_mesh_inertia_calculation.test_ran Issue #34 in gz_sim-ci-main-homebrew-amd64 - Failing 16.67% in 1 out of 6 builds INTEGRATION_ackermann_steering_system.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED) INTEGRATION_acoustic_comms.test_ran INTEGRATION_battery_plugin.test_ran INTEGRATION_breadcrumbs.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED) INTEGRATION_buoyancy.test_ran INTEGRATION_environment_preload_system.test_ran INTEGRATION_force_torque_system.test_ran INTEGRATION_joint_controller_system.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED) INTEGRATION_joint_position_controller_system.test_ran INTEGRATION_joint_trajectory_controller_system.test_ran INTEGRATION_level_manager.test_ran INTEGRATION_level_manager_runtime_performers.test_ran INTEGRATION_multicopter.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED) INTEGRATION_physics_system.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED) INTEGRATION_recreate_entities.test_ran INTEGRATION_scene_broadcaster_system.test_ran INTEGRATION_sdf_frame_semantics.test_ran INTEGRATION_thermal_system.test_ran INTEGRATION_thruster.test_ran INTEGRATION_touch_plugin.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED) INTEGRATION_tracked_vehicle_system.test_ran INTEGRATION_user_commands.test_ran INTEGRATION_wheel_slip.test_ran PERFORMANCE_level_manager.test_ran UNIT_ModelCommandAPI_TEST.test_ran UNIT_Server_TEST.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2282 - CLOSED) UNIT_SimulationRunner_TEST.test_ran Issue #35 in gz_sim-ign-gazebo6-win - Failing 20.0% in 1 out of 5 builds 3 msbuild warnings Issue #36 in nightly_linux-rhel_repeated - Failing 6.25% in 1 out of 16 builds (also in: "nightly_win_rel" job) rclcpp.TestAddCallbackGroupsToExecutorStable/EventsExecutor.subscriber_triggered_to_receive_message Issue #37 in nightly_linux-rhel_repeated - Failing 7.69% in 1 out of 13 builds (also in: "nightly_linux_repeated" job) (also in: "nightly_win_rel" job) projectroot.test.rclcpp.test_add_callback_groups_to_executor__rmw_connextdds Issue #38 in sdformat-ci-main-homebrew-amd64 - Failing 20.0% in 1 out of 5 builds 7 clang warnings ```

Sdformat Main | Warnings | Investigating :detective:

Reference build: https://build.osrfoundation.org/job/sdformat-ci-main-homebrew-amd64/187/

Warnings:

FrameSemantics.cc: 'NullVertex' is deprecated.

Makes reference to this file: https://github.com/gazebosim/sdformat/blob/main/src/FrameSemantics.cc.

Should be fixed after: https://github.com/gazebosim/sdformat/pull/1458

Jul 16

Build regressions

Test regressions

``` Excluding 'performance, connext, fastrtps-dynamic' jobs Issue #1 in nightly_linux-rhel_repeated - Failing 50.0% in 8 out of 16 builds (also in: "nightly_linux-aarch64_repeated" job) (also in: "nightly_linux-rhel_repeated" job) (also in: "nightly_linux_repeated" job) (also in: "nightly_win_rep" job) test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3] test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3] Issue #2 in nightly_linux_iron_coverage - Failing 42.86% in 6 out of 14 builds test_tracetools.test_tracetools.test.test_timer.TestTimer.test_all Issue #3 in nightly_win_rel - Failing 42.86% in 6 out of 14 builds (also in: "nightly_linux_iron_coverage" job) (also in: "nightly_win_rel" job) (also in: "nightly_win_rep" job) projectroot.test_timer Issue #4 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64 - Failing 100.0% in 5 out of 5 builds (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job) (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job) (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) (also in: "nightly_linux-rhel_debug" job) (also in: "nightly_linux-rhel_release" job) (also in: "nightly_linux-rhel_repeated" job) (also in: "nightly_linux_repeated" job) test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all Issue #5 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64 - Failing 100.0% in 5 out of 5 builds (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED) (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED) (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED) (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED) projectroot.test_publisher (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED) Issue #6 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64 - Failing 100.0% in 5 out of 5 builds (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job) (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job) projectroot.test_pub_sub test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all Issue #7 in nightly_win_rel - Failing 100.0% in 5 out of 5 builds (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job) (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job) (also in: "nightly_win_rel" job) (also in: "nightly_win_rep" job) projectroot.test_subscription Issue #8 in gz_transport-ci-gz-transport12-homebrew-amd64 - Failing 66.67% in 4 out of 6 builds UNIT_gz_TEST.xml.[failed-to-read] Issue #9 in Hci__nightly-connext_ubuntu_jammy_amd64 - Failing 60.0% in 3 out of 5 builds (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "nightly_linux-aarch64_repeated" job) test_tf2.BufferClientTestAfterShutdown.test_exit_code Issue #10 in Hci__nightly-connext_ubuntu_jammy_amd64 - Failing 100.0% in 3 out of 3 builds projectroot.test.rclcpp.test_qos_event rclcpp.TestQosEvent.test_invalid_on_new_event_callback rclcpp.TestQosEvent.test_on_new_event_callback Issue #11 in Ici__nightly-connext_ubuntu_jammy_amd64 - Failing 100.0% in 3 out of 3 builds (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test Issue #12 in Ici__nightly-connext_ubuntu_jammy_amd64 - Failing 100.0% in 3 out of 3 builds (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "nightly_linux-aarch64_debug" job) (also in: "nightly_linux-aarch64_repeated" job) (also in: "nightly_linux-rhel_repeated" job) (also in: "nightly_linux_repeated" job) launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test Issue #13 in Ici__nightly-performance_ubuntu_jammy_amd64 - Failing 100.0% in 3 out of 3 builds (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job) 4 cmake warnings performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23) projectroot.lint_cmake Issue #14 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64 - Failing 100.0% in 3 out of 3 builds projectroot.test_generic_subscription test_tracetools.test_tracetools.test.test_generic_subscription.TestGenericSubscription.test_all Issue #15 in Rci__nightly-connext_ubuntu_noble_amd64 - Failing 100.0% in 3 out of 3 builds (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset Issue #16 in Rci__nightly-connext_ubuntu_noble_amd64 - Failing 100.0% in 3 out of 3 builds (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) (also in: "nightly_win_rep" job) projectroot.test.rclcpp.test_subscription_topic_statistics Issue #17 in Rci__nightly-performance_ubuntu_noble_amd64 - Failing 100.0% in 3 out of 3 builds (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job) (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job) (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job) 2 clang-tidy warnings 30 gcc warnings performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19) performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp projectroot.cpplint (known issue in: https://github.com/ros2/rosidl/issues/790 - CLOSED) projectroot.uncrustify Issue #18 in gz_sim-ci-main-homebrew-amd64 - Failing 42.86% in 3 out of 7 builds INTEGRATION_ackermann_steering_system.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED) INTEGRATION_acoustic_comms.test_ran INTEGRATION_battery_plugin.test_ran INTEGRATION_breadcrumbs.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED) INTEGRATION_buoyancy.test_ran INTEGRATION_environment_preload_system.test_ran INTEGRATION_force_torque_system.test_ran INTEGRATION_joint_controller_system.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED) INTEGRATION_joint_position_controller_system.test_ran INTEGRATION_joint_trajectory_controller_system.test_ran INTEGRATION_level_manager.test_ran INTEGRATION_level_manager_runtime_performers.test_ran INTEGRATION_multicopter.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED) INTEGRATION_physics_system.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED) INTEGRATION_recreate_entities.test_ran INTEGRATION_scene_broadcaster_system.test_ran INTEGRATION_sdf_frame_semantics.test_ran INTEGRATION_thermal_system.test_ran INTEGRATION_thruster.test_ran INTEGRATION_touch_plugin.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED) INTEGRATION_tracked_vehicle_system.test_ran INTEGRATION_user_commands.test_ran INTEGRATION_wheel_slip.test_ran PERFORMANCE_level_manager.test_ran UNIT_ModelCommandAPI_TEST.test_ran UNIT_Server_TEST.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2282 - CLOSED) UNIT_SimulationRunner_TEST.test_ran Issue #19 in gz_transport-ci-ign-transport11-homebrew-amd64 - Failing 60.0% in 3 out of 5 builds ignTest.TopicInfo Issue #20 in nightly_linux-aarch64_repeated - Failing 18.75% in 3 out of 16 builds projectroot.test_transport_py rosbag2_py.test_transport_py.xunit.missing_result Issue #21 in nightly_linux-aarch64_repeated - Failing 100.0% in 3 out of 3 builds (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "nightly_linux-aarch64_repeated" job) (also in: "nightly_win_rep" job) launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test Issue #22 in nightly_linux_release - Failing 100.0% in 3 out of 3 builds (also in: "Jci__nightly-release_ubuntu_noble_amd64" job) (also in: "Rci__nightly-release_ubuntu_noble_amd64" job) (also in: "nightly_linux-aarch64_release" job) (also in: "nightly_linux_release" job) 1 clang-tidy warnings 1 gcc warnings Issue #23 in Hci__nightly-connext_ubuntu_jammy_amd64 - Failing 40.0% in 2 out of 5 builds (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) projectroot.test_buffer_client_tester.launch.py Issue #24 in Rci__benchmark_ubuntu_noble_amd64 - Failing 100.0% in 2 out of 2 builds (also in: "Jci__benchmark_ubuntu_noble_amd64" job) projectroot.benchmark_string_conversions Issue #25 in Rci__nightly-connext_ubuntu_noble_amd64 - Failing 66.67% in 2 out of 3 builds (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content Issue #26 in Rci__nightly-connext_ubuntu_noble_amd64 - Failing 40.0% in 2 out of 5 builds (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) projectroot.test.rclcpp.test_service_introspection rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events Issue #27 in Rci__nightly-performance_ubuntu_noble_amd64 - Failing 66.67% in 2 out of 3 builds (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job) (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job) (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job) projectroot.test.test_performance_CycloneDDS_sync_Array8m Issue #28 in Rci__nightly-performance_ubuntu_noble_amd64 - Failing 66.67% in 2 out of 3 builds (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job) (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job) (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job) (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job) buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m Issue #29 in Rci__nightly-performance_ubuntu_noble_amd64 - Failing 100.0% in 2 out of 2 builds (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job) 2 cmake warnings Issue #30 in nightly_linux-rhel_repeated - Failing 12.5% in 2 out of 16 builds test_cli_remapping.TestCLIRemapping.test_node_name_replacement[/home/jenkins-agent/workspace/nightly_linux-rhel_repeated/ws/build/test_cli_remapping/name_maker_rclcpp] Issue #31 in nightly_linux-rhel_repeated - Failing 12.5% in 2 out of 16 builds projectroot.test_record__rmw_fastrtps_cpp rosbag2_transport.RecordIntegrationTestFixture.can_record_again_after_stop Issue #32 in Jci__nightly-connext_ubuntu_noble_amd64 - Failing 20.0% in 1 out of 5 builds (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) rclpy.rclpy.test.test_client.TestClient.test_service_timestamps Issue #33 in Jci__nightly-connext_ubuntu_noble_amd64 - Failing 20.0% in 1 out of 5 builds (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) (also in: "nightly_win_deb" job) (also in: "nightly_win_rep" job) projectroot.test_client Issue #34 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64 - Failing 33.33% in 1 out of 3 builds (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) (also in: "nightly_linux-rhel_debug" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) (also in: "nightly_linux-rhel_release" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) (also in: "nightly_linux-rhel_repeated" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) (also in: "nightly_linux_coverage" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) (also in: "nightly_linux_repeated" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) Issue #35 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64 - Failing 33.33% in 1 out of 3 builds (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) projectroot.test_generic_pub_sub (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED) Issue #36 in gz_sim-8-win - Failing 20.0% in 1 out of 5 builds ServerRepeat/MultipleServers.TwoServersMixedBlocking/0 Issue #37 in gz_sim-ci-gz-sim7-homebrew-amd64 - Failing 20.0% in 1 out of 5 builds ServerRepeat/OdometryPublisherTest.MovementCustomTopic/0 Issue #38 in gz_sim-ci-main-homebrew-amd64 - Failing 20.0% in 1 out of 5 builds (also in: "gz_sim-main-win" job) INTEGRATION_mesh_inertia_calculation.test_ran Issue #39 in gz_sim-ci-main-noble-amd64 - Failing 20.0% in 1 out of 5 builds .ResetFixture ResetFixture.HandleReset Issue #40 in nightly_linux-aarch64_repeated - Failing 6.25% in 1 out of 16 builds (also in: "nightly_linux-rhel_repeated" job) (also in: "nightly_linux_repeated" job) projectroot.test_node_name__rmw_fastrtps_cpp test_rclcpp.test_node_name__rmw_fastrtps_cpp.xunit.missing_result Issue #41 in nightly_linux-rhel_repeated - Failing 6.25% in 1 out of 16 builds test_tracetools.test_pub_sub__rmw_connextdds.xunit.missing_result Issue #42 in nightly_linux-rhel_repeated - Failing 6.25% in 1 out of 16 builds (also in: "nightly_linux-aarch64_repeated" job) (also in: "nightly_win_rep" job) ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3] Issue #43 in nightly_linux-rhel_repeated - Failing 9.09% in 1 out of 11 builds (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) (also in: "nightly_linux-rhel_debug" job) (also in: "nightly_linux-rhel_release" job) (also in: "nightly_linux_repeated" job) projectroot.test_pub_sub__rmw_connextdds Issue #44 in nightly_linux-rhel_repeated - Failing 6.25% in 1 out of 16 builds (also in: "nightly_win_rel" job) (also in: "nightly_win_rep" job) projectroot.test_cli_remapping Issue #45 in nightly_linux_release - Failing 6.25% in 1 out of 16 builds (also in: "nightly_linux-aarch64_release" job) (also in: "nightly_linux_release" job) 1 clang warnings Issue #46 in nightly_win_deb - Failing 7.69% in 1 out of 13 builds projectroot.test.test_timer__rmw_cyclonedds_cpp projectroot.test.test_timer__rmw_fastrtps_cpp rcl.TestPreInitTimer.test_timer_info rcl.TestPreInitTimer.test_timer_info_detect_overrun Issue #47 in nightly_win_rel - Failing 7.69% in 1 out of 13 builds (also in: "nightly_win_deb" job) (also in: "nightly_win_rep" job) test_rclcpp.test_multithreaded.multi_access_publisher Issue #48 in nightly_win_rel - Failing 6.25% in 1 out of 16 builds ros2cli.ros2cli.test.test_strategy.test_with_daemon_running Issue #49 in nightly_win_rel - Failing 7.69% in 1 out of 13 builds (also in: "nightly_win_rep" job) projectroot.test_time_source projectroot.test_wait_for_message projectroot.test_waitable rclpy.test_subscription.xunit.missing_result rclpy.test_time_source.xunit.missing_result rclpy.test_timer.xunit.missing_result rclpy.test_wait_for_message.xunit.missing_result rclpy.test_waitable.xunit.missing_result Issue #50 in nightly_win_rel - Failing 6.25% in 1 out of 16 builds (also in: "nightly_linux-rhel_repeated" job) (also in: "nightly_win_deb" job) (also in: "nightly_win_rep" job) projectroot.gtest_multithreaded__rmw_connextdds ```

Nightly Windows Repeated | Build regression | Investigating :detective:

Reference build: https://ci.ros2.org/view/nightly/job/nightly_win_rep/3417/

Log output:

Windows fatal exception: access violation
...
unknown file: error: SEH exception with code 0xc0000005 thrown in the test body.

There are three consistent failures in windows repeated by today. The output appears in different parts of the log for all three failures.

Linux release nightlies | Warning | Reported :books:

Reference builds:

One warning stl_algobase.h:437 (array-bounds=):

‘void* __builtin_memmove(void*, const void*, long unsigned int)’ forming offset 8 is out of the bounds [0, 8] [-Warray-bounds=] 437 | __builtin_memmove(__result, __first, sizeof(_Tp) * _Num); | ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Full compilation output:

``` In file included from ^[[01m^[[K/usr/include/c++/13/bits/specfun.h:43^[[m^[[K,^M from ^[[01m^[[K/usr/include/c++/13/cmath:3699^[[m^[[K,^M from ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_assimp_vendor/assimp_vendor-prefix/src/assimp_vendor/include/assimp/vector2.h:53^[[m^[[K,^M from ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_assimp_vendor/assimp_vendor-prefix/src/assimp_vendor/include/assimp/types.h:64^[[m^[[K,^M from ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_assimp_vendor/assimp_vendor-prefix/src/assimp_vendor/include/assimp/IOStream.hpp:53^[[m^[[K, from ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_assimp_vendor/assimp_vendor-prefix/src/assimp_vendor/include/assimp/DefaultIOStream.h:55^[[m from ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_assimp_vendor/assimp_vendor-prefix/src/assimp_vendor/include/assimp/Exceptional.h:49^[[m^[[K from ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_assimp_vendor/assimp_vendor-prefix/src/assimp_vendor/include/assimp/BaseImporter.h:52^[[m^[[ from ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_assimp_vendor/assimp_vendor-prefix/src/assimp_vendor/code/AssetLib/MDL/MDLLoader.h:50^[[m^[[ from ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_assimp_vendor/assimp_vendor-prefix/src/assimp_vendor/code/AssetLib/MDL/MDLLoader.cpp:51^[[m^ In static member function ‘^[[01m^[[Kstatic _Up* std::__copy_move<_IsMove, true, std::random_access_iterator_tag>::^[[01;32m^[[K__copy_m^[[m^[[K(_Tp*, _Tp*, _Up*) ^[[35m^[[K[with _Tp = long inlined from ‘^[[01m^[[K_OI std::^[[01;32m^[[K__copy_move_a2^[[m^[[K(_II, _II, _OI) ^[[35m^[[K[with bool _IsMove = false; _II = long unsigned int*; _OI = long unsigned int*]^[[m^[[K^[[m^ inlined from ‘^[[01m^[[K_OI std::^[[01;32m^[[K__copy_move_a1^[[m^[[K(_II, _II, _OI) ^[[35m^[[K[with bool _IsMove = false; _II = long unsigned int*; _OI = long unsigned int*]^[[m^[[K^[[m^ inlined from ‘^[[01m^[[K_OI std::^[[01;32m^[[K__copy_move_a^[[m^[[K(_II, _II, _OI) ^[[35m^[[K[with bool _IsMove = false; _II = long unsigned int*; _OI = long unsigned int*]^[[m^[[K^[[m^[ inlined from ‘^[[01m^[[K_OI std::^[[01;32m^[[Kcopy^[[m^[[K(_II, _II, _OI) ^[[35m^[[K[with _II = long unsigned int*; _OI = long unsigned int*]^[[m^[[K^[[m^[[K’ at ^[[01m^[[K/usr/include/c inlined from ‘^[[01m^[[Kstd::vector::iterator std::vector::^[[01;32m^[[K_M_copy_aligned^[[m^[[K(const_iterator, const_iterator, iterator) ^[[35m^[[K[with _All inlined from ‘^[[01m^[[Kvoid std::vector::^[[01;32m^[[K_M_reallocate^[[m^[[K(size_type) ^[[35m^[[K[with _Alloc = std::allocator]^[[m^[[K^[[m^[[K’ at ^[[01m^[[K/usr/in inlined from ‘^[[01m^[[Kvoid std::vector::^[[01;32m^[[Kreserve^[[m^[[K(size_type) ^[[35m^[[K[with _Alloc = std::allocator]^[[m^[[K^[[m^[[K’ at ^[[01m^[[K/usr/include/ inlined from ‘^[[01m^[[KAssimp::MDL::IntSharedData_MDL7::^[[01;32m^[[KIntSharedData_MDL7^[[m^[[K()^[[m^[[K’ at ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz inlined from ‘^[[01m^[[Kvoid Assimp::MDLImporter::^[[01;32m^[[KInternReadFile_3DGS_MDL7^[[m^[[K()^[[m^[[K’ at ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_ ^[[01m^[[K/usr/include/c++/13/bits/stl_algobase.h:437:30:^[[m^[[K ^[[01;35m^[[Kwarning: ^[[m^[[K‘^[[01m^[[Kvoid*^[[01;32m^[[K __builtin_memmove^[[m^[[K(void*, const void*, long unsigned int) 437 | ^[[01;35m^[[K__builtin_memmove(__result, __first, sizeof(_Tp) * _Num)^[[m^[[K;^M | ^[[01;35m^[[K~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^[[m^[[K^M ```

As the full log says, this is happening in rviz/assimp_vendor package

Reported in: https://github.com/ros2/rviz/issues/1240

there are 28 test failures on gz-sim9 on macOS / homebrew since build 68. The failures don't occur on gz-sim8 and have been consistently failing. I posted about my debugging attempts in https://github.com/gazebosim/gz-sim/pull/2232#issuecomment-2232062040

Gz-sim8-windows | Flaky test regressions | Keeping track :eyes:

gz-sim8-win#92 shows: ServerRepeat/MultipleServers.TwoServersMixedBlocking/0 (SEH exception)
gz-sim8-win#93 shows: INTEGRATION_mesh_inertia_calculation.test_ran (Exit code 0xc0000409, physics error)

Running it multiple times to check what errors are actually happening

Jul 17

Urgent

Test regressions consecutive

Test regressions

Reference build	Age	Failure DateTime	Errors	Reports
Hci__nightly-performance_ubuntu_jammy_amd64#245	235	2024-07-16 06:05:11.472000	39 errors performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23) performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp	No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147	147	2024-07-16 16:38:26.438000	projectroot.test.rclcpp.test_executors projectroot.test_pub_sub rclcpp.TestClient.client_qos rclcpp.TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all	`https://github.com/ros2/rclcpp/issues/2502` (Closed)
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#145	110	2024-07-17 00:16:52.091000	projectroot.test_pub_sub test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all	No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109	108	2024-07-17 04:43:17.848000	39 errors performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23) performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp	No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#88	88	2024-07-16 07:20:43.334000	projectroot.test.rclcpp.test_subscription_topic_statistics rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset	No reports found!
Rci__benchmark_ubuntu_noble_amd64#53	53	2024-07-16 16:57:22.673000	projectroot.benchmark_string_conversions projectroot.benchmark_string_conversions	No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147	48	2024-07-16 16:38:26.438000	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test	No reports found!
gz_rendering-8-win#70	42	2024-07-17 01:06:14.271000	MeshTest.NormalMapWithoutTexCoord	No reports found!
gz_rendering-7-win#63	35	2024-07-17 00:06:12.601000	MeshTest.NormalMapWithoutTexCoord	No reports found!
gz_rendering-main-win#62	33	2024-07-17 02:06:14.849000	MeshTest.NormalMapWithoutTexCoord	No reports found!
Jci__nightly-connext_ubuntu_noble_amd64#33	33	2024-07-17 06:15:00.217000	projectroot.test.rclcpp.test_subscription_topic_statistics rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset	No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#56	31	2024-07-16 18:09:22.800000	36 errors performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19) performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp	No reports found!
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64#31	31	2024-07-14 10:28:24.694000	projectroot.test_generic_pub_sub projectroot.test_generic_subscription projectroot.test_pub_sub test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all test_tracetools.test_tracetools.test.test_generic_subscription.TestGenericSubscription.test_all test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all	`https://github.com/ros2/ros2_tracing/issues/124` (Closed)
Hci__nightly-connext_ubuntu_jammy_amd64#254	23	2024-07-15 06:15:01.077000	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test	No reports found!
nightly_linux-aarch64_repeated#2823	11	2024-07-17 04:00:01.178000	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3] test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]	No reports found!
nightly_linux-rhel_repeated#1967	9	2024-07-17 04:00:01.198000	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3] test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]	No reports found!
nightly_linux_repeated#3520	8	2024-07-16 08:27:07.033000	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3] test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]	No reports found!
Hci__nightly-connext_ubuntu_jammy_amd64#254	8	2024-07-15 06:15:01.077000	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test	No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109	7	2024-07-17 04:43:17.848000	projectroot.cpplint projectroot.lint_cmake projectroot.uncrustify	`https://github.com/ros2/rosidl/issues/790` (Closed)
nightly_win_rep#3418	5	2024-07-17 04:00:01.218000	projectroot.gtest_multithreaded__rmw_connextdds test_rclcpp.gtest_multithreaded__rmw_connextdds.gtest.missing_result	No reports found!
gz_sim-ci-main-homebrew-amd64#71	4	2024-07-16 17:28:58.697000	28 errors INTEGRATION_ackermann_steering_system.test_ran INTEGRATION_acoustic_comms.test_ran INTEGRATION_battery_plugin.test_ran INTEGRATION_breadcrumbs.test_ran INTEGRATION_buoyancy.test_ran INTEGRATION_environment_preload_system.test_ran INTEGRATION_force_torque_system.test_ran INTEGRATION_joint_controller_system.test_ran INTEGRATION_joint_position_controller_system.test_ran INTEGRATION_joint_trajectory_controller_system.test_ran INTEGRATION_level_manager.test_ran INTEGRATION_level_manager_runtime_performers.test_ran INTEGRATION_mesh_inertia_calculation.test_ran INTEGRATION_multicopter.test_ran INTEGRATION_physics_system.test_ran INTEGRATION_recreate_entities.test_ran INTEGRATION_scene_broadcaster_system.test_ran INTEGRATION_sdf_frame_semantics.test_ran INTEGRATION_thermal_system.test_ran INTEGRATION_thruster.test_ran INTEGRATION_touch_plugin.test_ran INTEGRATION_tracked_vehicle_system.test_ran INTEGRATION_user_commands.test_ran INTEGRATION_wheel_slip.test_ran PERFORMANCE_level_manager.test_ran UNIT_ModelCommandAPI_TEST.test_ran UNIT_Server_TEST.test_ran UNIT_SimulationRunner_TEST.test_ran	`https://github.com/gazebosim/gz-sim/issues/2204` (Closed) `https://github.com/gazebosim/gz-sim/issues/2282` (Closed)
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#145	4	2024-07-17 00:16:52.091000	projectroot.test_publisher projectroot.test_subscription	`https://github.com/ros2/system_tests/issues/496` (Closed)
Hci__nightly-performance_ubuntu_jammy_amd64#245	4	2024-07-16 06:05:11.472000	projectroot.cpplint projectroot.lint_cmake projectroot.uncrustify	`https://github.com/ros2/rosidl/issues/790` (Closed)
Ici__nightly-connext_ubuntu_jammy_amd64#147	3	2024-07-16 16:38:26.438000	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test	No reports found!

Warnings

Reference build	Age	Failure DateTime	Errors	Reports
nightly_linux_release#3141	-1	2024-07-17 07:25:42.353000	1 clang warnings 1 clang-tidy warnings 1 gcc warnings	No reports found!
nightly_linux-aarch64_release#2796	-1	2024-07-17 04:00:01.174000	1 clang warnings 1 clang-tidy warnings 1 gcc warnings	No reports found!
gz_rendering-main-win#62	-1	2024-07-17 02:06:14.849000	2 msbuild warnings	No reports found!
gz_rendering-8-win#70	-1	2024-07-17 01:06:14.271000	2 msbuild warnings	No reports found!
gz_rendering-7-win#63	-1	2024-07-17 00:06:12.601000	2 msbuild warnings	No reports found!
Rci__nightly-release_ubuntu_noble_amd64#84	-1	2024-07-16 15:51:42.651000	1 clang-tidy warnings 1 gcc warnings	No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#56	-1	2024-07-16 18:09:22.800000	2 clang-tidy warnings 2 cmake warnings 30 gcc warnings	No reports found!
Jci__nightly-release_ubuntu_noble_amd64#32	-1	2024-07-14 14:17:53.230000	1 clang-tidy warnings 1 gcc warnings	No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109	-1	2024-07-17 04:43:17.848000	2 clang-tidy warnings 30 gcc warnings 4 cmake warnings	No reports found!
Hci__nightly-performance_ubuntu_jammy_amd64#245	-1	2024-07-16 06:05:11.472000	2 clang-tidy warnings 30 gcc warnings 4 cmake warnings	No reports found!

Test regressions flaky

Test regressions

Reference builds Errors Flaky report Reports

projectroot.test_subscription
projectroot.test_subscription
projectroot.test_subscription

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Icinightly-fastrtps-dynamic_ubuntu_jammy_amd64	2024-07-17	2024-07-05	5	5	100.0%
Ici__nightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-04	5	5	100.0%
Jcinightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-14	2024-07-02	3	3	100.0%
nightly_win_rep	2024-07-17	2024-07-10	13	2	15.38%
nightly_win_rel	2024-07-16	2024-07-16	16	1	6.25%

No reports found!

nightly_linux_repeated#3520

launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Hci__nightly-connext_ubuntu_jammy_amd64	2024-07-15	2024-07-11	3	3	100.0%
Ici__nightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-04	5	4	80.0%
nightly_linux-aarch64_repeated	2024-07-11	2024-07-09	16	3	18.75%
nightly_linux_repeated	2024-07-16	2024-07-02	12	2	16.67%
nightly_linux-rhel_repeated	2024-07-14	2024-07-14	16	1	6.25%
nightly_linux-aarch64_debug	2024-07-04	2024-07-04	16	1	6.25%

No reports found!

nightly_linux-aarch64_repeated#2823

launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Ici__nightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-04	5	5	100.0%
Hci__nightly-connext_ubuntu_jammy_amd64	2024-07-15	2024-07-11	3	3	100.0%
nightly_linux-aarch64_repeated	2024-07-17	2024-07-04	16	5	31.25%
nightly_win_rep	2024-07-10	2024-07-10	13	1	7.69%

No reports found!

Rci__nightly-performance_ubuntu_noble_amd64#56

projectroot.cpplint
projectroot.uncrustify

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Icinightly-performance_ubuntu_jammy_amd64	2024-07-17	2024-07-09	5	5	100.0%
Rci__nightly-performance_ubuntu_noble_amd64	2024-07-16	2024-07-03	5	5	100.0%
Hcinightly-performance_ubuntu_jammy_amd64	2024-07-16	2024-07-12	3	3	100.0%
Jci__nightly-performance_ubuntu_noble_amd64	2024-07-06	2024-07-03	2	2	100.0%

https://github.com/ros2/rosidl/issues/790 (Closed)

projectroot.test_publisher
projectroot.test_publisher

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Icinightly-fastrtps-dynamic_ubuntu_jammy_amd64	2024-07-17	2024-07-05	5	5	100.0%
Ici__nightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-04	5	5	100.0%
Jcinightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-14	2024-07-02	3	3	100.0%
nightly_win_rep	2024-07-10	2024-07-10	13	1	7.69%

https://github.com/ros2/system_tests/issues/496 (Closed)

Jci__nightly-connext_ubuntu_noble_amd64#33

projectroot.test_generic_pub_sub

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-14	2024-07-02	3	3	100.0%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-02	4	2	50.0%

https://github.com/ros2/ros2_tracing/issues/124 (Closed)

Jci__nightly-connext_ubuntu_noble_amd64#33

test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-14	2024-07-02	3	3	100.0%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-02	4	2	50.0%
nightly_linux-rhel_repeated	2024-07-04	2024-07-02	16	3	18.75%
Rcinightly-connext_ubuntu_noble_amd64	2024-07-04	2024-07-02	11	2	18.18%
nightly_linux_repeated	2024-07-04	2024-07-03	12	2	16.67%
nightly_linux-rhel_release	2024-07-04	2024-07-02	15	2	13.33%
nightly_linux_coverage	2024-07-03	2024-07-03	15	1	6.67%
nightly_linux-rhel_debug	2024-07-03	2024-07-03	15	1	6.67%

https://github.com/ros2/ros2_tracing/issues/124 (Closed)

Ici__nightly-performance_ubuntu_jammy_amd64#109

buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Icinightly-performance_ubuntu_jammy_amd64	2024-07-17	2024-07-09	5	4	80.0%
Rci__nightly-performance_ubuntu_noble_amd64	2024-07-16	2024-07-03	5	4	80.0%
Hcinightly-performance_ubuntu_jammy_amd64	2024-07-13	2024-07-12	3	2	66.67%
Jci__nightly-performance_ubuntu_noble_amd64	2024-07-03	2024-07-03	2	1	50.0%

No reports found!

Ici__nightly-performance_ubuntu_jammy_amd64#109

projectroot.test.test_performance_CycloneDDS_sync_Array8m

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-performance_ubuntu_noble_amd64	2024-07-16	2024-07-03	5	4	80.0%
Hci__nightly-performance_ubuntu_jammy_amd64	2024-07-13	2024-07-12	3	2	66.67%
Icinightly-performance_ubuntu_jammy_amd64	2024-07-17	2024-07-11	5	3	60.0%
Jci__nightly-performance_ubuntu_noble_amd64	2024-07-03	2024-07-03	2	1	50.0%

No reports found!

nightly_win_deb#3157

projectroot.gtest_multithreaded__rmw_connextdds

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-17	2024-07-03	13	10	76.92%
nightly_win_deb	2024-07-17	2024-07-04	14	6	42.86%
nightly_win_rel	2024-07-16	2024-07-06	16	2	12.5%
nightly_linux-rhel_repeated	2024-07-03	2024-07-03	16	1	6.25%

No reports found!

projectroot.test.rclcpp.test_service_introspection
projectroot.test.rclcpp.test_service_introspection

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-connext_ubuntu_noble_amd64	2024-07-14	2024-07-02	4	3	75.0%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-16	2024-07-02	11	6	54.55%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-09	5	2	40.0%

No reports found!

Ici__nightly-connext_ubuntu_jammy_amd64#147

rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-connext_ubuntu_noble_amd64	2024-07-14	2024-07-02	4	3	75.0%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-15	2024-07-02	11	5	45.45%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-09	5	2	40.0%

No reports found!

nightly_linux_coverage#2462

ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux_coverage	2024-07-17	2024-07-02	15	10	66.67%
nightly_linux_debug	2024-07-13	2024-07-13	14	1	7.14%

https://github.com/ros2/ros2cli/issues/772 (Closed)

nightly_linux-rhel_repeated#1967

ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3]

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux-rhel_repeated	2024-07-17	2024-07-03	16	10	62.5%
nightly_win_rep	2024-07-09	2024-07-09	13	1	7.69%
nightly_linux-aarch64_repeated	2024-07-07	2024-07-07	16	1	6.25%

No reports found!

nightly_win_rep#3418

projectroot.test_n_nodes__rmw_fastrtps_cpp
test_rclcpp.TestNNodesAfterShutdown.test_10_nodes

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-17	2024-07-02	13	8	61.54%

No reports found!

nightly_win_deb#3157

test_rclcpp.gtest_multithreaded__rmw_connextdds.gtest.missing_result

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-17	2024-07-03	13	8	61.54%
nightly_win_deb	2024-07-17	2024-07-05	14	5	35.71%
nightly_win_rel	2024-07-06	2024-07-06	16	1	6.25%
nightly_linux-rhel_repeated	2024-07-03	2024-07-03	16	1	6.25%

No reports found!

nightly_win_rep#3418

test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux-rhel_repeated	2024-07-17	2024-07-09	16	9	56.25%
nightly_linux-aarch64_repeated	2024-07-17	2024-07-09	16	9	56.25%
nightly_win_rep	2024-07-17	2024-07-09	13	6	46.15%
nightly_linux_repeated	2024-07-16	2024-07-09	12	5	41.67%

No reports found!

rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-connext_ubuntu_noble_amd64	2024-07-16	2024-07-02	11	6	54.55%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-05	2024-07-02	4	2	50.0%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-16	5	1	20.0%

No reports found!

gz_sim-8-win#94

INTEGRATION_mesh_inertia_calculation.test_ran

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
gz_sim-ci-main-homebrew-amd64	2024-07-16	2024-07-15	8	4	50.0%
gz_sim-8-win	2024-07-17	2024-07-16	7	2	28.57%
gz_sim-main-win	2024-07-11	2024-07-11	6	1	16.67%

No reports found!

nightly_win_rep#3418

test_rclcpp.test_timeout_subscriber.timeout_subscriber

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-17	2024-07-05	13	5	38.46%

No reports found!

nightly_win_rep#3418

projectroot.test_timer

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux_iron_coverage	2024-07-16	2024-07-03	14	5	35.71%
nightly_win_rep	2024-07-17	2024-07-03	13	3	23.08%
nightly_win_rel	2024-07-16	2024-07-16	16	1	6.25%

No reports found!

nightly_linux_repeated#3520

projectroot.test_generic_pub_sub__rmw_connextdds

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux-rhel_repeated	2024-07-12	2024-07-02	16	5	31.25%
nightly_linux_repeated	2024-07-16	2024-07-03	12	3	25.0%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-04	2024-07-02	11	2	18.18%
nightly_linux-rhel_release	2024-07-04	2024-07-02	15	2	13.33%
nightly_linux_coverage	2024-07-03	2024-07-03	15	1	6.67%
nightly_linux-rhel_debug	2024-07-03	2024-07-03	15	1	6.67%

https://github.com/ros2/ros2_tracing/issues/124 (Closed)

nightly_win_rep#3418

demo_nodes_cpp.TestExecutablesTutorialAfterShutdown.test_last_process_exit_code
demo_nodes_cpp.TestExecutablesTutorialAfterShutdown.test_last_process_exit_code

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-17	2024-07-04	13	4	30.77%

No reports found!

nightly_win_rep#3418

projectroot.gtest_timeout_subscriber__rmw_fastrtps_cpp

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-17	2024-07-05	13	4	30.77%

No reports found!

nightly_win_rep#3418

projectroot.test.rclcpp.test_executor

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-17	2024-07-04	13	4	30.77%
nightly_win_deb	2024-07-06	2024-07-06	14	1	7.14%

https://github.com/ros2/rclcpp/issues/2502 (Closed)

nightly_win_rep#3418

projectroot.test_server

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-17	2024-07-05	13	4	30.77%
nightly_win_deb	2024-07-03	2024-07-03	14	1	7.14%

No reports found!

Jci__nightly-connext_ubuntu_noble_amd64#33

projectroot.tf2_ros_test_message_filter

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-12	2024-07-05	11	3	27.27%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-17	4	1	25.0%
nightly_win_deb	2024-07-03	2024-07-03	14	1	7.14%

No reports found!

Jci__nightly-connext_ubuntu_noble_amd64#33

tf2_ros.tf2_ros_test_message_filter.gtest.missing_result

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-12	2024-07-05	11	3	27.27%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-17	4	1	25.0%

No reports found!

nightly_linux-aarch64_repeated#2823

ros2topic.ros2topic.test.test_cli.test_cli

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux_repeated	2024-07-10	2024-07-02	12	3	25.0%
Rci__nightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-13	2024-07-13	12	1	8.33%
nightly_linux-aarch64_repeated	2024-07-17	2024-07-17	16	1	6.25%

https://github.com/ros2/ros2cli/issues/861 (Closed)

nightly_win_rep#3418

projectroot.test_tutorial_add_two_ints_server_add_two_ints_client_async__rmw_fastrtps_cpp

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-17	2024-07-04	13	3	23.08%

No reports found!

nightly_win_rep#3418

rclcpp.test_executor.gtest.missing_result

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-17	2024-07-04	13	3	23.08%
nightly_win_deb	2024-07-06	2024-07-06	14	1	7.14%

No reports found!

nightly_win_rep#3418

rclcpp_action.TestServer.deferred_execution
rclcpp_action.TestServer.get_result
rclcpp_action.TestServer.get_result_deferred
rclcpp_action.TestServer.publish_feedback
rclcpp_action.TestServer.publish_status_aborted
rclcpp_action.TestServer.publish_status_succeeded

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-17	2024-07-05	13	3	23.08%
nightly_win_deb	2024-07-03	2024-07-03	14	1	7.14%

No reports found!

Maintenance

Pending

Jul 18

Urgent

Build regressions

Reference Build	Failure DateTime	Failure Reason
nightly_linux-aarch64_repeated#2824	2024-07-18 04:00	Number of failed test exceeds the threshold
nightly_win_rep#3419	2024-07-18 04:00	Number of failed test exceeds the threshold

Test regressions consecutive

Test regressions

Reference build	Age	Failure DateTime	Errors	Reports
Hci__nightly-performance_ubuntu_jammy_amd64#245	235	2024-07-16 06:05:11.472000	39 errors performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23) performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp	No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147	147	2024-07-16 16:38:26.438000	projectroot.test.rclcpp.test_executors projectroot.test_pub_sub rclcpp.TestClient.client_qos rclcpp.TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all	`https://github.com/ros2/rclcpp/issues/2502` (Closed)
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#145	110	2024-07-17 00:16:52.091000	projectroot.test_pub_sub test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all	No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109	108	2024-07-17 04:43:17.848000	39 errors performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23) performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp	No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#89	89	2024-07-17 14:27:43.828000	projectroot.test.rclcpp.test_subscription_topic_statistics rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset	No reports found!
Rci__benchmark_ubuntu_noble_amd64#54	54	2024-07-18 03:07:55.831000	projectroot.benchmark_string_conversions projectroot.benchmark_string_conversions	No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147	48	2024-07-16 16:38:26.438000	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test	No reports found!
gz_rendering-8-win#70	42	2024-07-17 01:06:14.271000	MeshTest.NormalMapWithoutTexCoord	No reports found!
gz_rendering-7-win#63	35	2024-07-17 00:06:12.601000	MeshTest.NormalMapWithoutTexCoord	No reports found!
gz_rendering-main-win#62	33	2024-07-17 02:06:14.849000	MeshTest.NormalMapWithoutTexCoord	No reports found!
Jci__nightly-connext_ubuntu_noble_amd64#33	33	2024-07-17 06:15:00.217000	projectroot.test.rclcpp.test_subscription_topic_statistics rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset	No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#57	32	2024-07-18 03:40:00.356000	36 errors performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19) performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp	No reports found!
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64#32	32	2024-07-17 10:29:32.280000	projectroot.test_generic_pub_sub projectroot.test_generic_subscription projectroot.test_pub_sub test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all test_tracetools.test_tracetools.test.test_generic_subscription.TestGenericSubscription.test_all test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all	`https://github.com/ros2/ros2_tracing/issues/124` (Closed)
Hci__nightly-connext_ubuntu_jammy_amd64#255	24	2024-07-18 06:15:00.322000	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test	No reports found!
Jci__benchmark_ubuntu_noble_amd64#19	19	2024-07-18 02:21:13.767000	projectroot.benchmark_string_conversions projectroot.benchmark_string_conversions	No reports found!
nightly_linux-rhel_repeated#1968	10	2024-07-18 04:00:01.171000	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3] test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]	No reports found!
nightly_linux_repeated#3521	9	2024-07-17 08:21:14.566000	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3] test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]	No reports found!
Hci__nightly-connext_ubuntu_jammy_amd64#255	9	2024-07-18 06:15:00.322000	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test	No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#19	8	2024-07-17 23:57:02.066000	36 errors performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30) performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19) performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp	No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109	7	2024-07-17 04:43:17.848000	projectroot.cpplint projectroot.lint_cmake projectroot.uncrustify	`https://github.com/ros2/rosidl/issues/790` (Closed)
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#145	4	2024-07-17 00:16:52.091000	projectroot.test_publisher projectroot.test_subscription	`https://github.com/ros2/system_tests/issues/496` (Closed)
Hci__nightly-performance_ubuntu_jammy_amd64#245	4	2024-07-16 06:05:11.472000	projectroot.cpplint projectroot.lint_cmake projectroot.uncrustify	`https://github.com/ros2/rosidl/issues/790` (Closed)
nightly_linux-rhel_repeated#1968	3	2024-07-18 04:00:01.171000	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3]	No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#89	3	2024-07-17 14:27:43.828000	projectroot.test.rclcpp.test_service_introspection rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content	No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147	3	2024-07-16 16:38:26.438000	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test	No reports found!

Warnings

Reference build	Age	Failure DateTime	Errors	Reports
sdformat-ci-main-noble-amd64#20	-1	2024-07-17 20:48:06.890000	8 gcc warnings	No reports found!
nightly_linux_release#3142	-1	2024-07-18 07:28:35.818000	1 clang warnings 1 clang-tidy warnings 1 gcc warnings	No reports found!
nightly_linux-aarch64_release#2797	-1	2024-07-18 04:00:01.008000	1 clang warnings 1 clang-tidy warnings 1 gcc warnings	No reports found!
gz_rendering-main-win#62	-1	2024-07-17 02:06:14.849000	2 msbuild warnings	No reports found!
gz_rendering-8-win#70	-1	2024-07-17 01:06:14.271000	2 msbuild warnings	No reports found!
gz_rendering-7-win#63	-1	2024-07-17 00:06:12.601000	2 msbuild warnings	No reports found!
Rci__nightly-release_ubuntu_noble_amd64#85	-1	2024-07-17 23:19:47.160000	1 clang-tidy warnings 1 gcc warnings	No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#57	-1	2024-07-18 03:40:00.356000	2 clang-tidy warnings 2 cmake warnings 30 gcc warnings	No reports found!
Jci__nightly-release_ubuntu_noble_amd64#33	-1	2024-07-17 14:21:26.693000	1 clang-tidy warnings 1 gcc warnings	No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#19	-1	2024-07-17 23:57:02.066000	2 clang-tidy warnings 2 cmake warnings 30 gcc warnings	No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109	-1	2024-07-17 04:43:17.848000	2 clang-tidy warnings 30 gcc warnings 4 cmake warnings	No reports found!
Hci__nightly-performance_ubuntu_jammy_amd64#245	-1	2024-07-16 06:05:11.472000	2 clang-tidy warnings 30 gcc warnings 4 cmake warnings	No reports found!

Test regressions flaky

Test regressions

Reference builds Errors Flaky report Reports

nightly_win_rel#3110

projectroot.test.rclcpp.test_executors

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-04	5	5	100.0%
Rci__nightly-cyclonedds_ubuntu_noble_amd64	2024-07-10	2024-07-04	12	6	50.0%
Jcinightly-cyclonedds_ubuntu_noble_amd64	2024-07-05	2024-07-05	3	1	33.33%
nightly_win_rep	2024-07-06	2024-07-05	12	2	16.67%
nightly_linux_debug	2024-07-10	2024-07-04	13	2	15.38%
nightly_win_rel	2024-07-18	2024-07-18	16	1	6.25%
nightly_linux-rhel_repeated	2024-07-04	2024-07-04	16	1	6.25%

https://github.com/ros2/rclcpp/issues/2502 (Closed)

nightly_win_rel#3110

projectroot.test.rclcpp.test_subscription_topic_statistics

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-04	11	11	100.0%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-05	3	3	100.0%
nightly_win_rep	2024-07-05	2024-07-05	12	1	8.33%
nightly_win_rel	2024-07-18	2024-07-18	16	1	6.25%

No reports found!

nightly_linux_repeated#3521

launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Hci__nightly-connext_ubuntu_jammy_amd64	2024-07-18	2024-07-11	4	4	100.0%
Ici__nightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-04	5	4	80.0%
nightly_linux-aarch64_repeated	2024-07-11	2024-07-09	15	3	20.0%
nightly_linux_repeated	2024-07-17	2024-07-16	12	2	16.67%
nightly_linux-rhel_repeated	2024-07-14	2024-07-14	16	1	6.25%
nightly_linux-aarch64_debug	2024-07-04	2024-07-04	16	1	6.25%

No reports found!

projectroot.cpplint
projectroot.uncrustify
projectroot.cpplint
projectroot.uncrustify

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-performance_ubuntu_noble_amd64	2024-07-18	2024-07-03	6	6	100.0%
Jci__nightly-performance_ubuntu_noble_amd64	2024-07-17	2024-07-03	3	3	100.0%
Icinightly-performance_ubuntu_jammy_amd64	2024-07-17	2024-07-09	5	5	100.0%
Hci__nightly-performance_ubuntu_jammy_amd64	2024-07-16	2024-07-12	3	3	100.0%

https://github.com/ros2/rosidl/issues/790 (Closed)

projectroot.test_publisher
projectroot.test_publisher

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-17	2024-07-05	3	3	100.0%
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64	2024-07-17	2024-07-05	5	5	100.0%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-04	5	5	100.0%
nightly_win_rep	2024-07-10	2024-07-10	12	1	8.33%

https://github.com/ros2/system_tests/issues/496 (Closed)

projectroot.test_subscription
projectroot.test_subscription

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-17	2024-07-05	3	3	100.0%
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64	2024-07-17	2024-07-05	5	5	100.0%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-04	5	5	100.0%
nightly_win_rep	2024-07-17	2024-07-10	12	2	16.67%
nightly_win_rel	2024-07-16	2024-07-16	16	1	6.25%

No reports found!

Jci__nightly-connext_ubuntu_noble_amd64#33

projectroot.test_generic_pub_sub

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-17	2024-07-05	3	3	100.0%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-17	3	1	33.33%

https://github.com/ros2/ros2_tracing/issues/124 (Closed)

Jci__nightly-connext_ubuntu_noble_amd64#33

test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-17	2024-07-05	3	3	100.0%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-17	3	1	33.33%
nightly_linux_repeated	2024-07-04	2024-07-03	12	2	16.67%
nightly_linux-rhel_repeated	2024-07-04	2024-07-03	16	2	12.5%
Rcinightly-connext_ubuntu_noble_amd64	2024-07-04	2024-07-04	11	1	9.09%
nightly_linux-rhel_release	2024-07-04	2024-07-04	15	1	6.67%
nightly_linux_coverage	2024-07-03	2024-07-03	15	1	6.67%
nightly_linux-rhel_debug	2024-07-03	2024-07-03	15	1	6.67%

https://github.com/ros2/ros2_tracing/issues/124 (Closed)

buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-performance_ubuntu_noble_amd64	2024-07-18	2024-07-03	6	5	83.33%
Ici__nightly-performance_ubuntu_jammy_amd64	2024-07-17	2024-07-09	5	4	80.0%
Jcinightly-performance_ubuntu_noble_amd64	2024-07-17	2024-07-03	3	2	66.67%
Hci__nightly-performance_ubuntu_jammy_amd64	2024-07-13	2024-07-12	3	2	66.67%

No reports found!

projectroot.test.test_performance_CycloneDDS_sync_Array8m
projectroot.test.test_performance_CycloneDDS_sync_Array8m
projectroot.test.test_performance_CycloneDDS_sync_Array8m

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-performance_ubuntu_noble_amd64	2024-07-18	2024-07-03	6	5	83.33%
Jci__nightly-performance_ubuntu_noble_amd64	2024-07-17	2024-07-03	3	2	66.67%
Hcinightly-performance_ubuntu_jammy_amd64	2024-07-13	2024-07-12	3	2	66.67%
Ici__nightly-performance_ubuntu_jammy_amd64	2024-07-17	2024-07-11	5	3	60.0%

No reports found!

Rci__nightly-performance_ubuntu_noble_amd64#57

projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-performance_ubuntu_noble_amd64	2024-07-18	2024-07-03	6	5	83.33%
Hci__nightly-performance_ubuntu_jammy_amd64	2024-07-13	2024-07-12	3	2	66.67%
Icinightly-performance_ubuntu_jammy_amd64	2024-07-14	2024-07-09	5	3	60.0%
Jci__nightly-performance_ubuntu_noble_amd64	2024-07-03	2024-07-03	3	1	33.33%

No reports found!

projectroot.test.rclcpp.test_service_introspection
projectroot.test.rclcpp.test_service_introspection

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-connext_ubuntu_noble_amd64	2024-07-14	2024-07-05	3	2	66.67%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-04	11	6	54.55%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-09	5	2	40.0%
nightly_win_rel	2024-07-18	2024-07-18	16	1	6.25%

No reports found!

rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-connext_ubuntu_noble_amd64	2024-07-14	2024-07-05	3	2	66.67%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-04	11	5	45.45%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-09	5	2	40.0%
nightly_win_rel	2024-07-18	2024-07-18	16	1	6.25%

No reports found!

nightly_linux_coverage#2463

ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux_coverage	2024-07-18	2024-07-03	15	10	66.67%
nightly_linux_debug	2024-07-13	2024-07-13	13	1	7.69%

https://github.com/ros2/ros2cli/issues/772 (Closed)

Rci__nightly-connext_ubuntu_noble_amd64#89

projectroot.test_client

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-14	2024-07-05	3	2	66.67%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-04	11	5	45.45%
nightly_win_rep	2024-07-09	2024-07-04	12	3	25.0%
nightly_win_deb	2024-07-11	2024-07-03	15	2	13.33%

No reports found!

Rci__nightly-connext_ubuntu_noble_amd64#89

rclpy.rclpy.test.test_client.TestClient.test_service_timestamps

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-14	2024-07-05	3	2	66.67%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-04	11	5	45.45%

No reports found!

rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-04	11	6	54.55%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-05	2024-07-05	3	1	33.33%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-16	5	1	20.0%
nightly_win_rel	2024-07-18	2024-07-18	16	1	6.25%

No reports found!

nightly_win_rel#3110

projectroot.test.rclcpp.test_executors_busy_waiting

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rci__nightly-cyclonedds_ubuntu_noble_amd64	2024-07-10	2024-07-04	12	6	50.0%
nightly_win_rep	2024-07-12	2024-07-05	12	4	33.33%
nightly_linux-aarch64_repeated	2024-07-06	2024-07-06	15	1	6.67%
nightly_win_rel	2024-07-18	2024-07-18	16	1	6.25%

No reports found!

nightly_win_rel#3110

rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_all

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rci__nightly-cyclonedds_ubuntu_noble_amd64	2024-07-10	2024-07-04	12	6	50.0%
Jci__nightly-cyclonedds_ubuntu_noble_amd64	2024-07-05	2024-07-05	3	1	33.33%
nightly_win_rep	2024-07-05	2024-07-05	12	1	8.33%
nightly_win_rel	2024-07-18	2024-07-18	16	1	6.25%

https://github.com/ros2/rclcpp/issues/2502 (Closed)

nightly_win_rel#3110

sros2.test.sros2.commands.security.verbs.test_generate_policy.test_generate_policy

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rel	2024-07-18	2024-07-03	16	6	37.5%
nightly_win_deb	2024-07-12	2024-07-05	15	5	33.33%
nightly_win_rep	2024-07-05	2024-07-05	12	1	8.33%

No reports found!

nightly_win_rel#3110

projectroot.test.rclcpp.test_clock
rclcpp.TestClockWakeup.multiple_threads_wait_on_one_clock

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux_repeated	2024-07-12	2024-07-04	12	4	33.33%
nightly_win_rep	2024-07-11	2024-07-07	12	4	33.33%
nightly_linux-rhel_repeated	2024-07-13	2024-07-12	16	2	12.5%
nightly_win_rel	2024-07-18	2024-07-18	16	1	6.25%

No reports found!

nightly_win_rel#3110

projectroot.test.rclcpp.test_executor

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-17	2024-07-04	12	4	33.33%
nightly_win_deb	2024-07-06	2024-07-06	15	1	6.67%
nightly_win_rel	2024-07-18	2024-07-18	16	1	6.25%

https://github.com/ros2/rclcpp/issues/2502 (Closed)

nightly_linux_repeated#3521

projectroot.test_generic_pub_sub__rmw_connextdds

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux_repeated	2024-07-17	2024-07-03	12	4	33.33%
nightly_linux-rhel_repeated	2024-07-12	2024-07-03	16	4	25.0%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-04	2024-07-04	11	1	9.09%
nightly_linux-rhel_release	2024-07-04	2024-07-04	15	1	6.67%
nightly_linux_coverage	2024-07-03	2024-07-03	15	1	6.67%
nightly_linux-rhel_debug	2024-07-03	2024-07-03	15	1	6.67%

https://github.com/ros2/ros2_tracing/issues/124 (Closed)

Jci__nightly-connext_ubuntu_noble_amd64#33

projectroot.tf2_ros_test_message_filter

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-17	3	1	33.33%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-12	2024-07-05	11	3	27.27%
nightly_win_deb	2024-07-03	2024-07-03	15	1	6.67%

No reports found!

Jci__nightly-connext_ubuntu_noble_amd64#33

tf2_ros.tf2_ros_test_message_filter.gtest.missing_result

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-17	3	1	33.33%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-12	2024-07-05	11	3	27.27%

No reports found!

nightly_win_rel#3110

rclcpp.test_executor.gtest.missing_result

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-17	2024-07-04	12	3	25.0%
nightly_win_deb	2024-07-06	2024-07-06	15	1	6.67%
nightly_win_rel	2024-07-18	2024-07-18	16	1	6.25%

No reports found!

nightly_linux_repeated#3521

projectroot.test_client_scope_cpp__rmw_cyclonedds_cpp
test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux_repeated	2024-07-17	2024-07-10	12	3	25.0%
nightly_linux-rhel_repeated	2024-07-13	2024-07-13	16	1	6.25%

No reports found!

nightly_linux-rhel_repeated#1968

projectroot.test_pub_sub__rmw_connextdds

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux-rhel_repeated	2024-07-18	2024-07-03	16	4	25.0%
nightly_linux_repeated	2024-07-04	2024-07-03	12	2	16.67%
nightly_linux-rhel_release	2024-07-03	2024-07-03	15	1	6.67%

No reports found!

nightly_win_deb#3158

projectroot.copyright
rviz_default_plugins.copyright.xunit.missing_result

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_deb	2024-07-18	2024-07-12	15	3	20.0%

No reports found!

Maintenance

Pending

Ros2 Performance Tests | Test regressions | Reported :books:

Reference builds:

Most of the test regressions are related to cpplint include_order

Test regressions:

* [projectroot.cpplint](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/(root)/projectroot/cpplint/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_communication_abstractions_resource_manager_hpp_48_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_communication_abstractions_resource_manager_hpp_49_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_communication_abstractions_resource_manager_hpp_50_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_communication_abstractions_ros2_callback_communicator_hpp_20_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_communication_abstractions_ros2_callback_communicator_hpp_21_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_communication_abstractions_ros2_communicator_hpp_21_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_communication_abstractions_ros2_communicator_hpp_22_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_communication_abstractions_ros2_waitset_communicator_hpp_20_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_communication_abstractions_ros2_waitset_communicator_hpp_21_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_communication_abstractions_ros2_waitset_communicator_hpp_22_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_communication_abstractions_ros2_waitset_communicator_hpp_23_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_data_running_data_runner_base_hpp_19_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_data_running_data_runner_factory_cpp_19_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_data_running_data_runner_factory_cpp_20_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_configuration_experiment_configuration_cpp_18_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_configuration_experiment_configuration_cpp_20_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_configuration_experiment_configuration_cpp_21_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_configuration_experiment_configuration_cpp_22_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_configuration_experiment_configuration_cpp_23_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_configuration_experiment_configuration_hpp_21_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_configuration_experiment_configuration_hpp_22_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_configuration_experiment_configuration_hpp_23_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_configuration_experiment_configuration_hpp_24_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_configuration_external_info_storage_hpp_21_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_configuration_external_info_storage_hpp_22_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_execution_analyze_runner_cpp_15_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_execution_analyze_runner_cpp_16_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_execution_analyze_runner_cpp_17_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_execution_analyze_runner_cpp_18_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_execution_analyze_runner_cpp_19_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_execution_analyze_runner_cpp_20_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_execution_analyze_runner_cpp_21_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_execution_analyze_runner_cpp_29_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_experiment_execution_analyze_runner_cpp_30_/) * [performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19)](https://build.ros2.org/job/Hci__nightly-performance_ubuntu_jammy_amd64/245/testReport/junit/performance_test/cpplint/build_include_order__4____tmp_ws2_src_performance_test_performance_test_src_utilities_cpu_usage_tracker_hpp_19_/)

Affected files:

* resource_manager.hpp:48 * resource_manager.hpp:49 * resource_manager.hpp:50 * ros2_callback_communicator.hpp:20 * ros2_callback_communicator.hpp:21 * ros2_communicator.hpp:21 * ros2_communicator.hpp:22 * ros2_waitset_communicator.hpp:20 * ros2_waitset_communicator.hpp:21 * ros2_waitset_communicator.hpp:22 * ros2_waitset_communicator.hpp:23 * data_runner_base.hpp:19 * data_runner_factory.cpp:19 * data_runner_factory.cpp:20 * experiment_configuration.cpp:18 * experiment_configuration.cpp:20 * experiment_configuration.cpp:21 * experiment_configuration.cpp:22 * experiment_configuration.cpp:23 * experiment_configuration.hpp:21 * experiment_configuration.hpp:22 * experiment_configuration.hpp:23 * experiment_configuration.hpp:24 * external_info_storage.hpp:21 * external_info_storage.hpp:22 * analyze_runner.cpp:15 * analyze_runner.cpp:16 * analyze_runner.cpp:17 * analyze_runner.cpp:18 * analyze_runner.cpp:19 * analyze_runner.cpp:20 * analyze_runner.cpp:21 * analyze_runner.cpp:29 * analyze_runner.cpp:30 * cpu_usage_tracker.hpp:19

Reported in: https://github.com/ros2/performance_test/issues/48

Jul 19

Urgent

Test regressions consecutive

Test regressions

Reference build	Age	Failure DateTime	Errors	Reports
Hci__nightly-performance_ubuntu_jammy_amd64#245	235	2024-07-16 06:05:11.472000	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23) performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp	No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147	147	2024-07-16 16:38:26.438000	projectroot.test.rclcpp.test_executors projectroot.test_pub_sub rclcpp.TestClient.client_qos rclcpp.TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all	`https://github.com/ros2/rclcpp/issues/2502` (Closed)
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#145	110	2024-07-17 00:16:52.091000	projectroot.test_pub_sub test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all	No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109	108	2024-07-17 04:43:17.848000	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23) performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp	No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#89	89	2024-07-17 14:27:43.828000	projectroot.test.rclcpp.test_subscription_topic_statistics rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset	No reports found!
Rci__benchmark_ubuntu_noble_amd64#54	54	2024-07-18 03:07:55.831000	projectroot.benchmark_string_conversions projectroot.benchmark_string_conversions	No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147	48	2024-07-16 16:38:26.438000	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test	No reports found!
gz_rendering-8-win#70	42	2024-07-17 01:06:14.271000	MeshTest.NormalMapWithoutTexCoord	No reports found!
gz_rendering-7-win#63	35	2024-07-17 00:06:12.601000	MeshTest.NormalMapWithoutTexCoord	No reports found!
gz_rendering-main-win#62	33	2024-07-17 02:06:14.849000	MeshTest.NormalMapWithoutTexCoord	No reports found!
Jci__nightly-connext_ubuntu_noble_amd64#33	33	2024-07-17 06:15:00.217000	projectroot.test.rclcpp.test_subscription_topic_statistics rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset	No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#57	32	2024-07-18 03:40:00.356000	performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp	No reports found!
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64#32	32	2024-07-17 10:29:32.280000	projectroot.test_generic_pub_sub projectroot.test_generic_subscription projectroot.test_pub_sub test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all test_tracetools.test_tracetools.test.test_generic_subscription.TestGenericSubscription.test_all test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all	`https://github.com/ros2/ros2_tracing/issues/124` (Closed)
Hci__nightly-connext_ubuntu_jammy_amd64#255	24	2024-07-18 06:15:00.322000	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test	No reports found!
Jci__benchmark_ubuntu_noble_amd64#19	19	2024-07-18 02:21:13.767000	projectroot.benchmark_string_conversions projectroot.benchmark_string_conversions	No reports found!
nightly_linux-rhel_repeated#1968	10	2024-07-18 04:00:01.171000	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3] test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]	No reports found!
nightly_linux_repeated#3521	9	2024-07-17 08:21:14.566000	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3] test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]	No reports found!
Hci__nightly-connext_ubuntu_jammy_amd64#255	9	2024-07-18 06:15:00.322000	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test	No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#19	8	2024-07-17 23:57:02.066000	performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp	No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109	7	2024-07-17 04:43:17.848000	projectroot.lint_cmake projectroot.uncrustify	No reports found!
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#145	4	2024-07-17 00:16:52.091000	projectroot.test_publisher projectroot.test_subscription	`https://github.com/ros2/system_tests/issues/496` (Closed)
Hci__nightly-performance_ubuntu_jammy_amd64#245	4	2024-07-16 06:05:11.472000	projectroot.lint_cmake projectroot.uncrustify	No reports found!
nightly_linux-rhel_repeated#1968	3	2024-07-18 04:00:01.171000	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3]	No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#89	3	2024-07-17 14:27:43.828000	projectroot.test.rclcpp.test_service_introspection rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content	No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147	3	2024-07-16 16:38:26.438000	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test	No reports found!

Warnings

Reference build	Age	Failure DateTime	Errors	Reports
sdformat-ci-main-noble-amd64#20	-1	2024-07-17 20:48:06.890000	8 gcc warnings	No reports found!
nightly_linux_release#3142	-1	2024-07-18 07:28:35.818000	1 clang warnings 1 clang-tidy warnings 1 gcc warnings	No reports found!
nightly_linux-aarch64_release#2797	-1	2024-07-18 04:00:01.008000	1 clang warnings 1 clang-tidy warnings 1 gcc warnings	No reports found!
gz_rendering-main-win#62	-1	2024-07-17 02:06:14.849000	2 msbuild warnings	No reports found!
gz_rendering-8-win#70	-1	2024-07-17 01:06:14.271000	2 msbuild warnings	No reports found!
gz_rendering-7-win#63	-1	2024-07-17 00:06:12.601000	2 msbuild warnings	No reports found!
Rci__nightly-release_ubuntu_noble_amd64#85	-1	2024-07-17 23:19:47.160000	1 clang-tidy warnings 1 gcc warnings	No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#57	-1	2024-07-18 03:40:00.356000	2 clang-tidy warnings 2 cmake warnings 30 gcc warnings	No reports found!
Jci__nightly-release_ubuntu_noble_amd64#33	-1	2024-07-17 14:21:26.693000	1 clang-tidy warnings 1 gcc warnings	No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#19	-1	2024-07-17 23:57:02.066000	2 clang-tidy warnings 2 cmake warnings 30 gcc warnings	No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109	-1	2024-07-17 04:43:17.848000	2 clang-tidy warnings 30 gcc warnings 4 cmake warnings	No reports found!
Hci__nightly-performance_ubuntu_jammy_amd64#245	-1	2024-07-16 06:05:11.472000	2 clang-tidy warnings 30 gcc warnings 4 cmake warnings	No reports found!

Test regressions flaky

Test regressions

Reference builds Errors Flaky report Reports

nightly_win_rel#3110

projectroot.test.rclcpp.test_executors

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-04	5	5	100.0%
Rci__nightly-cyclonedds_ubuntu_noble_amd64	2024-07-10	2024-07-04	12	6	50.0%
Jcinightly-cyclonedds_ubuntu_noble_amd64	2024-07-05	2024-07-05	3	1	33.33%
nightly_win_rep	2024-07-06	2024-07-05	11	2	18.18%
nightly_linux_debug	2024-07-10	2024-07-04	12	2	16.67%
nightly_win_rel	2024-07-18	2024-07-18	15	1	6.67%
nightly_linux-rhel_repeated	2024-07-04	2024-07-04	15	1	6.67%

https://github.com/ros2/rclcpp/issues/2502 (Closed)

nightly_win_rel#3110

projectroot.test.rclcpp.test_subscription_topic_statistics

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-04	11	11	100.0%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-05	3	3	100.0%
nightly_win_rep	2024-07-05	2024-07-05	11	1	9.09%
nightly_win_rel	2024-07-18	2024-07-18	15	1	6.67%

No reports found!

nightly_linux_repeated#3521

launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Hci__nightly-connext_ubuntu_jammy_amd64	2024-07-18	2024-07-11	4	4	100.0%
Ici__nightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-04	5	4	80.0%
nightly_linux-aarch64_repeated	2024-07-11	2024-07-09	14	3	21.43%
nightly_linux_repeated	2024-07-17	2024-07-16	11	2	18.18%
nightly_linux-rhel_repeated	2024-07-14	2024-07-14	15	1	6.67%
nightly_linux-aarch64_debug	2024-07-04	2024-07-04	15	1	6.67%

No reports found!

projectroot.uncrustify
projectroot.uncrustify

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-performance_ubuntu_noble_amd64	2024-07-18	2024-07-07	5	5	100.0%
Jci__nightly-performance_ubuntu_noble_amd64	2024-07-17	2024-07-06	2	2	100.0%
Icinightly-performance_ubuntu_jammy_amd64	2024-07-17	2024-07-09	5	5	100.0%
Hci__nightly-performance_ubuntu_jammy_amd64	2024-07-16	2024-07-12	3	3	100.0%

No reports found!

projectroot.test_publisher
projectroot.test_publisher

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-17	2024-07-05	3	3	100.0%
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64	2024-07-17	2024-07-05	5	5	100.0%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-04	5	5	100.0%
nightly_win_rep	2024-07-10	2024-07-10	11	1	9.09%

https://github.com/ros2/system_tests/issues/496 (Closed)

projectroot.test_subscription
projectroot.test_subscription

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-17	2024-07-05	3	3	100.0%
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64	2024-07-17	2024-07-05	5	5	100.0%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-04	5	5	100.0%
nightly_win_rep	2024-07-17	2024-07-10	11	2	18.18%
nightly_win_rel	2024-07-16	2024-07-16	15	1	6.67%

No reports found!

Jci__nightly-connext_ubuntu_noble_amd64#33

projectroot.test_generic_pub_sub

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-17	2024-07-05	3	3	100.0%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-17	3	1	33.33%

https://github.com/ros2/ros2_tracing/issues/124 (Closed)

Jci__nightly-connext_ubuntu_noble_amd64#33

test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-17	2024-07-05	3	3	100.0%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-17	3	1	33.33%
nightly_linux_repeated	2024-07-04	2024-07-04	11	1	9.09%
Rcinightly-connext_ubuntu_noble_amd64	2024-07-04	2024-07-04	11	1	9.09%
nightly_linux-rhel_release	2024-07-04	2024-07-04	14	1	7.14%
nightly_linux-rhel_repeated	2024-07-04	2024-07-04	15	1	6.67%

https://github.com/ros2/ros2_tracing/issues/124 (Closed)

buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-performance_ubuntu_noble_amd64	2024-07-18	2024-07-07	5	4	80.0%
Ici__nightly-performance_ubuntu_jammy_amd64	2024-07-17	2024-07-09	5	4	80.0%
Hcinightly-performance_ubuntu_jammy_amd64	2024-07-13	2024-07-12	3	2	66.67%
Jci__nightly-performance_ubuntu_noble_amd64	2024-07-17	2024-07-17	2	1	50.0%

No reports found!

projectroot.test.test_performance_CycloneDDS_sync_Array8m
projectroot.test.test_performance_CycloneDDS_sync_Array8m
projectroot.test.test_performance_CycloneDDS_sync_Array8m

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-performance_ubuntu_noble_amd64	2024-07-18	2024-07-07	5	4	80.0%
Hci__nightly-performance_ubuntu_jammy_amd64	2024-07-13	2024-07-12	3	2	66.67%
Icinightly-performance_ubuntu_jammy_amd64	2024-07-17	2024-07-11	5	3	60.0%
Jci__nightly-performance_ubuntu_noble_amd64	2024-07-17	2024-07-17	2	1	50.0%

No reports found!

Rci__nightly-performance_ubuntu_noble_amd64#57

projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-performance_ubuntu_noble_amd64	2024-07-18	2024-07-07	5	4	80.0%
Hci__nightly-performance_ubuntu_jammy_amd64	2024-07-13	2024-07-12	3	2	66.67%
Icinightly-performance_ubuntu_jammy_amd64	2024-07-14	2024-07-09	5	3	60.0%

No reports found!

projectroot.test.rclcpp.test_service_introspection
projectroot.test.rclcpp.test_service_introspection

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-connext_ubuntu_noble_amd64	2024-07-14	2024-07-05	3	2	66.67%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-04	11	6	54.55%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-09	5	2	40.0%
nightly_win_rel	2024-07-18	2024-07-18	15	1	6.67%

No reports found!

rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-connext_ubuntu_noble_amd64	2024-07-14	2024-07-05	3	2	66.67%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-04	11	5	45.45%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-09	5	2	40.0%
nightly_win_rel	2024-07-18	2024-07-18	15	1	6.67%

No reports found!

Rci__nightly-connext_ubuntu_noble_amd64#89

projectroot.test_client

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-14	2024-07-05	3	2	66.67%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-04	11	5	45.45%
nightly_win_rep	2024-07-09	2024-07-04	11	3	27.27%
nightly_win_deb	2024-07-11	2024-07-11	14	1	7.14%

No reports found!

Rci__nightly-connext_ubuntu_noble_amd64#89

rclpy.rclpy.test.test_client.TestClient.test_service_timestamps

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-14	2024-07-05	3	2	66.67%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-04	11	5	45.45%

No reports found!

nightly_linux_coverage#2463

ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux_coverage	2024-07-18	2024-07-04	14	9	64.29%
nightly_linux_debug	2024-07-13	2024-07-13	12	1	8.33%

https://github.com/ros2/ros2cli/issues/772 (Closed)

rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-04	11	6	54.55%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-05	2024-07-05	3	1	33.33%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-16	5	1	20.0%
nightly_win_rel	2024-07-18	2024-07-18	15	1	6.67%

No reports found!

nightly_win_rel#3110

projectroot.test.rclcpp.test_executors_busy_waiting

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rci__nightly-cyclonedds_ubuntu_noble_amd64	2024-07-10	2024-07-04	12	6	50.0%
nightly_win_rep	2024-07-12	2024-07-05	11	4	36.36%
nightly_linux-aarch64_repeated	2024-07-06	2024-07-06	14	1	7.14%
nightly_win_rel	2024-07-18	2024-07-18	15	1	6.67%

No reports found!

nightly_win_rel#3110

rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_all

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rci__nightly-cyclonedds_ubuntu_noble_amd64	2024-07-10	2024-07-04	12	6	50.0%
Jci__nightly-cyclonedds_ubuntu_noble_amd64	2024-07-05	2024-07-05	3	1	33.33%
nightly_win_rep	2024-07-05	2024-07-05	11	1	9.09%
nightly_win_rel	2024-07-18	2024-07-18	15	1	6.67%

https://github.com/ros2/rclcpp/issues/2502 (Closed)

nightly_win_rel#3110

projectroot.test.rclcpp.test_clock
rclcpp.TestClockWakeup.multiple_threads_wait_on_one_clock

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux_repeated	2024-07-12	2024-07-04	11	4	36.36%
nightly_win_rep	2024-07-11	2024-07-07	11	4	36.36%
nightly_linux-rhel_repeated	2024-07-13	2024-07-12	15	2	13.33%
nightly_win_rel	2024-07-18	2024-07-18	15	1	6.67%

No reports found!

nightly_win_rel#3110

projectroot.test.rclcpp.test_executor

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-17	2024-07-04	11	4	36.36%
nightly_win_deb	2024-07-06	2024-07-06	14	1	7.14%
nightly_win_rel	2024-07-18	2024-07-18	15	1	6.67%

https://github.com/ros2/rclcpp/issues/2502 (Closed)

nightly_win_rel#3110

sros2.test.sros2.commands.security.verbs.test_generate_policy.test_generate_policy

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_deb	2024-07-12	2024-07-05	14	5	35.71%
nightly_win_rel	2024-07-18	2024-07-04	15	5	33.33%
nightly_win_rep	2024-07-05	2024-07-05	11	1	9.09%

No reports found!

Jci__nightly-connext_ubuntu_noble_amd64#33

projectroot.tf2_ros_test_message_filter
tf2_ros.tf2_ros_test_message_filter.gtest.missing_result

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-17	3	1	33.33%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-12	2024-07-05	11	3	27.27%

No reports found!

nightly_win_rel#3110

rclcpp.test_executor.gtest.missing_result

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-17	2024-07-04	11	3	27.27%
nightly_win_deb	2024-07-06	2024-07-06	14	1	7.14%
nightly_win_rel	2024-07-18	2024-07-18	15	1	6.67%

No reports found!

nightly_linux_repeated#3521

projectroot.test_client_scope_cpp__rmw_cyclonedds_cpp
test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux_repeated	2024-07-17	2024-07-10	11	3	27.27%
nightly_linux-rhel_repeated	2024-07-13	2024-07-13	15	1	6.67%

No reports found!

nightly_linux_repeated#3521

projectroot.test_generic_pub_sub__rmw_connextdds

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux_repeated	2024-07-17	2024-07-04	11	3	27.27%
nightly_linux-rhel_repeated	2024-07-12	2024-07-04	15	3	20.0%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-04	2024-07-04	11	1	9.09%
nightly_linux-rhel_release	2024-07-04	2024-07-04	14	1	7.14%

https://github.com/ros2/ros2_tracing/issues/124 (Closed)

nightly_win_deb#3158

projectroot.copyright
rviz_default_plugins.copyright.xunit.missing_result

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_deb	2024-07-18	2024-07-12	14	3	21.43%

No reports found!

nightly_linux-rhel_repeated#1968

projectroot.test_pub_sub__rmw_connextdds

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux-rhel_repeated	2024-07-18	2024-07-04	15	3	20.0%
nightly_linux_repeated	2024-07-04	2024-07-04	11	1	9.09%

No reports found!

Maintenance

Pending

:yellow_circle: Jul 19th buildfarm Urgent test regressions

Buildfarmer: @claraberendsen

ROS

Performance regressions

https://github.com/ros2/performance_test/issues/48 Performace test regressions were partially reported by @Crola1702. However the report does not seem to pickup the related error.

Affected builds:
Uncrustify regression There seems to be a standalone regression on file https://github.com/ros2/performance_test/blob/master/performance_test/src/communication_abstractions/connext_dds_micro_communicator.hpp that is affecting all distros.
Linux repeated regressions
https://github.com/ros2/launch_ros/issues/407 [NEW] Reported consistent regressions on all repeated jobs on ci.ros2.org
Benchmark regressions
https://github.com/ros2/rosidl_typesupport_fastrtps/issues/119 [NEW] Affects Rci and Jci on noble, but it seems to be happening on the jammy side as well and it has been transported over on the noble change. The first appearance seems to be on March 27th
Gazebo
https://github.com/gazebosim/gz-rendering/issues/745 Known issue for a while now. Updating with new information, the solution seems to be to install ogre 2.3 as per previous discussions with the team. It seems that from garden onward it needs ogre 2.3 and that is not installed.

ACTION ITEM: Verify locally if the vcpkg port works and add it to the machine.

Follow up question: @Crola1702 do we have a way to link an existing error to the report.

Jul 20

Urgent

Test regressions consecutive

Test regressions

Reference build	Age	Failure DateTime	Errors	Reports
Ici__nightly-connext_ubuntu_jammy_amd64#147	147	2024-07-16 16:38:26.438000	projectroot.test.rclcpp.test_executors projectroot.test_pub_sub rclcpp.TestClient.client_qos rclcpp.TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all	`https://github.com/ros2/rclcpp/issues/2502` (Closed)
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#145	110	2024-07-17 00:16:52.091000	projectroot.test_pub_sub test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all	No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109	108	2024-07-17 04:43:17.848000	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23) performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp	No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#89	89	2024-07-17 14:27:43.828000	projectroot.test.rclcpp.test_subscription_topic_statistics rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset	No reports found!
Rci__benchmark_ubuntu_noble_amd64#54	54	2024-07-18 03:07:55.831000	projectroot.benchmark_string_conversions projectroot.benchmark_string_conversions	No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147	48	2024-07-16 16:38:26.438000	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test	No reports found!
gz_rendering-8-win#70	42	2024-07-17 01:06:14.271000	MeshTest.NormalMapWithoutTexCoord	No reports found!
gz_rendering-7-win#63	35	2024-07-17 00:06:12.601000	MeshTest.NormalMapWithoutTexCoord	No reports found!
gz_rendering-main-win#62	33	2024-07-17 02:06:14.849000	MeshTest.NormalMapWithoutTexCoord	No reports found!
Jci__nightly-connext_ubuntu_noble_amd64#33	33	2024-07-17 06:15:00.217000	projectroot.test.rclcpp.test_subscription_topic_statistics rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset	No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#57	32	2024-07-18 03:40:00.356000	performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp	No reports found!
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64#32	32	2024-07-17 10:29:32.280000	projectroot.test_generic_pub_sub projectroot.test_generic_subscription projectroot.test_pub_sub test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all test_tracetools.test_tracetools.test.test_generic_subscription.TestGenericSubscription.test_all test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all	`https://github.com/ros2/ros2_tracing/issues/124` (Closed)
Hci__nightly-connext_ubuntu_jammy_amd64#255	24	2024-07-18 06:15:00.322000	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test	No reports found!
Jci__benchmark_ubuntu_noble_amd64#19	19	2024-07-18 02:21:13.767000	projectroot.benchmark_string_conversions projectroot.benchmark_string_conversions	No reports found!
nightly_linux-rhel_repeated#1968	10	2024-07-18 04:00:01.171000	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3] test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]	No reports found!
nightly_linux_repeated#3521	9	2024-07-17 08:21:14.566000	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3] test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]	No reports found!
Hci__nightly-connext_ubuntu_jammy_amd64#255	9	2024-07-18 06:15:00.322000	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test	No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#19	8	2024-07-17 23:57:02.066000	performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp	No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109	7	2024-07-17 04:43:17.848000	projectroot.lint_cmake projectroot.uncrustify	No reports found!
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#145	4	2024-07-17 00:16:52.091000	projectroot.test_publisher projectroot.test_subscription	`https://github.com/ros2/system_tests/issues/496` (Closed)
nightly_linux-rhel_repeated#1968	3	2024-07-18 04:00:01.171000	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3]	No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#89	3	2024-07-17 14:27:43.828000	projectroot.test.rclcpp.test_service_introspection rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content	No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147	3	2024-07-16 16:38:26.438000	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test	No reports found!

Warnings

Reference build	Age	Failure DateTime	Errors	Reports
sdformat-ci-main-noble-amd64#20	-1	2024-07-17 20:48:06.890000	8 gcc warnings	No reports found!
nightly_linux_release#3142	-1	2024-07-18 07:28:35.818000	1 clang warnings 1 clang-tidy warnings 1 gcc warnings	No reports found!
nightly_linux-aarch64_release#2797	-1	2024-07-18 04:00:01.008000	1 clang warnings 1 clang-tidy warnings 1 gcc warnings	No reports found!
gz_rendering-main-win#62	-1	2024-07-17 02:06:14.849000	2 msbuild warnings	No reports found!
gz_rendering-8-win#70	-1	2024-07-17 01:06:14.271000	2 msbuild warnings	No reports found!
gz_rendering-7-win#63	-1	2024-07-17 00:06:12.601000	2 msbuild warnings	No reports found!
Rci__nightly-release_ubuntu_noble_amd64#85	-1	2024-07-17 23:19:47.160000	1 clang-tidy warnings 1 gcc warnings	No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#57	-1	2024-07-18 03:40:00.356000	2 clang-tidy warnings 2 cmake warnings 30 gcc warnings	No reports found!
Jci__nightly-release_ubuntu_noble_amd64#33	-1	2024-07-17 14:21:26.693000	1 clang-tidy warnings 1 gcc warnings	No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#19	-1	2024-07-17 23:57:02.066000	2 clang-tidy warnings 2 cmake warnings 30 gcc warnings	No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109	-1	2024-07-17 04:43:17.848000	2 clang-tidy warnings 30 gcc warnings 4 cmake warnings	No reports found!

Test regressions flaky

Test regressions

Reference builds Errors Flaky report Reports

nightly_win_rel#3110

projectroot.test.rclcpp.test_executors

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-09	4	4	100.0%
Rci__nightly-cyclonedds_ubuntu_noble_amd64	2024-07-10	2024-07-06	11	5	45.45%
Jcinightly-cyclonedds_ubuntu_noble_amd64	2024-07-05	2024-07-05	3	1	33.33%
nightly_win_rep	2024-07-06	2024-07-05	10	2	20.0%
nightly_linux_debug	2024-07-10	2024-07-10	11	1	9.09%
nightly_win_rel	2024-07-18	2024-07-18	14	1	7.14%

https://github.com/ros2/rclcpp/issues/2502 (Closed)

nightly_win_rel#3110

projectroot.test.rclcpp.test_subscription_topic_statistics

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-05	10	10	100.0%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-05	3	3	100.0%
nightly_win_rep	2024-07-05	2024-07-05	10	1	10.0%
nightly_win_rel	2024-07-18	2024-07-18	14	1	7.14%

No reports found!

nightly_linux_repeated#3521

launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Hci__nightly-connext_ubuntu_jammy_amd64	2024-07-18	2024-07-11	4	4	100.0%
Ici__nightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-10	4	3	75.0%
nightly_linux-aarch64_repeated	2024-07-11	2024-07-09	13	3	23.08%
nightly_linux_repeated	2024-07-17	2024-07-16	10	2	20.0%
nightly_linux-rhel_repeated	2024-07-14	2024-07-14	14	1	7.14%

No reports found!

projectroot.uncrustify
projectroot.uncrustify

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-performance_ubuntu_noble_amd64	2024-07-18	2024-07-07	5	5	100.0%
Jci__nightly-performance_ubuntu_noble_amd64	2024-07-17	2024-07-06	2	2	100.0%
Icinightly-performance_ubuntu_jammy_amd64	2024-07-17	2024-07-09	5	5	100.0%
Hci__nightly-performance_ubuntu_jammy_amd64	2024-07-16	2024-07-12	3	3	100.0%

No reports found!

projectroot.test_publisher
projectroot.test_publisher

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-17	2024-07-05	3	3	100.0%
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64	2024-07-17	2024-07-05	5	5	100.0%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-09	4	4	100.0%
nightly_win_rep	2024-07-10	2024-07-10	10	1	10.0%

https://github.com/ros2/system_tests/issues/496 (Closed)

projectroot.test_subscription
projectroot.test_subscription

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-17	2024-07-05	3	3	100.0%
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64	2024-07-17	2024-07-05	5	5	100.0%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-09	4	4	100.0%
nightly_win_rep	2024-07-17	2024-07-10	10	2	20.0%
nightly_win_rel	2024-07-16	2024-07-16	14	1	7.14%

No reports found!

Jci__nightly-connext_ubuntu_noble_amd64#33

projectroot.test_generic_pub_sub
test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-17	2024-07-05	3	3	100.0%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-17	3	1	33.33%

https://github.com/ros2/ros2_tracing/issues/124 (Closed)

buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-performance_ubuntu_noble_amd64	2024-07-18	2024-07-07	5	4	80.0%
Ici__nightly-performance_ubuntu_jammy_amd64	2024-07-17	2024-07-09	5	4	80.0%
Hcinightly-performance_ubuntu_jammy_amd64	2024-07-13	2024-07-12	3	2	66.67%
Jci__nightly-performance_ubuntu_noble_amd64	2024-07-17	2024-07-17	2	1	50.0%

No reports found!

projectroot.test.test_performance_CycloneDDS_sync_Array8m
projectroot.test.test_performance_CycloneDDS_sync_Array8m
projectroot.test.test_performance_CycloneDDS_sync_Array8m

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-performance_ubuntu_noble_amd64	2024-07-18	2024-07-07	5	4	80.0%
Hci__nightly-performance_ubuntu_jammy_amd64	2024-07-13	2024-07-12	3	2	66.67%
Icinightly-performance_ubuntu_jammy_amd64	2024-07-17	2024-07-11	5	3	60.0%
Jci__nightly-performance_ubuntu_noble_amd64	2024-07-17	2024-07-17	2	1	50.0%

No reports found!

Rci__nightly-performance_ubuntu_noble_amd64#57

projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-performance_ubuntu_noble_amd64	2024-07-18	2024-07-07	5	4	80.0%
Hci__nightly-performance_ubuntu_jammy_amd64	2024-07-13	2024-07-12	3	2	66.67%
Icinightly-performance_ubuntu_jammy_amd64	2024-07-14	2024-07-09	5	3	60.0%

No reports found!

projectroot.test.rclcpp.test_service_introspection
projectroot.test.rclcpp.test_service_introspection

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-connext_ubuntu_noble_amd64	2024-07-14	2024-07-05	3	2	66.67%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-06	10	5	50.0%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-09	4	2	50.0%
nightly_win_rel	2024-07-18	2024-07-18	14	1	7.14%

No reports found!

rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-connext_ubuntu_noble_amd64	2024-07-14	2024-07-05	3	2	66.67%
Ici__nightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-09	4	2	50.0%
Rcinightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-06	10	4	40.0%
nightly_win_rel	2024-07-18	2024-07-18	14	1	7.14%

No reports found!

Rci__nightly-connext_ubuntu_noble_amd64#89

projectroot.test_client

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-14	2024-07-05	3	2	66.67%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-06	10	4	40.0%
nightly_win_rep	2024-07-09	2024-07-07	10	2	20.0%
nightly_win_deb	2024-07-11	2024-07-11	13	1	7.69%

No reports found!

Rci__nightly-connext_ubuntu_noble_amd64#89

rclpy.rclpy.test.test_client.TestClient.test_service_timestamps

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-14	2024-07-05	3	2	66.67%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-06	10	4	40.0%

No reports found!

nightly_linux_coverage#2463

ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux_coverage	2024-07-18	2024-07-05	13	8	61.54%
nightly_linux_debug	2024-07-13	2024-07-13	11	1	9.09%

https://github.com/ros2/ros2cli/issues/772 (Closed)

rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-06	10	5	50.0%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-05	2024-07-05	3	1	33.33%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-16	4	1	25.0%
nightly_win_rel	2024-07-18	2024-07-18	14	1	7.14%

No reports found!

nightly_win_rel#3110

projectroot.test.rclcpp.test_executors_busy_waiting

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rci__nightly-cyclonedds_ubuntu_noble_amd64	2024-07-10	2024-07-06	11	5	45.45%
nightly_win_rep	2024-07-12	2024-07-05	10	4	40.0%
nightly_linux-aarch64_repeated	2024-07-06	2024-07-06	13	1	7.69%
nightly_win_rel	2024-07-18	2024-07-18	14	1	7.14%

No reports found!

nightly_win_rel#3110

rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_all

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rci__nightly-cyclonedds_ubuntu_noble_amd64	2024-07-10	2024-07-06	11	5	45.45%
Jci__nightly-cyclonedds_ubuntu_noble_amd64	2024-07-05	2024-07-05	3	1	33.33%
nightly_win_rep	2024-07-05	2024-07-05	10	1	10.0%
nightly_win_rel	2024-07-18	2024-07-18	14	1	7.14%

https://github.com/ros2/rclcpp/issues/2502 (Closed)

nightly_win_rel#3110

projectroot.test.rclcpp.test_clock
rclcpp.TestClockWakeup.multiple_threads_wait_on_one_clock

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-11	2024-07-07	10	4	40.0%
nightly_linux_repeated	2024-07-12	2024-07-07	10	3	30.0%
nightly_linux-rhel_repeated	2024-07-13	2024-07-12	14	2	14.29%
nightly_win_rel	2024-07-18	2024-07-18	14	1	7.14%

No reports found!

nightly_win_rel#3110

sros2.test.sros2.commands.security.verbs.test_generate_policy.test_generate_policy

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_deb	2024-07-12	2024-07-05	13	5	38.46%
nightly_win_rel	2024-07-18	2024-07-05	14	4	28.57%
nightly_win_rep	2024-07-05	2024-07-05	10	1	10.0%

No reports found!

Jci__nightly-connext_ubuntu_noble_amd64#33

projectroot.tf2_ros_test_message_filter
tf2_ros.tf2_ros_test_message_filter.gtest.missing_result

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-17	2024-07-17	3	1	33.33%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-12	2024-07-05	10	3	30.0%

No reports found!

nightly_win_rel#3110

projectroot.test.rclcpp.test_executor

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-17	2024-07-05	10	3	30.0%
nightly_win_deb	2024-07-06	2024-07-06	13	1	7.69%
nightly_win_rel	2024-07-18	2024-07-18	14	1	7.14%

https://github.com/ros2/rclcpp/issues/2502 (Closed)

nightly_linux_repeated#3521

projectroot.test_client_scope_cpp__rmw_cyclonedds_cpp
test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux_repeated	2024-07-17	2024-07-10	10	3	30.0%
nightly_linux-rhel_repeated	2024-07-13	2024-07-13	14	1	7.14%

No reports found!

nightly_win_deb#3158

projectroot.copyright
rviz_default_plugins.copyright.xunit.missing_result

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_deb	2024-07-18	2024-07-12	13	3	23.08%

No reports found!

Maintenance

Pending

Jul 21

Urgent

Build regressions

Reference Build	Failure DateTime	Failure Reason
nightly_linux_coverage#2466	2024-07-21 04:00	Early fail
nightly_linux_debug#3124	2024-07-21 04:00	Early fail
nightly_linux_humble_coverage#868	2024-07-21 04:01	Early fail
nightly_linux_iron_coverage#502	2024-07-21 04:01	Early fail
nightly_linux_release#3145	2024-07-21 04:01	Early fail
nightly_linux_repeated#3525	2024-07-21 04:02	Early fail
packaging_linux#3510	2024-07-21 04:02	Early fail
nightly_linux-rhel_repeated#1971	2024-07-21 04:00	Early fail
packaging_linux-rhel#2011	2024-07-21 04:03	Early fail

Test regressions consecutive

Test regressions

Reference build	Age	Failure DateTime	Errors	Reports
Hci__nightly-performance_ubuntu_jammy_amd64#246	236	2024-07-19 02:33:12.420000	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22) performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23) performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp	No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#148	148	2024-07-19 06:15:00.326000	projectroot.test.rclcpp.test_executors projectroot.test_pub_sub rclcpp.TestClient.client_qos rclcpp.TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all	`https://github.com/ros2/rclcpp/issues/2502` (Closed)
Rci__nightly-connext_ubuntu_noble_amd64#92	92	2024-07-20 14:12:04.439000	projectroot.test.rclcpp.test_subscription_topic_statistics rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset	No reports found!
Rci__benchmark_ubuntu_noble_amd64#56	56	2024-07-21 03:08:58.899000	projectroot.benchmark_string_conversions projectroot.benchmark_string_conversions	No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#148	49	2024-07-19 06:15:00.326000	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test	No reports found!
gz_rendering-8-win#71	43	2024-07-19 19:27:32.266000	MeshTest.NormalMapWithoutTexCoord	No reports found!
gz_rendering-7-win#64	36	2024-07-21 01:06:18.052000	MeshTest.NormalMapWithoutTexCoord	No reports found!
Jci__nightly-connext_ubuntu_noble_amd64#35	35	2024-07-20 23:00:35.778000	projectroot.test.rclcpp.test_subscription_topic_statistics rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset	No reports found!
gz_rendering-main-win#63	34	2024-07-21 03:06:19.669000	MeshTest.NormalMapWithoutTexCoord	No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#59	34	2024-07-21 03:17:33.956000	performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp	No reports found!
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64#33	33	2024-07-20 09:43:36.477000	projectroot.test_generic_pub_sub projectroot.test_generic_subscription projectroot.test_pub_sub test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all test_tracetools.test_tracetools.test.test_generic_subscription.TestGenericSubscription.test_all test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all	`https://github.com/ros2/ros2_tracing/issues/124` (Closed)
Hci__nightly-connext_ubuntu_jammy_amd64#256	25	2024-07-21 06:15:00.915000	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test	No reports found!
Jci__benchmark_ubuntu_noble_amd64#20	20	2024-07-20 23:43:07.833000	projectroot.benchmark_string_conversions projectroot.benchmark_string_conversions	No reports found!
nightly_linux-aarch64_repeated#2827	15	2024-07-21 04:00:00.958000	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3] test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]	No reports found!
Hci__nightly-connext_ubuntu_jammy_amd64#256	10	2024-07-21 06:15:00.915000	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test	No reports found!
nightly_win_rep#3422	9	2024-07-21 04:00:01.342000	projectroot.gtest_multithreaded__rmw_connextdds	No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#20	9	2024-07-21 00:24:31.952000	performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp	No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#92	6	2024-07-20 14:12:04.439000	projectroot.test.rclcpp.test_service_introspection rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content	No reports found!
Hci__nightly-performance_ubuntu_jammy_amd64#246	5	2024-07-19 02:33:12.420000	projectroot.lint_cmake projectroot.uncrustify	No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#92	4	2024-07-20 14:12:04.439000	rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events rclpy.rclpy.test.test_client.TestClient.test_service_timestamps	No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#148	4	2024-07-19 06:15:00.326000	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test	No reports found!
Hci__nightly-connext_ubuntu_jammy_amd64#256	3	2024-07-21 06:15:00.915000	projectroot.test_buffer_client_tester.launch.py test_tf2.BufferClientTestAfterShutdown.test_exit_code	No reports found!

Warnings

Reference build	Age	Failure DateTime	Errors	Reports
sdformat-ci-main-noble-amd64#20	-1	2024-07-17 20:48:06.890000	8 gcc warnings	No reports found!
nightly_linux-aarch64_release#2800	-1	2024-07-21 04:00:00.953000	1 clang warnings 1 clang-tidy warnings 1 gcc warnings	No reports found!
gz_rendering-main-win#63	-1	2024-07-21 03:06:19.669000	2 msbuild warnings	No reports found!
gz_rendering-8-win#71	-1	2024-07-19 19:27:32.266000	2 msbuild warnings	No reports found!
gz_rendering-7-win#64	-1	2024-07-21 01:06:18.052000	2 msbuild warnings	No reports found!
Rci__nightly-release_ubuntu_noble_amd64#88	-1	2024-07-20 22:07:13.532000	1 clang-tidy warnings 1 gcc warnings	No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#59	-1	2024-07-21 03:17:33.956000	2 clang-tidy warnings 2 cmake warnings 30 gcc warnings	No reports found!
Jci__nightly-release_ubuntu_noble_amd64#34	-1	2024-07-20 13:27:55.774000	1 clang-tidy warnings 1 gcc warnings	No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#20	-1	2024-07-21 00:24:31.952000	2 clang-tidy warnings 2 cmake warnings 30 gcc warnings	No reports found!
Hci__nightly-performance_ubuntu_jammy_amd64#246	-1	2024-07-19 02:33:12.420000	2 clang-tidy warnings 30 gcc warnings 4 cmake warnings	No reports found!

Test regressions flaky

Test regressions

Reference builds Errors Flaky report Reports

projectroot.uncrustify
projectroot.uncrustify

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-performance_ubuntu_noble_amd64	2024-07-21	2024-07-07	7	7	100.0%
Jci__nightly-performance_ubuntu_noble_amd64	2024-07-21	2024-07-06	3	3	100.0%
Hcinightly-performance_ubuntu_jammy_amd64	2024-07-19	2024-07-12	4	4	100.0%
Ici__nightly-performance_ubuntu_jammy_amd64	2024-07-17	2024-07-09	5	5	100.0%

No reports found!

projectroot.test_publisher
projectroot.test_publisher

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-20	2024-07-14	3	3	100.0%
Ici__nightly-connext_ubuntu_jammy_amd64	2024-07-19	2024-07-09	5	5	100.0%
Icinightly-fastrtps-dynamic_ubuntu_jammy_amd64	2024-07-17	2024-07-10	4	4	100.0%
nightly_win_rep	2024-07-10	2024-07-10	11	1	9.09%

https://github.com/ros2/system_tests/issues/496 (Closed)

projectroot.test_subscription
projectroot.test_subscription

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-fastrtps-dynamic_ubuntu_noble_amd64	2024-07-20	2024-07-14	3	3	100.0%
Ici__nightly-connext_ubuntu_jammy_amd64	2024-07-19	2024-07-09	5	5	100.0%
Icinightly-fastrtps-dynamic_ubuntu_jammy_amd64	2024-07-17	2024-07-10	4	4	100.0%
nightly_win_rep	2024-07-17	2024-07-10	11	2	18.18%
nightly_win_rel	2024-07-16	2024-07-16	14	1	7.14%

No reports found!

nightly_win_deb#3161

projectroot.gtest_multithreaded__rmw_connextdds

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-21	2024-07-06	11	9	81.82%
nightly_win_deb	2024-07-21	2024-07-06	14	5	35.71%
nightly_win_rel	2024-07-16	2024-07-06	14	2	14.29%

No reports found!

nightly_win_rep#3422

test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_linux-aarch64_repeated	2024-07-21	2024-07-09	15	12	80.0%
nightly_linux-rhel_repeated	2024-07-20	2024-07-09	15	12	80.0%
nightly_win_rep	2024-07-21	2024-07-09	11	8	72.73%
nightly_linux_repeated	2024-07-18	2024-07-09	10	7	70.0%

No reports found!

Rci__nightly-performance_ubuntu_noble_amd64#59

buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Icinightly-performance_ubuntu_jammy_amd64	2024-07-17	2024-07-09	5	4	80.0%
Rci__nightly-performance_ubuntu_noble_amd64	2024-07-21	2024-07-07	7	5	71.43%
Hcinightly-performance_ubuntu_jammy_amd64	2024-07-13	2024-07-12	4	2	50.0%
Jci__nightly-performance_ubuntu_noble_amd64	2024-07-17	2024-07-17	3	1	33.33%

No reports found!

Rci__nightly-performance_ubuntu_noble_amd64#59

projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-performance_ubuntu_noble_amd64	2024-07-21	2024-07-07	7	5	71.43%
Ici__nightly-performance_ubuntu_jammy_amd64	2024-07-14	2024-07-09	5	3	60.0%
Hcinightly-performance_ubuntu_jammy_amd64	2024-07-13	2024-07-12	4	2	50.0%

No reports found!

projectroot.test_client
projectroot.test_client
projectroot.test_client

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-connext_ubuntu_noble_amd64	2024-07-20	2024-07-14	3	2	66.67%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-20	2024-07-06	12	7	58.33%
Hcinightly-connext_ubuntu_jammy_amd64	2024-07-21	2024-07-21	5	1	20.0%
nightly_win_rep	2024-07-09	2024-07-07	11	2	18.18%
nightly_win_deb	2024-07-11	2024-07-11	14	1	7.14%

No reports found!

projectroot.test.rclcpp.test_service_introspection
projectroot.test.rclcpp.test_service_introspection

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-connext_ubuntu_noble_amd64	2024-07-20	2024-07-06	12	8	66.67%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-20	2024-07-14	3	2	66.67%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-19	2024-07-09	5	3	60.0%
nightly_win_rel	2024-07-18	2024-07-18	14	1	7.14%

No reports found!

Jci__nightly-connext_ubuntu_noble_amd64#35

rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Rcinightly-connext_ubuntu_noble_amd64	2024-07-20	2024-07-06	12	8	66.67%
Jci__nightly-connext_ubuntu_noble_amd64	2024-07-20	2024-07-20	3	1	33.33%
Icinightly-connext_ubuntu_jammy_amd64	2024-07-16	2024-07-16	5	1	20.0%
nightly_win_rel	2024-07-18	2024-07-18	14	1	7.14%

No reports found!

rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-connext_ubuntu_noble_amd64	2024-07-20	2024-07-14	3	2	66.67%
Ici__nightly-connext_ubuntu_jammy_amd64	2024-07-19	2024-07-09	5	3	60.0%
Rcinightly-connext_ubuntu_noble_amd64	2024-07-20	2024-07-06	12	7	58.33%
nightly_win_rel	2024-07-18	2024-07-18	14	1	7.14%

No reports found!

rclpy.rclpy.test.test_client.TestClient.test_service_timestamps
rclpy.rclpy.test.test_client.TestClient.test_service_timestamps

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Jcinightly-connext_ubuntu_noble_amd64	2024-07-20	2024-07-14	3	2	66.67%
Rci__nightly-connext_ubuntu_noble_amd64	2024-07-20	2024-07-06	12	7	58.33%
Hcinightly-connext_ubuntu_jammy_amd64	2024-07-21	2024-07-21	5	1	20.0%

No reports found!

Hci__nightly-connext_ubuntu_jammy_amd64#256

test_tf2.BufferClientTestAfterShutdown.test_exit_code

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
Hci__nightly-connext_ubuntu_jammy_amd64	2024-07-21	2024-07-15	5	3	60.0%
Ici__nightly-connext_ubuntu_jammy_amd64	2024-07-10	2024-07-09	5	2	40.0%

No reports found!

test_rclcpp.gtest_multithreadedrmw_connextdds.gtest.missing_result
test_rclcpp.gtest_multithreadedrmw_connextdds.gtest.missing_result

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-21	2024-07-06	11	6	54.55%
nightly_win_deb	2024-07-21	2024-07-06	14	5	35.71%
nightly_win_rel	2024-07-06	2024-07-06	14	1	7.14%

No reports found!

projectroot.test_tutorial_use_logger_service__rmw_connextdds
projectroot.test_tutorial_use_logger_service__rmw_connextdds

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_deb	2024-07-21	2024-07-06	14	5	35.71%
nightly_win_rep	2024-07-21	2024-07-21	11	1	9.09%

No reports found!

nightly_win_deb#3161

projectroot.copyright
rviz_default_plugins.copyright.xunit.missing_result

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_deb	2024-07-21	2024-07-12	14	4	28.57%

No reports found!

nightly_win_rep#3422

projectroot.test.rclcpp.test_executor

Job Name	Last Fail	First Fail	Build Count	Failure Count	Failure Percentage
nightly_win_rep	2024-07-21	2024-07-07	11	3	27.27%
nightly_win_rel	2024-07-18	2024-07-18	14	1	7.14%
nightly_win_deb	2024-07-06	2024-07-06	14	1	7.14%

https://github.com/ros2/rclcpp/issues/2502 (Closed)

osrf / buildfarm-tools

Buildfarmer log 2024/07/15 - 2024/07/22 #67

Jul 15

Sdformat Main | Warnings | Investigating :detective:

Jul 16

Nightly Windows Repeated | Build regression | Investigating :detective:

Linux release nightlies | Warning | Reported :books:

Gz-sim8-windows | Flaky test regressions | Keeping track :eyes:

Jul 17

Urgent

Test regressions consecutive

Test regressions

Warnings

Test regressions flaky

Test regressions

Maintenance

Pending

Jul 18

Urgent

Build regressions

Test regressions consecutive

Test regressions

Warnings

Test regressions flaky

Test regressions

Maintenance

Pending

Ros2 Performance Tests | Test regressions | Reported :books:

Jul 19

Urgent

Test regressions consecutive

Test regressions

Warnings

Test regressions flaky

Test regressions

Maintenance

Pending

:yellow_circle: Jul 19th buildfarm Urgent test regressions

ROS

Performance regressions

Linux repeated regressions

Benchmark regressions

Gazebo

Jul 20

Urgent

Test regressions consecutive

Test regressions

Warnings

Test regressions flaky

Test regressions

Maintenance

Pending

Jul 21

Urgent

Build regressions

Test regressions consecutive

Test regressions

Warnings

Test regressions flaky

Test regressions

Maintenance

Pending