osrf / buildfarm-tools

3 stars 2 forks source link

Buildfarmer log 2024/02/05 - 2024/02/12 #26

Closed github-actions[bot] closed 9 months ago

github-actions[bot] commented 9 months ago

Previous log #25

github-actions[bot] commented 9 months ago

Feb 05

Build regressions ``` nightly_linux_coverage|2271|2024-02-05 04:45:42.089000|Packages composition demo_nodes_py interactive_markers launch_ros launch_testing_ros lifecycle message_filters rclcpp rclcpp_action rclcpp_components rclcpp_lifecycle rclpy ros2action ros2bag ros2cli ros2component ros2doctor ros2interface ros2lifecycle ros2lifecycle_test_fixtures ros2node ros2param ros2pkg ros2service ros2test ros2topic ros_testing rosbag2_compression rosbag2_compression_zstd rosbag2_cpp rosbag2_py rosbag2_storage rosbag2_storage_default_plugins rosbag2_storage_mcap rosbag2_storage_sqlite3 rosbag2_test_common rosbag2_tests rosbag2_transport sros2 test_cli test_cli_remapping test_communication test_launch_ros test_quality_of_service test_rclcpp test_security test_tf2 test_tracetools tf2_bullet tf2_eigen tf2_geometry_msgs tf2_kdl tf2_py tf2_ros tf2_ros_py tf2_sensor_msgs tracetools_launch tracetools_test Failed|ccache stats (after) nightly_linux_humble_coverage|700|2024-02-05 05:18:31.030000|Early fail|No last section nightly_linux_release|2973|2024-02-05 05:36:52.831000|Packages demo_nodes_cpp demo_nodes_cpp_native dummy_robot_bringup examples_tf2_py geometry2 image_common image_tools image_transport interactive_markers launch_testing_examples lifecycle lifecycle_py logging_demo pendulum_control robot_state_publisher ros2action ros2bag ros2cli_common_extensions ros2component ros2doctor ros2interface ros2launch ros2lifecycle ros2node ros2param ros2pkg ros2run ros2service ros2test ros2topic ros_testing rosbag2 rosbag2_compression rosbag2_compression_zstd rosbag2_cpp rosbag2_examples_cpp rosbag2_examples_py rosbag2_performance_benchmarking rosbag2_py rosbag2_storage_default_plugins rosbag2_storage_mcap rosbag2_storage_sqlite3 rosbag2_tests rosbag2_transport rqt_action rqt_console rqt_graph rqt_msg rqt_reconfigure rqt_srv rqt_topic rviz2 rviz_common rviz_default_plugins rviz_visual_testing_framework sros2 sros2_cmake test_launch_ros test_rclcpp test_ros2trace test_security test_tf2 test_tracetools test_tracetools_launch tf2_bullet tf2_eigen tf2_geometry_msgs tf2_kdl tf2_ros tf2_sensor_msgs tf2_tools tracetools_test Failed|ccache stats (after) packaging_linux|3323|2024-02-05 06:36:02.473000|Packages rviz_common Failed|build underlay packages Rci__nightly-performance_ubuntu_jammy_amd64|614|2024-02-04 18:38:09.376000|Packages performance_test Failed|build workspace in isolation and install gz-launch8-debbuilder|105|2024-02-04 12:28:44.676000|Unknown Reason|create deb packages gz-msgs11-debbuilder|113|2024-02-05 09:48:36.666000|Error in configuration dependencies|create deb packages sdformat15-debbuilder|113|2024-02-05 10:10:40.187000|Unknown Reason|create deb packages gz_sim-7-win|27|2024-02-04 19:06:22.692000|Jenkins channel closing down (Agent disconnected)|packages in workspace nightly_win_deb|2994|2024-02-05 04:00:01.236000|Number of failed test exceeds the threshold|test ```
Test regressions ``` Excluding 'performance, connext, fastrtps-dynamic' jobs Issue #1 in nightly_win_rep - Failing 85.71% in 12 out of 14 builds rclcpp.TestGuardCondition.construction_and_destruction projectroot.test.rclcpp.test_guard_condition Issue #2 in nightly_linux_repeated - Failing 28.57% in 4 out of 14 builds rcl_logging_spdlog.LoggingTest.init_old_flushing_behavior projectroot.test_logging_interface Issue #3 in nightly_linux_repeated - Failing 28.57% in 4 out of 14 builds test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp projectroot.test_client_scope_cpp__rmw_cyclonedds_cpp Issue #4 in nightly_win_rep - Failing 21.43% in 3 out of 14 builds rosidl_typesupport_introspection_tests.MultiNestedMessageIntrospectionTest/0.CanWriteTypeErasedMessage projectroot.test_multi_nested_message_introspection Issue #5 in nightly_win_rep - Failing 14.29% in 2 out of 14 builds test_launch_ros.test.test_launch_ros.utilities.test_track_node_names.test_launch_nodes_with_different_names[2-3] Issue #6 in gz_gui-ci-ign-gui6-focal-amd64 - Failing 25.0% in 1 out of 4 builds INTEGRATION_transport_scene_manager.test_ran (known issue in: https://github.com/gazebosim/gz-gui/issues/562 - CLOSED) INTEGRATION_scene3d.test_ran INTEGRATION_minimal_scene.test_ran (known issue in: https://github.com/gazebosim/gz-gui/issues/562 - CLOSED) INTEGRATION_marker_manager.test_ran Issue #7 in gz_launch-ci-main-jammy-amd64 - Failing 25.0% in 1 out of 4 builds CmdLine.EchoSelf (known issue in: https://github.com/gazebosim/gz-launch/issues/208 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/208 - OPEN | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) (also in: "gz_launch-ign-launch5-win" job) (known issue in: https://github.com/gazebosim/gz-launch/issues/208 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/208 - OPEN | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) (also in: "gz_launch-ci-ign-launch2-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-launch/issues/208 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/208 - OPEN | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) Issue #8 in gz_launch-ci-main-jammy-amd64 - Failing 25.0% in 1 out of 4 builds CmdLine.EchoErb (known issue in: https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) (also in: "gz_launch-ign-launch5-win" job) (known issue in: https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) Issue #9 in gz_sim-7-win - Failing 25.0% in 1 out of 4 builds INTEGRATION_multiple_servers.test_ran (also in: "gz_sim-8-win" job) Issue #10 in gz_sim-ci-ign-gazebo6-homebrew-amd64 - Failing 25.0% in 1 out of 4 builds ServerRepeat/OdometryPublisherTest.GaussianNoiseTest/0 (also in: "gz_sim-ci-ign-gazebo6-focal-amd64" job) Issue #11 in gz_sim-ci-main-jammy-amd64 - Failing 25.0% in 1 out of 4 builds ModelCommandAPI.RgbdCameraSensor ModelCommandAPI.NoServerRunning ModelCommandAPI.MagnetometerSensor ModelCommandAPI.GpuLidarSensor ModelCommandAPI.Commands ModelCommandAPI.AltimeterSensor Issue #12 in gz_sim-ci-ign-gazebo6-homebrew-amd64 - Failing 25.0% in 1 out of 4 builds ModelCommandAPI.AirPressureSensor (also in: "gz_sim-ci-main-jammy-amd64" job) (also in: "gz_sim-ci-ign-gazebo6-homebrew-amd64" job) Issue #13 in gz_transport-ci-main-jammy-amd64 - Failing 25.0% in 1 out of 4 builds gzTest.TopicPublish gzTest.TopicListSameProc gzTest.TopicList gzTest.ServiceRequest gzTest.ServiceListSameProc gzTest.ServiceList Issue #14 in nightly_linux-aarch64_repeated - Failing 6.67% in 1 out of 15 builds test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_consistency_cpp (also in: "nightly_win_rep" job) (also in: "nightly_linux_repeated" job) Issue #15 in nightly_linux-aarch64_repeated - Failing 6.67% in 1 out of 15 builds projectroot.test_client_scope_consistency_cpp__rmw_cyclonedds_cpp (also in: "nightly_linux_repeated" job) Issue #16 in nightly_linux_repeated - Failing 7.14% in 1 out of 14 builds test_security.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_2.xunit.missing_result Issue #17 in nightly_linux_repeated - Failing 7.14% in 1 out of 14 builds test_security.TestSecurePublisherSubscriberAfterShutdown.test_processes_finished_gracefully (also in: "nightly_win_rep" job) (also in: "nightly_linux_debug" job) (also in: "nightly_linux_coverage" job) (also in: "nightly_linux-rhel_repeated" job) Issue #18 in nightly_linux_repeated - Failing 7.14% in 1 out of 14 builds test_security.TestSecurePublisherSubscriber.test_subscriber_terminates_in_a_finite_amount_of_time projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_not_connecting_1 projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_not_connecting_0 projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_3 projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_2 projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_1 projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_cyclonedds_cpp__secure_comm_0 projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_not_connecting_1 projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_not_connecting_0 projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_3 projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_2 projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_1 projectroot.test_secure_publisher_subscriber__Empty__rmw_cyclonedds_cpp__secure_comm_0 (also in: "nightly_linux_debug" job) (also in: "nightly_linux_coverage" job) (also in: "nightly_linux-rhel_repeated" job) Issue #19 in nightly_win_rep - Failing 7.14% in 1 out of 14 builds rosidl_typesupport_introspection_tests.ArraysServiceIntrospectionTest/0.CanReadTypeErasedResponseMessage projectroot.test_arrays_service_introspection ```
Crola1702 commented 9 months ago

No left space in device

Today this same agent had also the no space left error (reference build)

I ran du -h -d 1 on workspace folder and found:

``` 15G ./nightly_linux-rhel_xfail 5.2G ./nightly_linux_clang_libcxx 4.0K ./nightly_linux_clang_libcxx@tmp 5.9G ./test_ci_linux-rhel 13G ./ci_linux_clang_libcxx 20G ./packaging_linux-rhel 4.0K ./nightly_linux-rhel_debug@tmp 4.0K ./ci_linux-rhel@tmp 4.0K ./ci_linux@tmp 5.8G ./test_ci_linux 4.2M ./nightly_linux_humble_coverage 11G ./nightly_linux-rhel_release 4.0K ./nightly_linux_humble_coverage@tmp 21G ./nightly_linux_iron_coverage 11G ./nightly_linux_release 4.0K ./nightly_linux_repeated@tmp 24G ./nightly_linux_coverage 4.0K ./nightly_linux_address_sanitizer@tmp 4.0K ./nightly_linux-rhel_release@tmp 15G ./ci_linux-rhel 23G ./nightly_linux-rhel_debug 30G ./nightly_linux_debug 4.0K ./nightly_linux-rhel_repeated@tmp 4.0K ./packaging_linux@tmp 4.0K ./nightly_linux-rhel_xfail@tmp 4.0K ./test_ci_linux@tmp 17G ./packaging_linux 4.0K ./nightly_linux_debug@tmp 4.0K ./packaging_linux-rhel@tmp 13G ./ci_linux 4.0K ./nightly_linux_iron_coverage@tmp 6.3G ./nightly_linux_address_sanitizer 4.0K ./ci_linux_clang_libcxx@tmp 16G ./nightly_linux-rhel_repeated 4.0K ./nightly_linux_coverage@tmp 4.0K ./test_ci_linux-rhel@tmp 4.0K ./nightly_linux_release@tmp 16G ./nightly_linux_repeated 262G . ```

I rm -rfed all the workspaces that had > 10 GB and now it's back online

github-actions[bot] commented 9 months ago

Feb 06

Build regressions ``` nightly_linux-rhel_release|1792|2024-02-06 04:00:01.570000|Jenkins channel closing down (Agent disconnected)|test nightly_win_deb|2995|2024-02-06 04:00:01.590000|Number of failed test exceeds the threshold|test Rci__nightly-performance_ubuntu_jammy_amd64|615|2024-02-05 15:42:39.609000|Packages performance_test Failed|build workspace in isolation and install gz-launch8-debbuilder|106|2024-02-05 12:35:04.019000|Unknown Reason|create deb packages gz-msgs11-debbuilder|115|2024-02-06 09:50:15.448000|Error in configuration dependencies|create deb packages gz_gui-ci-main-homebrew-amd64|22|2024-02-06 03:06:28.154000|Error in configuration dependencies|install gz-gui9 dependencies gz_math-main-win|19|2024-02-06 01:06:12.774000|Jenkins channel closing down (Agent disconnected)|colcon compilation with tests for gz-math8 gz_sensors-ci-main-homebrew-amd64|19|2024-02-05 23:06:22.846000|Error in configuration dependencies|install gz-sensors9 dependencies gz_sensors-ci-main-jammy-amd64|36|2024-02-06 07:10:09.238000|Jenkins channel closing down (Agent disconnected)|compiling gz_sensors-ci-main-jammy-amd64|35|2024-02-06 07:06:27.915000|Unknown Reason|NVIDIA MISMATCH RECOVERY sdformat15-debbuilder|114|2024-02-06 10:12:41.471000|Unknown Reason|create deb packages ```
Test regressions ``` Excluding 'performance, connext, fastrtps-dynamic' jobs Issue #1 in nightly_win_rep - Failing 35.71% in 5 out of 14 builds test_rclcpp.TestNNodesAfterShutdown.test_10_nodes projectroot.test_n_nodes__rmw_fastrtps_cpp Issue #2 in nightly_linux_repeated - Failing 21.43% in 3 out of 14 builds ros2topic.ros2topic.test.test_cli.test_cli (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED) (also in: "nightly_linux-aarch64_repeated" job) (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED) Issue #3 in nightly_win_rep - Failing 21.43% in 3 out of 14 builds test_rclcpp.TestNNodes.test_10_nodes Issue #4 in nightly_win_rep - Failing 21.43% in 3 out of 14 builds projectroot.test.rclcpp.test_timers_manager Issue #5 in nightly_win_rep - Failing 14.29% in 2 out of 14 builds rclcpp.TestTimersManager.check_one_timer_cancel_doesnt_affect_other_timers Issue #6 in gz_gui-ci-ign-gui6-focal-amd64 - Failing 25.0% in 1 out of 4 builds INTEGRATION_transport_scene_manager.test_ran (known issue in: https://github.com/gazebosim/gz-gui/issues/562 - CLOSED) INTEGRATION_scene3d.test_ran INTEGRATION_minimal_scene.test_ran (known issue in: https://github.com/gazebosim/gz-gui/issues/562 - CLOSED) INTEGRATION_marker_manager.test_ran Issue #7 in gz_launch-ci-main-jammy-amd64 - Failing 25.0% in 1 out of 4 builds CmdLine.EchoSelf (known issue in: https://github.com/gazebosim/gz-launch/issues/208 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/208 - OPEN | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) (also in: "gz_launch-ign-launch5-win" job) (known issue in: https://github.com/gazebosim/gz-launch/issues/208 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/208 - OPEN | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) (also in: "gz_launch-ci-ign-launch2-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-launch/issues/208 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/208 - OPEN | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) Issue #8 in gz_launch-ci-main-jammy-amd64 - Failing 25.0% in 1 out of 4 builds CmdLine.EchoErb (known issue in: https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) (also in: "gz_launch-ign-launch5-win" job) (known issue in: https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) Issue #9 in gz_sim-7-win - Failing 25.0% in 1 out of 4 builds INTEGRATION_multiple_servers.test_ran (also in: "gz_sim-8-win" job) Issue #10 in gz_sim-ci-ign-gazebo6-homebrew-amd64 - Failing 33.33% in 1 out of 3 builds ServerRepeat/OdometryPublisherTest.GaussianNoiseTest/0 (also in: "gz_sim-ci-ign-gazebo6-focal-amd64" job) Issue #11 in gz_sim-ci-main-jammy-amd64 - Failing 25.0% in 1 out of 4 builds ModelCommandAPI.RgbdCameraSensor ModelCommandAPI.NoServerRunning ModelCommandAPI.MagnetometerSensor ModelCommandAPI.GpuLidarSensor ModelCommandAPI.Commands ModelCommandAPI.AltimeterSensor Issue #12 in gz_sim-ci-ign-gazebo6-homebrew-amd64 - Failing 33.33% in 1 out of 3 builds ModelCommandAPI.AirPressureSensor (also in: "gz_sim-ci-main-jammy-amd64" job) (also in: "gz_sim-ci-ign-gazebo6-homebrew-amd64" job) Issue #13 in nightly_win_rep - Failing 7.14% in 1 out of 14 builds test_cli_remapping.TestCLIRemappingAfterShutdown.test_processes_finished_gracefully[C:/ci/ws/src/ros2/system_tests/test_cli_remapping/test/name_maker.py] test_cli_remapping.TestCLIRemappingAfterShutdown.test_processes_finished_gracefully[C:/ci/ws/build/test_cli_remapping/Release/name_maker_rclcpp.exe] test_cli_remapping.TestCLIRemapping.test_topic_replacement[C:/ci/ws/build/test_cli_remapping/Release/name_maker_rclcpp.exe] test_cli_remapping.TestCLIRemapping.test_namespace_replacement[C:/ci/ws/src/ros2/system_tests/test_cli_remapping/test/name_maker.py] projectroot.test_cli_remapping Issue #14 in sdformat-ci-main-jammy-amd64 - Failing 20.0% in 1 out of 5 builds print.SDF inertial_stats.SDF describe.SDF check_shapes_sdf.SDF check_model_sdf.SDF check.SDF GraphCmd.WorldPoseRelativeTo GraphCmd.WorldFrameAttachedTo GraphCmd.ModelPoseRelativeTo GraphCmd.ModelFrameAttachedTo ```
github-actions[bot] commented 9 months ago

Feb 07

Build regressions ``` nightly_linux_coverage|2273|2024-02-07 04:53:50.397000|Packages rosbag2_transport Failed|build nightly_win_deb|2996|2024-02-07 04:00:01.224000|Number of failed test exceeds the threshold|test Rci__nightly-performance_ubuntu_jammy_amd64|616|2024-02-06 18:38:11.351000|Packages performance_test Failed|build workspace in isolation and install gz-launch8-debbuilder|107|2024-02-06 12:40:11.413000|Unknown Reason|create deb packages gz_sensors-ci-gz-sensors8-jammy-amd64|47|2024-02-07 07:13:43.784000|Unknown Reason|NVIDIA MISMATCH RECOVERY gz_sensors-ci-gz-sensors8-jammy-amd64|46|2024-02-07 07:09:11.924000|Unknown Reason|NVIDIA MISMATCH RECOVERY ```
Test regressions ``` Excluding 'performance, connext, fastrtps-dynamic' jobs Issue #1 in nightly_win_rep - Failing 85.71% in 12 out of 14 builds rclcpp.TestGuardCondition.construction_and_destruction projectroot.test.rclcpp.test_guard_condition Issue #2 in nightly_win_rep - Failing 35.71% in 5 out of 14 builds test_rclcpp.TestNNodesAfterShutdown.test_10_nodes projectroot.test_n_nodes__rmw_fastrtps_cpp Issue #3 in nightly_linux_repeated - Failing 23.08% in 3 out of 13 builds ros2topic.ros2topic.test.test_cli.test_cli (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED) (also in: "nightly_linux-aarch64_repeated" job) (known issue in: https://github.com/ros2/ros2cli/issues/861 - CLOSED) Issue #4 in nightly_win_rep - Failing 21.43% in 3 out of 14 builds rosidl_typesupport_introspection_tests.MultiNestedMessageIntrospectionTest/0.CanWriteTypeErasedMessage projectroot.test_multi_nested_message_introspection Issue #5 in gz_transport-ci-main-jammy-amd64 - Failing 50.0% in 2 out of 4 builds gzTest.TopicPublish gzTest.TopicListSameProc gzTest.TopicList gzTest.ServiceRequest gzTest.ServiceListSameProc gzTest.ServiceList Issue #6 in nightly_win_rep - Failing 14.29% in 2 out of 14 builds test_security.TestSecurePublisherSubscriberAfterShutdown.test_processes_finished_gracefully (also in: "nightly_linux_repeated" job) (also in: "nightly_linux_debug" job) (also in: "nightly_linux_coverage" job) (also in: "nightly_linux-rhel_repeated" job) Issue #7 in gz_gui-ci-ign-gui6-focal-amd64 - Failing 25.0% in 1 out of 4 builds INTEGRATION_transport_scene_manager.test_ran (known issue in: https://github.com/gazebosim/gz-gui/issues/562 - CLOSED) INTEGRATION_scene3d.test_ran INTEGRATION_minimal_scene.test_ran (known issue in: https://github.com/gazebosim/gz-gui/issues/562 - CLOSED) INTEGRATION_marker_manager.test_ran Issue #8 in gz_sim-7-win - Failing 25.0% in 1 out of 4 builds INTEGRATION_multiple_servers.test_ran (also in: "gz_sim-8-win" job) Issue #9 in gz_sim-ci-main-jammy-amd64 - Failing 33.33% in 1 out of 3 builds ModelCommandAPI.RgbdCameraSensor ModelCommandAPI.NoServerRunning ModelCommandAPI.MagnetometerSensor ModelCommandAPI.GpuLidarSensor ModelCommandAPI.Commands ModelCommandAPI.AltimeterSensor Issue #10 in gz_sim-ci-main-jammy-amd64 - Failing 33.33% in 1 out of 3 builds ModelCommandAPI.AirPressureSensor (also in: "gz_sim-ci-ign-gazebo6-homebrew-amd64" job) Issue #11 in gz_transport-13-win - Failing 20.0% in 1 out of 5 builds playback.ReplayStep (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - OPEN | https://github.com/gazebosim/gz-transport/issues/195 - CLOSED) (also in: "gz_transport-12-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - OPEN | https://github.com/gazebosim/gz-transport/issues/195 - CLOSED) Issue #12 in nightly_linux-aarch64_repeated - Failing 6.67% in 1 out of 15 builds ros2multicast.ros2multicast.test.test_api.test_group_and_port[1-3] Issue #13 in nightly_win_rep - Failing 7.14% in 1 out of 14 builds projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_fastrtps_cpp__secure_not_connecting_0 Issue #14 in sdformat-ci-main-jammy-amd64 - Failing 20.0% in 1 out of 5 builds print.SDF inertial_stats.SDF describe.SDF check_shapes_sdf.SDF check_model_sdf.SDF check.SDF GraphCmd.WorldPoseRelativeTo GraphCmd.WorldFrameAttachedTo GraphCmd.ModelPoseRelativeTo GraphCmd.ModelFrameAttachedTo ```
github-actions[bot] commented 9 months ago

Feb 08

Build regressions ``` packaging_linux|3326|2024-02-08 08:17:33.710000|Jenkins channel closing down (Agent disconnected)|build underlay packages nightly_linux-rhel_repeated|1796|2024-02-08 04:00:01.128000|Jenkins channel closing down (Agent disconnected)|test nightly_win_deb|2997|2024-02-08 04:00:01.307000|Number of failed test exceeds the threshold|test Rci__nightly-performance_ubuntu_jammy_amd64|617|2024-02-07 20:37:35.823000|Packages performance_test Failed|build workspace in isolation and install gz-launch8-debbuilder|108|2024-02-07 13:49:26.092000|Unknown Reason|create deb packages gz_launch-ci-main-homebrew-amd64|18|2024-02-07 14:06:30.381000|Error in configuration dependencies|install gz-launch8 dependencies gz_sim-ci-main-homebrew-amd64|23|2024-02-07 16:06:14.569000|Error in configuration dependencies|install gz-sim9 dependencies ```
Test regressions ``` Excluding 'performance, connext, fastrtps-dynamic' jobs Issue #1 in nightly_win_rep - Failing 84.62% in 11 out of 13 builds rclcpp.TestGuardCondition.construction_and_destruction projectroot.test.rclcpp.test_guard_condition Issue #2 in nightly_win_rep - Failing 30.77% in 4 out of 13 builds test_rclcpp.TestNNodesAfterShutdown.test_10_nodes projectroot.test_n_nodes__rmw_fastrtps_cpp Issue #3 in nightly_linux_repeated - Failing 21.43% in 3 out of 14 builds test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_consistency_cpp (also in: "nightly_win_rep" job) (also in: "nightly_linux-aarch64_repeated" job) Issue #4 in nightly_linux_repeated - Failing 21.43% in 3 out of 14 builds test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp projectroot.test_client_scope_cpp__rmw_cyclonedds_cpp Issue #5 in nightly_linux_repeated - Failing 21.43% in 3 out of 14 builds projectroot.test_client_scope_consistency_cpp__rmw_cyclonedds_cpp (also in: "nightly_linux-aarch64_repeated" job) Issue #6 in nightly_win_rep - Failing 23.08% in 3 out of 13 builds rosidl_typesupport_introspection_tests.MultiNestedMessageIntrospectionTest/0.CanWriteTypeErasedMessage projectroot.test_multi_nested_message_introspection Issue #7 in gz_gui-ci-ign-gui6-focal-amd64 - Failing 40.0% in 2 out of 5 builds INTEGRATION_minimal_scene.test_ran (known issue in: https://github.com/gazebosim/gz-gui/issues/562 - CLOSED) INTEGRATION_marker_manager.test_ran Issue #8 in gz_launch-ci-main-jammy-amd64 - Failing 50.0% in 2 out of 4 builds CmdLine.EchoSelf (known issue in: https://github.com/gazebosim/gz-launch/issues/208 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/208 - OPEN | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) (also in: "gz_launch-ign-launch5-win" job) (known issue in: https://github.com/gazebosim/gz-launch/issues/208 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/208 - OPEN | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) (also in: "gz_launch-ci-ign-launch2-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-launch/issues/208 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/208 - OPEN | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) Issue #9 in gz_launch-ci-main-jammy-amd64 - Failing 50.0% in 2 out of 4 builds CmdLine.EchoErb (known issue in: https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) (also in: "gz_launch-ign-launch5-win" job) (known issue in: https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) Issue #10 in gz_transport-ci-main-jammy-amd64 - Failing 50.0% in 2 out of 4 builds gzTest.TopicPublish gzTest.TopicListSameProc gzTest.TopicList gzTest.ServiceRequest gzTest.ServiceListSameProc gzTest.ServiceList Issue #11 in gz_gui-ci-ign-gui6-focal-amd64 - Failing 20.0% in 1 out of 5 builds INTEGRATION_camera_tracking.test_ran Issue #12 in gz_sim-7-win - Failing 33.33% in 1 out of 3 builds INTEGRATION_multiple_servers.test_ran (also in: "gz_sim-8-win" job) Issue #13 in gz_sim-ci-gz-sim8-jammy-amd64 - Failing 14.29% in 1 out of 7 builds ThrusterTest.VelocityControl Issue #14 in gz_transport-13-win - Failing 25.0% in 1 out of 4 builds playback.ReplayStep (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - OPEN | https://github.com/gazebosim/gz-transport/issues/195 - CLOSED) (also in: "gz_transport-12-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - OPEN | https://github.com/gazebosim/gz-transport/issues/195 - CLOSED) Issue #15 in nightly_linux-aarch64_repeated - Failing 6.67% in 1 out of 15 builds projectroot.test_tutorial_use_logger_service__rmw_fastrtps_cpp demo_nodes_cpp.TestExecutablesTutorialAfterShutdown.test_last_process_exit_code demo_nodes_cpp.TestExecutablesTutorial.test_processes_output Issue #16 in nightly_win_rep - Failing 7.69% in 1 out of 13 builds test_security.TestSecurePublisherSubscriberAfterShutdown.test_processes_finished_gracefully (also in: "nightly_linux_repeated" job) (also in: "nightly_linux_debug" job) (also in: "nightly_linux_coverage" job) (also in: "nightly_linux-rhel_repeated" job) Issue #17 in nightly_win_rep - Failing 7.69% in 1 out of 13 builds projectroot.test_secure_publisher_subscriber__UnboundedSequences__rmw_fastrtps_cpp__secure_not_connecting_0 Issue #18 in sdformat-ci-main-jammy-amd64 - Failing 25.0% in 1 out of 4 builds print.SDF inertial_stats.SDF describe.SDF check_shapes_sdf.SDF check_model_sdf.SDF check.SDF GraphCmd.WorldPoseRelativeTo GraphCmd.WorldFrameAttachedTo GraphCmd.ModelPoseRelativeTo GraphCmd.ModelFrameAttachedTo ```
Crola1702 commented 9 months ago

Rolling Performance | Build regressions | Investigating :detective:

Reference build: https://build.ros2.org/view/Rci/job/Rci__nightly-performance_ubuntu_jammy_amd64/617/

Log output: ``` 00:04:47.607 In file included from /tmp/ws2/build_isolated/performance_test/src/idlgen/fast_rtps/gen/fast_rtps/Header_PubSubTypes.cxx:26: 00:04:47.607 /tmp/ws2/build_isolated/performance_test/src/idlgen/fast_rtps/gen/fast_rtps/Header_PubSubTypes.h:32:2: error: #error Generated Header_ is not compatible with current installed Fast-RTPS. Please, regenerate it with fastrtpsgen. 00:04:47.607 32 | #error Generated Header_ is not compatible with current installed Fast-RTPS. Please, regenerate it with fastrtpsgen. 00:04:47.607 | ^~~~~ 00:04:47.607 In file included from /tmp/ws/install_isolated/fastrtps/include/fastrtps/TopicDataType.h:22, 00:04:47.607 from /tmp/ws2/build_isolated/performance_test/src/idlgen/fast_rtps/gen/fast_rtps/Header_PubSubTypes.h:27, 00:04:47.607 from /tmp/ws2/build_isolated/performance_test/src/idlgen/fast_rtps/gen/fast_rtps/Header_PubSubTypes.cxx:26: 00:04:47.607 /tmp/ws/install_isolated/fastrtps/include/fastdds/dds/topic/TopicDataType.hpp:99:30: warning: ‘virtual bool eprosima::fastdds::dds::TopicDataType::serialize(void*, eprosima::fastrtps::rtps::SerializedPayload_t*, eprosima::fastdds::dds::DataRepresentationId_t)’ was hidden [-Woverloaded-virtual] 00:04:47.607 99 | RTPS_DllAPI virtual bool serialize( 00:04:47.607 | ^~~~~~~~~ 00:04:47.607 In file included from /tmp/ws2/build_isolated/performance_test/src/idlgen/fast_rtps/gen/fast_rtps/Header_PubSubTypes.cxx:26: 00:04:47.607 /tmp/ws2/build_isolated/performance_test/src/idlgen/fast_rtps/gen/fast_rtps/Header_PubSubTypes.h:51:30: note: by ‘virtual bool std_msgs::msg::dds_::Header_PubSubType::serialize(void*, eprosima::fastrtps::rtps::SerializedPayload_t*)’ 00:04:47.607 51 | virtual bool serialize(void *data, eprosima::fastrtps::rtps::SerializedPayload_t *payload) override; 00:04:47.607 | ^~~~~~~~~ 00:04:47.607 In file included from /tmp/ws/install_isolated/fastrtps/include/fastrtps/TopicDataType.h:22, 00:04:47.607 from /tmp/ws2/build_isolated/performance_test/src/idlgen/fast_rtps/gen/fast_rtps/Header_PubSubTypes.h:27, 00:04:47.607 from /tmp/ws2/build_isolated/performance_test/src/idlgen/fast_rtps/gen/fast_rtps/Header_PubSubTypes.cxx:26: 00:04:47.607 /tmp/ws/install_isolated/fastrtps/include/fastdds/dds/topic/TopicDataType.hpp:131:51: warning: ‘virtual std::function eprosima::fastdds::dds::TopicDataType::getSerializedSizeProvider(void*, eprosima::fastdds::dds::DataRepresentationId_t)’ was hidden [-Woverloaded-virtual] 00:04:47.607 131 | RTPS_DllAPI virtual std::function getSerializedSizeProvider( 00:04:47.607 | ^~~~~~~~~~~~~~~~~~~~~~~~~ 00:04:47.607 In file included from /tmp/ws2/build_isolated/performance_test/src/idlgen/fast_rtps/gen/fast_rtps/Header_PubSubTypes.cxx:26: 00:04:47.607 /tmp/ws2/build_isolated/performance_test/src/idlgen/fast_rtps/gen/fast_rtps/Header_PubSubTypes.h:53:51: note: by ‘virtual std::function std_msgs::msg::dds_::Header_PubSubType::getSerializedSizeProvider(void*)’ 00:04:47.607 53 | virtual std::function getSerializedSizeProvider(void* data) override; 00:04:47.607 | ^~~~~~~~~~~~~~~~~~~~~~~~~ 00:04:47.607 In file included from /tmp/ws/install_isolated/fastrtps/include/fastdds/rtps/common/all_common.h:25, 00:04:47.607 from /tmp/ws/install_isolated/fastrtps/include/fastdds/dds/core/policy/ParameterTypes.hpp:24, 00:04:47.607 from /tmp/ws/install_isolated/fastrtps/include/fastdds/dds/core/policy/QosPolicies.hpp:25, 00:04:47.607 from /tmp/ws/install_isolated/fastrtps/include/fastdds/dds/topic/TopicDataType.hpp:26, 00:04:47.607 from /tmp/ws/install_isolated/fastrtps/include/fastrtps/TopicDataType.h:22, 00:04:47.607 from /tmp/ws2/build_isolated/performance_test/src/idlgen/fast_rtps/gen/fast_rtps/Header_PubSubTypes.h:27, 00:04:47.607 from /tmp/ws2/build_isolated/performance_test/src/idlgen/fast_rtps/gen/fast_rtps/Header_PubSubTypes.cxx:26: 00:04:47.607 /tmp/ws/install_isolated/fastrtps/include/fastdds/rtps/common/InstanceHandle.h: In instantiation of ‘eprosima::fastrtps::rtps::octet eprosima::fastrtps::rtps::InstanceHandleValue_t::operator[](T) const [with T = int; eprosima::fastrtps::rtps::octet = unsigned char]’: 00:04:47.607 /tmp/ws/install_isolated/fastrtps/include/fastdds/rtps/common/InstanceHandle.h:302:32: required from here 00:04:47.607 /tmp/ws/install_isolated/fastrtps/include/fastdds/rtps/common/InstanceHandle.h:70:23: warning: conversion to ‘std::array::size_type’ {aka ‘long unsigned int’} from ‘int’ may change the sign of the result [-Wsign-conversion] 00:04:47.607 70 | return value_[i]; 00:04:47.607 | ^ 00:04:47.607 /tmp/ws/install_isolated/fastrtps/include/fastdds/rtps/common/InstanceHandle.h: In instantiation of ‘eprosima::fastrtps::rtps::octet& eprosima::fastrtps::rtps::InstanceHandleValue_t::operator[](T) [with T = int; eprosima::fastrtps::rtps::octet = unsigned char]’: 00:04:47.607 /tmp/ws/install_isolated/fastrtps/include/fastdds/rtps/common/InstanceHandle.h:335:28: required from here 00:04:47.607 /tmp/ws/install_isolated/fastrtps/include/fastdds/rtps/common/InstanceHandle.h:53:23: warning: conversion to ‘std::array::size_type’ {aka ‘long unsigned int’} from ‘int’ may change the sign of the result [-Wsign-conversion] 00:04:47.607 53 | return value_[i]; 00:04:47.607 | ^ 00:04:47.607 gmake[2]: *** [src/idlgen/fast_rtps/CMakeFiles/fast_rtps_idl.dir/build.make:172: src/idlgen/fast_rtps/CMakeFiles/fast_rtps_idl.dir/gen/fast_rtps/Header_PubSubTypes.cxx.o] Error 1 00:04:47.607 gmake[1]: *** [CMakeFiles/Makefile2:690: src/idlgen/fast_rtps/CMakeFiles/fast_rtps_idl.dir/all] Error 2 00:04:47.607 gmake: *** [Makefile:146: all] Error 2 00:04:47.607 --- 00:04:47.607 Failed <<< performance_test [2min 18s, exited with code 2] ```

I also see the following warning of a missing package in idlgen/fast_rtps:

00:04:47.607 CMake Warning at src/idlgen/fast_rtps/CMakeLists.txt:70 (message):
00:04:47.607   Could not find program 'fastrtpsgen' in path.  Trying to use bundled
00:04:47.607   version
00:04:47.607 
00:04:47.607 
00:04:47.607 CMake Deprecation Warning at /tmp/ws/install_isolated/rosidl_cmake/share/rosidl_cmake/cmake/rosidl_target_interfaces.cmake:32 (message):
00:04:47.607   Use rosidl_get_typesupport_target() and target_link_libraries() instead of
00:04:47.607   rosidl_target_interfaces()
00:04:47.607 Call Stack (most recent call first):
00:04:47.607   CMakeLists.txt:280 (rosidl_target_interfaces)

None of compare_build_repos and comparepip shows any differences

github-actions[bot] commented 9 months ago

Feb 09

Build regressions ``` nightly_win_deb|2998|2024-02-09 04:00:01.534000|Number of failed test exceeds the threshold|test Rci__nightly-performance_ubuntu_jammy_amd64|622|2024-02-08 16:26:44.163000|Packages performance_test Failed|build workspace in isolation and install Rci__nightly-performance_ubuntu_jammy_amd64|621|2024-02-08 16:14:41.548000|Packages performance_test Failed|build workspace in isolation and install Rci__nightly-performance_ubuntu_jammy_amd64|620|2024-02-08 16:05:59.885000|Packages performance_test Failed|build workspace in isolation and install Rci__nightly-performance_ubuntu_jammy_amd64|619|2024-02-08 16:02:44.029000|Packages performance_test Failed|build workspace in isolation and install Rci__nightly-performance_ubuntu_jammy_amd64|618|2024-02-08 15:54:12.261000|Packages performance_test Failed|build workspace in isolation and install gz-msgs11-debbuilder|118|2024-02-08 11:39:52.145000|Error in configuration dependencies|create deb packages gz_rendering-ci-ign-rendering6-focal-amd64|27|2024-02-09 05:03:45.286000|Jenkins channel closing down (Agent disconnected)|compiling ```
Test regressions ``` Excluding 'performance, connext, fastrtps-dynamic' jobs Issue #1 in nightly_linux_repeated - Failing 23.08% in 3 out of 13 builds test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_consistency_cpp (also in: "nightly_win_rep" job) (also in: "nightly_linux-aarch64_repeated" job) Issue #2 in nightly_linux_repeated - Failing 23.08% in 3 out of 13 builds test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp projectroot.test_client_scope_cpp__rmw_cyclonedds_cpp Issue #3 in nightly_linux_repeated - Failing 23.08% in 3 out of 13 builds projectroot.test_client_scope_consistency_cpp__rmw_cyclonedds_cpp (also in: "nightly_linux-aarch64_repeated" job) Issue #4 in nightly_win_rep - Failing 23.08% in 3 out of 13 builds test_launch_ros.test.test_launch_ros.utilities.test_track_node_names.test_launch_nodes_with_different_names[2-3] Issue #5 in nightly_win_rep - Failing 23.08% in 3 out of 13 builds projectroot.test.rclcpp.test_timers_manager Issue #6 in gz_gui-ci-ign-gui6-focal-amd64 - Failing 50.0% in 2 out of 4 builds INTEGRATION_minimal_scene.test_ran (known issue in: https://github.com/gazebosim/gz-gui/issues/562 - CLOSED) INTEGRATION_marker_manager.test_ran Issue #7 in gz_launch-ci-main-jammy-amd64 - Failing 50.0% in 2 out of 4 builds CmdLine.EchoSelf (known issue in: https://github.com/gazebosim/gz-launch/issues/208 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/208 - OPEN | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) (also in: "gz_launch-ign-launch5-win" job) (known issue in: https://github.com/gazebosim/gz-launch/issues/208 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/208 - OPEN | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) (also in: "gz_launch-ci-ign-launch2-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-launch/issues/208 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/208 - OPEN | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) Issue #8 in gz_launch-ci-main-jammy-amd64 - Failing 50.0% in 2 out of 4 builds CmdLine.EchoErb (known issue in: https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) (also in: "gz_launch-ign-launch5-win" job) (known issue in: https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) Issue #9 in gz_transport-ci-main-jammy-amd64 - Failing 50.0% in 2 out of 4 builds gzTest.TopicPublish gzTest.TopicListSameProc gzTest.TopicList gzTest.ServiceRequest gzTest.ServiceListSameProc gzTest.ServiceList Issue #10 in nightly_linux-aarch64_repeated - Failing 13.33% in 2 out of 15 builds test_rclcpp.TestTwoExecutablesAfterShutdown.test_node_name projectroot.test_node_name__rmw_fastrtps_cpp Issue #11 in nightly_win_rep - Failing 15.38% in 2 out of 13 builds projectroot.test_cli_remapping Issue #12 in nightly_win_rep - Failing 15.38% in 2 out of 13 builds projectroot.test_arrays_service_introspection Issue #13 in gz_gui-ci-ign-gui6-focal-amd64 - Failing 25.0% in 1 out of 4 builds INTEGRATION_camera_tracking.test_ran Issue #14 in gz_sim-main-win - Failing 25.0% in 1 out of 4 builds ServerRepeat/MultipleServers.TwoServersMixedBlocking/0 Issue #15 in gz_transport-13-win - Failing 25.0% in 1 out of 4 builds playback.ReplayStep (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED | https://github.com/gazebosim/gz-transport/issues/195 - OPEN) (also in: "gz_transport-12-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED | https://github.com/gazebosim/gz-transport/issues/195 - OPEN) Issue #16 in nightly_win_rep - Failing 7.69% in 1 out of 13 builds test_launch_ros.test.test_launch_ros.utilities.test_track_node_names.test_launch_nodes_with_same_names[1-3] test_cli_remapping.TestCLIRemapping.test_node_name_replacement[C:/ci/ws/build/test_cli_remapping/Release/name_maker_rclcpp.exe] rosidl_typesupport_introspection_tests.ArraysServiceIntrospectionTest/0.CanWriteTypeErasedResponseMessage rclcpp.TestTimersManager.timers_thread Issue #17 in sdformat-ci-main-jammy-amd64 - Failing 25.0% in 1 out of 4 builds print.SDF inertial_stats.SDF describe.SDF check_shapes_sdf.SDF check_model_sdf.SDF check.SDF GraphCmd.WorldPoseRelativeTo GraphCmd.WorldFrameAttachedTo GraphCmd.ModelPoseRelativeTo GraphCmd.ModelFrameAttachedTo ```
github-actions[bot] commented 9 months ago

Feb 10

Build regressions ``` nightly_linux_coverage|2276|2024-02-10 05:22:20.478000|Packages test_rclcpp Failed|build nightly_linux_humble_coverage|705|2024-02-10 05:53:56.716000|Packages rosbag2_transport Failed|build Rci__nightly-fastrtps-dynamic_ubuntu_jammy_amd64|712|2024-02-09 13:12:05.184000|Jenkins channel closing down (Agent disconnected)|build workspace in isolation and install Rci__nightly-performance_ubuntu_jammy_amd64|624|2024-02-09 18:25:37.824000|Packages performance_test Failed|build workspace in isolation and install Rci__nightly-performance_ubuntu_jammy_amd64|623|2024-02-09 17:22:37.651000|Packages performance_test Failed|build workspace in isolation and install gz-fuel-tools10-debbuilder|118|2024-02-09 12:45:52.413000|Error processing archive 49-gz-msgs11-cli_10.999.999+nightly+git20240209+1rfbc0480cacb3e33ee3177b73a4603e3c6fc63a4a-1~jammy_amd64|install build dependencies from debian/control gz-gui9-debbuilder|116|2024-02-09 12:52:50.898000|Error processing archive 30-gz-msgs11-cli_10.999.999+nightly+git20240209+1rfbc0480cacb3e33ee3177b73a4603e3c6fc63a4a-1~jammy_amd64|install build dependencies from debian/control gz-launch8-debbuilder|110|2024-02-09 13:44:26.370000|Error processing archive 29-gz-msgs11-cli_10.999.999+nightly+git20240209+1rfbc0480cacb3e33ee3177b73a4603e3c6fc63a4a-1~jammy_amd64|install build dependencies from debian/control gz-msgs11-debbuilder|120|2024-02-09 11:59:51.712000|Error in configuration dependencies|create deb packages gz-sensors9-debbuilder|116|2024-02-09 12:56:59.597000|Error processing archive 264-gz-msgs11-cli_10.999.999+nightly+git20240209+1rfbc0480cacb3e33ee3177b73a4603e3c6fc63a4a-1~jammy_amd64|install build dependencies from debian/control gz-sim9-debbuilder|114|2024-02-09 14:29:14.850000|Error processing archive 29-gz-msgs11-cli_10.999.999+nightly+git20240209+1rfbc0480cacb3e33ee3177b73a4603e3c6fc63a4a-1~jammy_amd64|install build dependencies from debian/control gz-sim9-debbuilder|113|2024-02-09 13:37:25.646000|Error processing archive 29-gz-msgs11-cli_10.999.999+nightly+git20240209+1rfbc0480cacb3e33ee3177b73a4603e3c6fc63a4a-1~jammy_amd64|install build dependencies from debian/control gz-transport14-debbuilder|119|2024-02-09 12:49:18.815000|Error processing archive 116-gz-msgs11-cli_10.999.999+nightly+git20240209+1rfbc0480cacb3e33ee3177b73a4603e3c6fc63a4a-1~jammy_amd64|install build dependencies from debian/control ```
Test regressions ``` Excluding 'performance, connext, fastrtps-dynamic' jobs Issue #1 in nightly_win_rep - Failing 78.57% in 11 out of 14 builds rclcpp.TestGuardCondition.construction_and_destruction projectroot.test.rclcpp.test_guard_condition Issue #2 in nightly_win_rep - Failing 35.71% in 5 out of 14 builds test_rclcpp.TestNNodesAfterShutdown.test_10_nodes projectroot.test_n_nodes__rmw_fastrtps_cpp Issue #3 in nightly_win_rep - Failing 21.43% in 3 out of 14 builds test_rclcpp.TestNNodes.test_10_nodes Issue #4 in gz_gui-ci-ign-gui6-focal-amd64 - Failing 50.0% in 2 out of 4 builds INTEGRATION_minimal_scene.test_ran (known issue in: https://github.com/gazebosim/gz-gui/issues/562 - CLOSED) INTEGRATION_marker_manager.test_ran Issue #5 in gz_launch-ci-main-jammy-amd64 - Failing 50.0% in 2 out of 4 builds CmdLine.EchoSelf (known issue in: https://github.com/gazebosim/gz-launch/issues/208 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/208 - OPEN | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) (also in: "gz_launch-ign-launch5-win" job) (known issue in: https://github.com/gazebosim/gz-launch/issues/208 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/208 - OPEN | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) (also in: "gz_launch-ci-ign-launch2-homebrew-amd64" job) (known issue in: https://github.com/gazebosim/gz-launch/issues/208 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/208 - OPEN | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) Issue #6 in gz_launch-ci-main-jammy-amd64 - Failing 50.0% in 2 out of 4 builds CmdLine.EchoErb (known issue in: https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) (also in: "gz_launch-ign-launch5-win" job) (known issue in: https://github.com/gazebosim/gz-launch/issues/202 - CLOSED | https://github.com/gazebosim/gz-launch/issues/202 - OPEN) Issue #7 in gz_gui-ci-ign-gui6-focal-amd64 - Failing 25.0% in 1 out of 4 builds INTEGRATION_camera_tracking.test_ran Issue #8 in gz_sim-main-win - Failing 25.0% in 1 out of 4 builds ServerRepeat/MultipleServers.TwoServersMixedBlocking/0 Issue #9 in gz_transport-13-win - Failing 25.0% in 1 out of 4 builds playback.ReplayStep (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED | https://github.com/gazebosim/gz-transport/issues/195 - OPEN) (also in: "gz_transport-12-win" job) (known issue in: https://github.com/gazebosim/gz-transport/issues/195 - CLOSED | https://github.com/gazebosim/gz-transport/issues/195 - OPEN) Issue #10 in gz_transport-ci-main-jammy-amd64 - Failing 25.0% in 1 out of 4 builds UNIT_Recorder_TEST.test_ran (also in: "gz_transport-ci-gz-transport12-focal-amd64" job) Issue #11 in nightly_win_rel - Failing 6.67% in 1 out of 15 builds test_cli_remapping.TestCLIRemapping.test_topic_and_service_replacement[C:/ci/ws/src/ros2/system_tests/test_cli_remapping/test/name_maker.py] Issue #12 in nightly_win_rel - Failing 6.67% in 1 out of 15 builds test_cli_remapping.TestCLIRemapping.test_node_name_replacement[C:/ci/ws/build/test_cli_remapping/Release/name_maker_rclcpp.exe] (also in: "nightly_win_rep" job) Issue #13 in nightly_win_rel - Failing 6.67% in 1 out of 15 builds test_cli_remapping.TestCLIRemappingAfterShutdown.test_processes_finished_gracefully[C:/ci/ws/src/ros2/system_tests/test_cli_remapping/test/name_maker.py] test_cli_remapping.TestCLIRemappingAfterShutdown.test_processes_finished_gracefully[C:/ci/ws/build/test_cli_remapping/Release/name_maker_rclcpp.exe] test_cli_remapping.TestCLIRemapping.test_namespace_replacement[C:/ci/ws/src/ros2/system_tests/test_cli_remapping/test/name_maker.py] (also in: "nightly_win_rep" job) Issue #14 in nightly_win_rel - Failing 6.67% in 1 out of 15 builds projectroot.test_cli_remapping (also in: "nightly_win_rep" job) ```
github-actions[bot] commented 9 months ago

Feb 11

Build regressions ``` nightly_win_deb|3000|2024-02-11 04:00:01.687000|Number of failed test exceeds the threshold|test Rci__nightly-performance_ubuntu_jammy_amd64|626|2024-02-10 18:38:15.518000|Packages performance_test Failed|build workspace in isolation and install gz-fuel-tools10-debbuilder|122|2024-02-11 10:14:40.903000|Failed to compile and install build|install build dependencies from debian/control gz-fuel-tools10-debbuilder|121|2024-02-11 00:10:14.873000|Failed to compile and install build|install build dependencies from debian/control gz-gui9-debbuilder|120|2024-02-11 10:22:48.479000|Failed to compile and install build|install build dependencies from debian/control gz-gui9-debbuilder|119|2024-02-11 00:19:22.083000|Failed to compile and install build|install build dependencies from debian/control gz-launch8-debbuilder|114|2024-02-11 10:40:03.842000|Failed to compile and install build|install build dependencies from debian/control gz-launch8-debbuilder|113|2024-02-11 00:34:06.268000|Failed to compile and install build|install build dependencies from debian/control gz-msgs11-debbuilder|125|2024-02-11 10:00:04.195000|Failed to compile and install build|install build dependencies from debian/control gz-msgs11-debbuilder|124|2024-02-10 23:57:29.610000|Failed to compile and install build|install build dependencies from debian/control gz-physics8-debbuilder|120|2024-02-11 10:30:58.979000|Failed to compile and install build|install build dependencies from debian/control gz-physics8-debbuilder|119|2024-02-11 00:26:28.771000|Failed to compile and install build|install build dependencies from debian/control gz-rendering9-debbuilder|120|2024-02-11 10:04:45.530000|Failed to compile and install build|install build dependencies from debian/control gz-rendering9-debbuilder|119|2024-02-11 00:01:04.314000|Failed to compile and install build|install build dependencies from debian/control gz-sensors9-debbuilder|120|2024-02-11 10:27:24.962000|Failed to compile and install build|install build dependencies from debian/control gz-sensors9-debbuilder|119|2024-02-11 00:22:56.384000|Failed to compile and install build|install build dependencies from debian/control gz-sim9-debbuilder|118|2024-02-11 10:35:39.224000|Failed to compile and install build|install build dependencies from debian/control gz-sim9-debbuilder|117|2024-02-11 00:30:07.783000|Failed to compile and install build|install build dependencies from debian/control gz-tools2-debbuilder|1397|2024-02-11 09:18:33.719000|Failed to compile and install build|install build dependencies from debian/control gz-tools2-debbuilder|1396|2024-02-10 23:16:54.107000|Failed to compile and install build|install build dependencies from debian/control gz-transport14-debbuilder|123|2024-02-11 10:18:10.582000|Failed to compile and install build|install build dependencies from debian/control gz-transport14-debbuilder|122|2024-02-11 00:14:44.556000|Failed to compile and install build|install build dependencies from debian/control sdformat15-debbuilder|120|2024-02-11 10:10:01.613000|Failed to compile and install build|install build dependencies from debian/control sdformat15-debbuilder|119|2024-02-11 00:05:24.109000|Failed to compile and install build|install build dependencies from debian/control gz_physics-ign-physics5-win|21|2024-02-10 15:18:39.625000|Jenkins channel closing down (Agent disconnected)|colcon compilation with tests for ignition-physics5 gz_physics-ign-physics5-win|20|2024-02-10 15:06:25.444000|Jenkins channel closing down (Agent disconnected)|colcon compilation with tests for ignition-physics5 ```
Test regressions ``` Excluding 'performance, connext, fastrtps-dynamic' jobs Issue #1 in nightly_win_rep - Failing 84.62% in 11 out of 13 builds rclcpp.TestGuardCondition.construction_and_destruction projectroot.test.rclcpp.test_guard_condition Issue #2 in nightly_win_rep - Failing 38.46% in 5 out of 13 builds test_rclcpp.TestNNodesAfterShutdown.test_10_nodes projectroot.test_n_nodes__rmw_fastrtps_cpp Issue #3 in nightly_win_rep - Failing 23.08% in 3 out of 13 builds test_rclcpp.TestNNodes.test_10_nodes Issue #4 in gz_gui-ci-ign-gui6-focal-amd64 - Failing 50.0% in 2 out of 4 builds INTEGRATION_minimal_scene.test_ran (known issue in: https://github.com/gazebosim/gz-gui/issues/562 - CLOSED) INTEGRATION_marker_manager.test_ran Issue #5 in gz_gui-ci-ign-gui6-focal-amd64 - Failing 25.0% in 1 out of 4 builds INTEGRATION_camera_tracking.test_ran Issue #6 in gz_sim-ign-gazebo6-win - Failing 25.0% in 1 out of 4 builds ServerRepeat/MultipleServers.TwoServersMixedBlocking/0 (also in: "gz_sim-main-win" job) (also in: "gz_sim-ign-gazebo6-win" job) Issue #7 in gz_transport-ci-main-jammy-amd64 - Failing 25.0% in 1 out of 4 builds UNIT_Recorder_TEST.test_ran (also in: "gz_transport-ci-gz-transport12-focal-amd64" job) ```