usdot-fhwa-stol / carma-platform

CARMA Platform is built on robot operating system (ROS) and utilizes open source software (OSS) that enables Cooperative Driving Automation (CDA) features to allow Automated Driving Systems to interact and cooperate with infrastructure and other vehicles through communication. Doxygen Source Code Documentation :
https://usdot-fhwa-stol.github.io/documentation/carma-platform/
395 stars 122 forks source link

Autoware.ai build is failing due to submodules not being detected correctly #2369

Open MishkaMN opened 3 months ago

MishkaMN commented 3 months ago

Summary

Therare submodules defined in autoware.ai subdirectory that are not getting correctly detected by github submodule. Not sure if this is something that always existed or something occurred due to our change Since then, the build is failing saying it was not able to find url for its submodules (please see the long error message below):

#1 [internal] load git source https://github.com/usdot-fhwa-stol/autoware.ai.git#eeaa1296f41c24378bb6a9de4971c4022435a0fd
#1 0.080 Initialized empty Git repository in /var/lib/buildkit/runc-overlayfs/snapshots/snapshots/1/fs/
#1 0.[115](https://github.com/usdot-fhwa-stol/autoware.ai/actions/runs/8624683047/job/23640077614#step:7:120) fatal: Not a valid object name eeaa1296f41c24378bb6a9de4971c4022435a0fd^{commit}
#1 11.08 From https://github.com/usdot-fhwa-stol/autoware.ai
#1 11.08  * [new branch]          bugfix/auto_builds      -> origin/bugfix/auto_builds
#1 11.08  * [new branch]          carma-develop           -> origin/carma-develop
#1 11.08  * [new branch]          carma-master            -> origin/carma-master
#1 11.08  * [new branch]          compilation-database    -> origin/compilation-database
#1 11.08  * [new branch]          feature/add_can2odom    -> origin/feature/add_can2odom
#1 11.08  * [new branch]          feature/add_gha         -> origin/feature/add_gha
#1 11.08  * [new branch]          feature/add_polymorphism_to_reg_elem -> origin/feature/add_polymorphism_to_reg_elem
#1 11.08  * [new branch]          feature/arm_port        -> origin/feature/arm_port
#1 11.08  * [new branch]          feature/bus_stop_sp     -> origin/feature/bus_stop_sp
#1 11.08  * [new branch]          feature/carla_bridge    -> origin/feature/carla_bridge
#1 11.08  * [new branch]          feature/carma_python_support -> origin/feature/carma_python_support
#1 11.08  * [new branch]          feature/ekf_timestamp   -> origin/feature/ekf_timestamp
#1 11.08  * [new branch]          feature/enhanced-build-warnings -> origin/feature/enhanced-build-warnings
#1 11.08  * [new branch]          feature/gear_change_update -> origin/feature/gear_change_update
#1 11.08  * [new branch]          feature/gitmodule       -> origin/feature/gitmodule
#1 11.08  * [new branch]          feature/ihp_develop_merge -> origin/feature/ihp_develop_merge
#1 11.08  * [new branch]          feature/lanelet2_participation_type -> origin/feature/lanelet2_participation_type
#1 11.08  * [new branch]          feature/lanelet2_update -> origin/feature/lanelet2_update
#1 11.08  * [new branch]          feature/mpc_controller  -> origin/feature/mpc_controller
#1 11.08  * [new branch]          feature/mpc_test        -> origin/feature/mpc_test
#1 11.08  * [new branch]          feature/msgs_ros1_and_ros2_compile_backup -> origin/feature/msgs_ros1_and_ros2_compile_backup
#1 11.08  * [new branch]          feature/ndt_with_imu    -> origin/feature/ndt_with_imu
#1 11.08  * [new branch]          feature/object_detection -> origin/feature/object_detection
#1 11.08  * [new branch]          feature/object_tracking -> origin/feature/object_tracking
#1 11.08  * [new branch]          feature/ros2_update_amathutils -> origin/feature/ros2_update_amathutils
#1 11.08  * [new branch]          feature/update_ci_for_ros2 -> origin/feature/update_ci_for_ros2
#1 11.08  * [new branch]          feature/update_ekf_tf_pub -> origin/feature/update_ekf_tf_pub
#1 11.08  * [new branch]          feature/update_tfhrc_full_map_tf -> origin/feature/update_tfhrc_full_map_tf
#1 11.08  * [new branch]          feature/voxel_grid_filter -> origin/feature/voxel_grid_filter
#1 11.08  * [new branch]          fix/cleaner_speed_limit_constraint -> origin/fix/cleaner_speed_limit_constraint
#1 11.09  * [new branch]          fix/jsk_common_msgs     -> origin/fix/jsk_common_msgs
#1 11.09  * [new branch]          fix/jsk_common_msgs_actually_working -> origin/fix/jsk_common_msgs_actually_working
#1 11.09  * [new branch]          fix/lanelet2_traffic_rules_install -> origin/fix/lanelet2_traffic_rules_install
#1 11.09  * [new branch]          fix/lanelet_or_area     -> origin/fix/lanelet_or_area
#1 11.09  * [new branch]          fix/message_install     -> origin/fix/message_install
#1 11.09  * [new branch]          fix/mrt_cmake_modules_install -> origin/fix/mrt_cmake_modules_install
#1 11.09  * [new branch]          fix/only_update_map_when_vehicle_changes_pos -> origin/fix/only_update_map_when_vehicle_changes_pos
#1 11.09  * [new branch]          fix/purepursuit_stopnwait -> origin/fix/purepursuit_stopnwait
#1 11.09  * [new branch]          fix/revert_ndt_matching -> origin/fix/revert_ndt_matching
#1 11.09  * [new branch]          fix/ros2_localization   -> origin/fix/ros2_localization
#1 11.09  * [new branch]          fix/rout_following      -> origin/fix/rout_following
#1 11.09  * [new branch]          fix/speed_limit_overwrite -> origin/fix/speed_limit_overwrite
#1 11.09  * [new branch]          fix/speed_limits        -> origin/fix/speed_limits
#1 11.09  * [new branch]          fix/vector_map_alignment -> origin/fix/vector_map_alignment
#1 11.09  * [new branch]          gha                     -> origin/gha
#1 11.09  * [new branch]          hotfix/higher_point_limit -> origin/hotfix/higher_point_limit
#1 11.09  * [new branch]          integration/autoware-1.12-upgrade -> origin/integration/autoware-1.12-upgrade
#1 11.09  * [new branch]          integration/autoware-1.13-alpha-upgrade -> origin/integration/autoware-1.13-alpha-upgrade
#1 11.09  * [new branch]          integration/autoware-1.13-prerelease -> origin/integration/autoware-1.13-prerelease
#1 11.09  * [new branch]          integration/ros_noetic  -> origin/integration/ros_noetic
#1 11.09  * [new branch]          noetic/develop          -> origin/noetic/develop
#1 11.09  * [new branch]          noetic/release          -> origin/noetic/release
#1 11.09  * [new branch]          refactor_lanelet2_extension -> origin/refactor_lanelet2_extension
#1 11.09  * [new branch]          release/a1              -> origin/release/a1
#1 11.09  * [new branch]          release/autobuild_test  -> origin/release/autobuild_test
#1 11.09  * [new branch]          release/cabin           -> origin/release/cabin
#1 11.09  * [new branch]          release/demo            -> origin/release/demo
#1 11.09  * [new branch]          release/fiesta          -> origin/release/fiesta
#1 11.09  * [new branch]          release/grayson_test    -> origin/release/grayson_test
#1 11.09  * [new branch]          release/isetta          -> origin/release/isetta
#1 11.09  * [new branch]          release/k900            -> origin/release/k900
#1 11.09  * [new branch]          release/lavida          -> origin/release/lavida
#1 11.09  * [new branch]          remove-build-wrapper    -> origin/remove-build-wrapper
#1 11.09  * [new branch]          resolve_conflicts       -> origin/resolve_conflicts
#1 11.09  * [new branch]          reusable-workflows      -> origin/reusable-workflows
#1 11.09  * [new branch]          revert-28-release/skyline -> origin/revert-28-release/skyline
#1 11.09  * [new branch]          revert-31-feature/update-autoware-version -> origin/revert-31-feature/update-autoware-version
#1 11.09  * [new branch]          sync-master-to-develop  -> origin/sync-master-to-develop
#1 11.09  * [new branch]          sync_develop_with_3_7   -> origin/sync_develop_with_3_7
#1 11.09  * [new branch]          sync_develop_with_elise -> origin/sync_develop_with_elise
#1 11.09  * [new branch]          sync_elise_with_master  -> origin/sync_elise_with_master
#1 11.09  * [new branch]          test/ekf_filter         -> origin/test/ekf_filter
#1 11.09  * [new branch]          test/localization_stack -> origin/test/localization_stack
#1 11.09  * [new branch]          test/master_voices      -> origin/test/master_voices
#1 11.09  * [new branch]          test/voices-pursuit-fix -> origin/test/voices-pursuit-fix
#1 11.09  * [new branch]          update-version-4.5.0    -> origin/update-version-4.5.0
#1 11.09  * [new tag]             carma-system-4.5.0      -> carma-system-4.5.0
#1 11.09  * [new tag]             sit1_rfr                -> sit1_rfr
#1 11.15  * [new tag]             1.0.0                   -> 1.0.0
#1 11.15  * [new tag]             1.0.1                   -> 1.0.1
#1 11.15  * [new tag]             1.1.0                   -> 1.1.0
#1 11.15  * [new tag]             1.1.1                   -> 1.1.1
#1 11.15  * [new tag]             1.1.2                   -> 1.1.2
#1 11.15  * [new tag]             1.10.0                  -> 1.10.0
#1 11.15  * [new tag]             1.11.0                  -> 1.11.0
#1 11.15  * [new tag]             1.2.0                   -> 1.2.0
#1 11.15  * [new tag]             1.3.0                   -> 1.3.0
#1 11.16  * [new tag]             1.3.1                   -> 1.3.1
#1 11.16  * [new tag]             1.4.0                   -> 1.4.0
#1 11.16  * [new tag]             1.5.0                   -> 1.5.0
#1 11.16  * [new tag]             1.5.1                   -> 1.5.1
#1 11.16  * [new tag]             1.6.0                   -> 1.6.0
#1 11.16  * [new tag]             1.6.1                   -> 1.6.1
#1 11.16  * [new tag]             1.6.2                   -> 1.6.2
#1 11.16  * [new tag]             1.6.3                   -> 1.6.3
#1 11.16  * [new tag]             1.7.0                   -> 1.7.0
#1 11.16  * [new tag]             1.8.0                   -> 1.8.0
#1 11.16  * [new tag]             1.9.0                   -> 1.9.0
#1 11.16  * [new tag]             1.9.1                   -> 1.9.1
#1 11.16  * [new tag]             CARMASystem_3.1.0       -> CARMASystem_3.1.0
#1 11.16  * [new tag]             CARMASystem_3.2.0       -> CARMASystem_3.2.0
#1 11.16  * [new tag]             Version_3.0.0           -> Version_3.0.0
#1 11.16  * [new tag]             autoware.ai-3.8.2       -> autoware.ai-3.8.2
#1 11.16  * [new tag]             autoware.ai-3.9.0       -> autoware.ai-3.9.0
#1 11.16  * [new tag]             autoware.ai_3.0.0       -> autoware.ai_3.0.0
#1 11.16  * [new tag]             autoware.ai_3.1.0       -> autoware.ai_3.1.0
#1 11.16  * [new tag]             autoware.ai_3.2.0       -> autoware.ai_3.2.0
#1 11.16  * [new tag]             autoware.ai_3.3.0       -> autoware.ai_3.3.0
#1 11.16  * [new tag]             autoware.ai_3.4.0       -> autoware.ai_3.4.0
#1 11.16  * [new tag]             autoware.ai_3.5.0       -> autoware.ai_3.5.0
#1 11.16  * [new tag]             autoware.ai_3.6.0       -> autoware.ai_3.6.0
#1 11.16  * [new tag]             autoware.ai_3.7.0       -> autoware.ai_3.7.0
#1 11.16  * [new tag]             autoware.ai_3.8.0       -> autoware.ai_3.8.0
#1 11.16  * [new tag]             autoware.ai_3.8.1       -> autoware.ai_3.8.1
#1 11.16  * [new tag]             carma-system-3.10.0     -> carma-system-3.10.0
#1 11.16  * [new tag]             carma-system-3.11.0     -> carma-system-3.11.0
#1 11.16  * [new tag]             carma-system-3.4.0      -> carma-system-3.4.0
#1 11.16  * [new tag]             carma-system-3.4.1      -> carma-system-3.4.1
#1 11.16  * [new tag]             carma-system-3.4.2      -> carma-system-3.4.2
#1 11.16  * [new tag]             carma-system-3.4.3      -> carma-system-3.4.3
#1 11.16  * [new tag]             carma-system-3.5.0      -> carma-system-3.5.0
#1 11.16  * [new tag]             carma-system-3.5.3      -> carma-system-3.5.3
#1 11.16  * [new tag]             carma-system-3.6.0      -> carma-system-3.6.0
#1 11.16  * [new tag]             carma-system-3.7.0      -> carma-system-3.7.0
#1 11.16  * [new tag]             carma-system-3.8.0      -> carma-system-3.8.0
#1 11.16  * [new tag]             carma-system-3.9.0      -> carma-system-3.9.0
#1 11.16  * [new tag]             carma-system-4.0.0      -> carma-system-4.0.0
#1 11.16  * [new tag]             carma-system-4.0.3      -> carma-system-4.0.3
#1 11.16  * [new tag]             carma-system-4.1.0      -> carma-system-4.1.0
#1 11.16  * [new tag]             carma-system-4.2.0      -> carma-system-4.2.0
#1 11.16  * [new tag]             carma-system-4.3.0      -> carma-system-4.3.0
#1 11.16  * [new tag]             carma-system-4.4.0      -> carma-system-4.4.0
#1 13.82 fatal: No url found for submodule path 'jsk_common_msgs/.travis' in .gitmodules
#1 ERROR: failed to update submodules for https://github.com/usdot-fhwa-stol/autoware.ai.git: git error: exit status 128
stderr:
fatal: No url found for submodule path 'jsk_common_msgs/.travis' in .gitmodules

------
 > [internal] load git source https://github.com/usdot-fhwa-stol/autoware.ai.git#eeaa1296f41c24378bb6a9de4971c4022435a0fd:
11.16  * [new tag]             carma-system-3.7.0      -> carma-system-3.7.0
11.16  * [new tag]             carma-system-3.8.0      -> carma-system-3.8.0
11.16  * [new tag]             carma-system-3.9.0      -> carma-system-3.9.0
11.16  * [new tag]             carma-system-4.0.0      -> carma-system-4.0.0
11.16  * [new tag]             carma-system-4.0.3      -> carma-system-4.0.3
11.16  * [new tag]             carma-system-4.1.0      -> carma-system-4.1.0
11.16  * [new tag]             carma-system-4.2.0      -> carma-system-4.2.0
11.16  * [new tag]             carma-system-4.3.0      -> carma-system-4.3.0
11.16  * [new tag]             carma-system-4.4.0      -> carma-system-4.4.0
13.82 fatal: No url found for submodule path 'jsk_common_msgs/.travis' in .gitmodules
------
ERROR: failed to solve: failed to read dockerfile: failed to update submodules for https://github.com/usdot-fhwa-stol/autoware.ai.git: git error: exit status [128](https://github.com/usdot-fhwa-stol/autoware.ai/actions/runs/8624683047/job/23640077614#step:7:133)
stderr:
fatal: No url found for submodule path 'jsk_common_msgs/.travis' in .gitmodules

Original can be seen from this: https://github.com/usdot-fhwa-stol/autoware.ai/actions/runs/8624698002/job/23640117337

When moving these submodule declarations into the root directory of the repository, submodules are detected but it still was not possible to clone the repositories with following unknown error:

#0 building with "builder-d96ce27e-2b94-4238-b169-b5d4327c3d3b" instance using docker-container driver

#1 [internal] load git source https://github.com/usdot-fhwa-stol/autoware.ai.git#refs/pull/271/merge
#1 0.042 Initialized empty Git repository in /var/lib/buildkit/runc-overlayfs/snapshots/snapshots/1/fs/
#1 0.399 b7cc23d1c9e0bb7ad0eb1130b4afd5c8427b686d   refs/pull/271/merge
#1 8.510 From https://github.com/usdot-fhwa-stol/autoware.ai
#1 8.510  * [new ref]         refs/pull/271/merge -> refs/pull/271/merge
#1 11.08 Submodule 'jsk_common_msgs/.travis' (git://github.com/jsk-ros-pkg/jsk_travis) registered for path 'jsk_common_msgs/.travis'
#1 11.08 Submodule 'jsk_recognition/.travis' (https://github.com/jsk-ros-pkg/jsk_travis.git) registered for path 'jsk_recognition/.travis'
#1 11.08 Submodule 'jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort' (https://github.com/nwojke/deep_sort.git) registered for path 'jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort'
#1 11.08 Submodule 'jsk_recognition/jsk_perception/slic' (https://github.com/garaemon/SLIC-Superpixels.git) registered for path 'jsk_recognition/jsk_perception/slic'
#1 11.08 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis'...
#1 146.1 fatal: unable to connect to github.com:
#1 146.1 github.com[0: 140.82.[113](https://github.com/usdot-fhwa-stol/autoware.ai/actions/runs/8791371654/job/24125441576#step:4:118).3]: errno=Operation timed out
#1 146.1 
#1 146.1 fatal: clone of 'git://github.com/jsk-ros-pkg/jsk_travis' into submodule path '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis' failed
#1 146.1 Failed to clone 'jsk_common_msgs/.travis'. Retry scheduled
#1 146.1 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/.travis'...
#1 146.3 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort'...
#1 146.5 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/jsk_perception/slic'...
#1 146.7 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis'...
#1 281.3 fatal: unable to connect to github.com:
#1 281.3 github.com[0: 140.82.113.3]: errno=Operation timed out
#1 281.3 
#1 281.3 fatal: clone of 'git://github.com/jsk-ros-pkg/jsk_travis' into submodule path '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis' failed
#1 281.3 Failed to clone 'jsk_common_msgs/.travis' a second time, aborting
#1 ERROR: failed to update submodules for https://github.com/usdot-fhwa-stol/autoware.ai.git: git error: exit status 1
stderr:
Submodule 'jsk_common_msgs/.travis' (git://github.com/jsk-ros-pkg/jsk_travis) registered for path 'jsk_common_msgs/.travis'
Submodule 'jsk_recognition/.travis' (https://github.com/jsk-ros-pkg/jsk_travis.git) registered for path 'jsk_recognition/.travis'
Submodule 'jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort' (https://github.com/nwojke/deep_sort.git) registered for path 'jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort'
Submodule 'jsk_recognition/jsk_perception/slic' (https://github.com/garaemon/SLIC-Superpixels.git) registered for path 'jsk_recognition/jsk_perception/slic'
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis'...
fatal: unable to connect to github.com:
github.com[0: 140.82.113.3]: errno=Operation timed out

fatal: clone of 'git://github.com/jsk-ros-pkg/jsk_travis' into submodule path '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis' failed
Failed to clone 'jsk_common_msgs/.travis'. Retry scheduled
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/.travis'...
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort'...
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/jsk_perception/slic'...
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis'...
fatal: unable to connect to github.com:
github.com[0: 140.82.113.3]: errno=Operation timed out

fatal: clone of 'git://github.com/jsk-ros-pkg/jsk_travis' into submodule path '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis' failed
Failed to clone 'jsk_common_msgs/.travis' a second time, aborting

------
 > [internal] load git source https://github.com/usdot-fhwa-stol/autoware.ai.git#refs/pull/271/merge:
146.1 Failed to clone 'jsk_common_msgs/.travis'. Retry scheduled
146.1 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/.travis'...
146.3 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort'...
146.5 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/jsk_perception/slic'...
146.7 Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis'...
281.3 fatal: unable to connect to github.com:
281.3 github.com[0: 140.82.113.3]: errno=Operation timed out
281.3 
281.3 fatal: clone of 'git://github.com/jsk-ros-pkg/jsk_travis' into submodule path '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis' failed
281.3 Failed to clone 'jsk_common_msgs/.travis' a second time, aborting
------
WARNING: No output specified with docker-container driver. Build result will only remain in the build cache. To push result image into registry use --push or to load image into docker use --load
ERROR: failed to solve: failed to read dockerfile: failed to update submodules for https://github.com/usdot-fhwa-stol/autoware.ai.git: git error: exit status 1
stderr:
Submodule 'jsk_common_msgs/.travis' (git://github.com/jsk-ros-pkg/jsk_travis) registered for path 'jsk_common_msgs/.travis'
Submodule 'jsk_recognition/.travis' (https://github.com/jsk-ros-pkg/jsk_travis.git) registered for path 'jsk_recognition/.travis'
Submodule 'jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort' (https://github.com/nwojke/deep_sort.git) registered for path 'jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort'
Submodule 'jsk_recognition/jsk_perception/slic' (https://github.com/garaemon/SLIC-Superpixels.git) registered for path 'jsk_recognition/jsk_perception/slic'
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis'...
fatal: unable to connect to github.com:
github.com[0: 140.82.113.3]: errno=Operation timed out

fatal: clone of 'git://github.com/jsk-ros-pkg/jsk_travis' into submodule path '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis' failed
Failed to clone 'jsk_common_msgs/.travis'. Retry scheduled
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/.travis'...
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/jsk_perception/node_scripts/deep_sort/deep_sort'...
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_recognition/jsk_perception/slic'...
Cloning into '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis'...
fatal: unable to connect to github.com:
github.com[0: 140.82.113.3]: errno=Operation timed out

fatal: clone of 'git://github.com/jsk-ros-pkg/jsk_travis' into submodule path '/var/lib/buildkit/runc-overlayfs/snapshots/snapshots/2/fs/jsk_common_msgs/.travis' failed
Failed to clone 'jsk_common_msgs/.travis' a second time, aborting

Original can be seen from this action: https://github.com/usdot-fhwa-stol/autoware.ai/actions/runs/8791371654/job/24125441576

Which leds me to believe (I could be wrong) that these submodules were never really cloned AND not needed. They were added in 4.0.0 as part of fork from autoware, and the packages we build don't seem to need them: please check this PR where basically removed the submodules https://github.com/usdot-fhwa-stol/autoware.ai/pull/268 And the build succeeds: https://github.com/usdot-fhwa-stol/autoware.ai/actions/runs/8630864827/job/23658072373?pr=268

However, I am not sure whether if this will fail at run-time or fail on features that we do not use currently such as any perception involved operations.

Version

4.5.0 (Current)

Expected Behavior

See above

Actual Behavior

See above

Steps to Reproduce the Actual Behavior

See above

Related Work

No response

MishkaMN commented 3 months ago

Interstingly, when we trigger build image with top of carma-develop branch, we are able to build the image, which I am assuming it skips the git cloning operation and builds from "cached builds"?. However, if that is the case, I am still little confused how it was able to build the cached one from the beginning:

Run docker/build-push-action@v3
GitHub Actions runtime token access controls
Docker info
Buildx version

/usr/bin/docker buildx build --iidfile /tmp/docker-build-push-UIfUNE/iidfile --tag usdotfhwastoldev/autoware.ai:develop --metadata-file /tmp/docker-build-push-UIfUNE/metadata-file --push .
#0 building with "builder-d5441fe6-8542-419c-a968-a4d0b669d5c8" instance using docker-container driver
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 1.18kB done
#1 DONE 0.0s
#2 [internal] load metadata for docker.io/usdotfhwastoldev/carma-base:develop
#2 ...
#3 [auth] usdotfhwastoldev/carma-base:pull token for registry-1.docker.io
#3 DONE 0.0s
#2 [internal] load metadata for docker.io/usdotfhwastoldev/carma-base:develop
#2 DONE 0.7s
#4 [internal] load .dockerignore
#4 transferring context: 500B done
#4 DONE 0.0s
#5 [base_image 1/1] FROM docker.io/usdotfhwastoldev/carma-base:develop@sha256:a5b9[21](https://github.com/usdot-fhwa-stol/autoware.ai/actions/runs/8793203268/job/24130696780#step:5:23)b6f0dc550ecabc47e3706323e8bfa14da67600aae56795f8e985056c8a
#5 resolve docker.io/usdotfhwastoldev/carma-base:develop@sha256:a5b921b6f0dc550ecabc47e3706323e8bfa14da67600aae56795f8e985056c8a done
#5 DONE 0.1s
#6 [internal] load build context
#6 transferring context: 491.36MB 4.8s done
#6 DONE 4.8s

Action: https://github.com/usdot-fhwa-stol/autoware.ai/actions/runs/8793203268/job/24130696780