Unexpected EOF - Humble binary builds

[ijnek]

unexpected EOF has happened across a few of my Humble Ubuntu Jammy binary builds in the last few days.

• https://build.ros2.org/job/Hbin_uJ64__nao_lola__ubuntu_jammy_amd64__binary/32/console
• https://build.ros2.org/job/Hbin_ujv8_uJv8__cv_bridge__ubuntu_jammy_arm64__binary/18/console
• https://build.ros2.org/job/Hbin_ujv8_uJv8__ros_image_to_qimage__ubuntu_jammy_arm64__binary/20/console

They seem to pass the subsequent build that usually happens within 24 hours of the failed one.

[Blast545]

Maybe related? https://github.com/ros2/ci/issues/702 cc: @claraberendsen

[claraberendsen]

@ijnek From the three builds listed here only one had a remaining online agent I could go through. I have not found evidence of the error related with unattended upgrade or of a OOM killed process during that time frame. My best guess on the cause of this issue is this line in the log

Jun 24 23:00:01 ip-10-0-1-202 CRON[3101021]: (root) CMD (/root/docker-disk-cleanup.sh)

that executes this script that does system prune and that for some reason the docker container got selected there. Let me know if you see it again I can dig a bit more if there are more available agents.

[wep21]

I have encountered the similar issue that says error waiting for container: unexpected EOF. https://build.ros2.org/job/Hbin_uJ64__aws_sdk_cpp_vendor__ubuntu_jammy_amd64__binary/16/display/redirect https://build.ros2.org/job/Rbin_ujv8_uJv8__aws_sdk_cpp_vendor__ubuntu_jammy_arm64__binary/11/display/redirect