search

ros-infrastructure / ros_buildfarm

ROS buildfarm based on Docker
Apache License 2.0
81 stars 96 forks source link

add retry for apt-get update 503 #638

Closed tfoote closed 5 years ago

tfoote commented 5 years ago

We had 4 jobs fail due to a 503 from deb.debian.org this was an intermittent failure of the server. Adding this as a known retry case might prevent us from having a large fraction of our build fail.

From http://build.ros.org/view/Mbin_ds_dS64/job/Mbin_ds_dS64__dynamic_reconfigure__debian_stretch_amd64__binary/1/console

00:02:33.840 Step 22/26 : RUN python3 -u /tmp/wrapper_scripts/apt.py update-install-clean -q -y ccache
00:02:33.948  ---> Running in 9ae61e3709bc
00:02:34.700 Invoking 'apt-get update'
00:02:34.764 Get:1 http://repositories.ros.org/ubuntu/building stretch InRelease [4,658 B]
00:02:34.783 Ign:2 http://cloudfront.debian.net/debian stretch InRelease
00:02:34.796 Hit:3 http://cloudfront.debian.net/debian stretch Release
00:02:34.939 Ign:4 http://deb.debian.org/debian stretch InRelease
00:02:34.962 Hit:5 http://security-cdn.debian.org/debian-security stretch/updates InRelease
00:02:35.114 Ign:7 http://deb.debian.org/debian stretch-updates InRelease
00:02:35.286 Err:8 http://deb.debian.org/debian stretch Release
00:02:35.286   503  Service Unavailable [IP: 130.89.148.14 80]
00:02:35.458 Err:9 http://deb.debian.org/debian stretch-updates Release
00:02:35.458   503  Service Unavailable [IP: 130.89.148.14 80]
00:02:36.313 Reading package lists...
00:02:36.354 E: The repository 'http://deb.debian.org/debian stretch Release' does no longer have a Release file.
00:02:36.355 E: The repository 'http://deb.debian.org/debian stretch-updates Release' does no longer have a Release file.
00:02:36.359 Invocation failed without any known error condition, printing all lines to debug known error detection:
00:02:36.359   1 'Get:1 http://repositories.ros.org/ubuntu/building stretch InRelease [4,658 B]'
00:02:36.359   2 'Ign:2 http://cloudfront.debian.net/debian stretch InRelease'
00:02:36.359   3 'Hit:3 http://cloudfront.debian.net/debian stretch Release'
00:02:36.359   4 'Ign:4 http://deb.debian.org/debian stretch InRelease'
00:02:36.359   5 'Hit:5 http://security-cdn.debian.org/debian-security stretch/updates InRelease'
00:02:36.359   6 'Ign:7 http://deb.debian.org/debian stretch-updates InRelease'
00:02:36.359   7 'Err:8 http://deb.debian.org/debian stretch Release'
00:02:36.359   8 '  503  Service Unavailable [IP: 130.89.148.14 80]'
00:02:36.359   9 'Err:9 http://deb.debian.org/debian stretch-updates Release'
00:02:36.359   10 '  503  Service Unavailable [IP: 130.89.148.14 80]'
00:02:36.359   11 'Reading package lists...'
00:02:36.359   12 'E: The repository 'http://deb.debian.org/debian stretch Release' does no longer have a Release file.'
00:02:36.359   13 'E: The repository 'http://deb.debian.org/debian stretch-updates Release' does no longer have a Release file.'
00:02:36.359 None of the following known errors were detected:
00:02:36.359   1 'Failed to fetch'
00:02:36.359   2 'Failed to stat'
00:02:36.359   3 'Hash Sum mismatch'
00:02:36.359   4 'Unable to locate package'
00:02:36.359   5 'is not what the server reported'

Also observed:

dirk-thomas commented 5 years ago

@tfoote If you are still interested to retry on this specific error please consider to contribute a pull request for this. Otherwise please go ahead and close the ticket.

dirk-thomas commented 5 years ago

Closing due to no reply.