search

envoyproxy / envoy

Cloud-native high-performance edge/middle/service proxy
https://www.envoyproxy.io
Apache License 2.0
24.84k stars 4.77k forks source link

Download failures on CI #36494

Open alyssawilk opened 1 day ago

alyssawilk commented 1 day ago

https://github.com/envoyproxy/envoy/actions/runs/11212818032/job/31164597707 Error: 2024/10/07 09:40:40 could not download Bazel: could not copy from https://releases.bazel.build/6.5.0/release/bazel-6.5.0-linux-x86_64 to /root/.cache/bazelisk/downloads/bazelbuild/bazel-6.5.0-linux-x86_64/bin/download212968532: stream error: stream ID 1; INTERNAL_ERROR

https://github.com/envoyproxy/envoy/actions/runs/11218555489/job/31182686750 Error: ERROR: /root/.cache/bazel/_bazel_root/bb3efe6b13248f746491cbfc24ae2efe/external/com_github_bazelbuild_buildtools/buildifier/BUILD.bazel:3:10: @com_github_bazelbuild_buildtools//buildifier:buildifier depends on @go_sdk//:go_linux_amd64-impl in repository @go_sdk which failed to fetch. no such package '@go_sdk//': java.io.IOException: Error downloading [https://dl.google.com/go/go1.23.1.linux-amd64.tar.gz] to /root/.cache/bazel/_bazel_root/bb3efe6b13248f746491cbfc24ae2efe/external/go_sdk/temp6404781646228535477/go1.23.1.linux-amd64.tar.gz: Bytes read 2883568 but wanted 73598519

https://github.com/envoyproxy/envoy/actions/runs/11224031337/job/31199982226 Download action repository 'envoyproxy/toolshed@actions-v0.2.35' (SHA:6a6b241e787106400f7e5858593941fbc39ff866) Warning: Failed to download action 'https://api.github.com/repos/envoyproxy/toolshed/tarball/6a6b241e787106400f7e5858593941fbc39ff866'. Error: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. Warning: Back off 22.026 seconds before retry. Warning: Failed to download action 'https://api.github.com/repos/envoyproxy/toolshed/tarball/6a6b241e787106400f7e5858593941fbc39ff866'. Error: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. Warning: Back off 12.057 seconds before retry. Error: Action 'https://api.github.com/repos/envoyproxy/toolshed/tarball/6a6b241e787106400f7e5858593941fbc39ff866' download has timed out. Error: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.

alyssawilk commented 1 day ago

cc @phlax @fredyw not sure if we ping engflow about connectivity or if we can improve our images to require fewer downloads. Thoughts?

phlax commented 1 day ago

these are variously cause by upstream failures

we mostly avoided this kind of error previously in azp with retriable prefetching

i didnt see them so much when i was testing the migration so didnt address in initial iteration but since we went live they are pretty common - so will prioritize

phlax commented 1 day ago

issue is https://github.com/envoyproxy/envoy/issues/36340

alyssawilk commented 1 day ago

Cool, thanks for the details + prioritization!

alyssawilk commented 8 hours ago

https://github.com/envoyproxy/envoy/actions/runs/11236006763/job/31235266988 https://github.com/envoyproxy/envoy/actions/runs/11236006763/job/31235266988

alyssawilk commented 2 hours ago

This one is definitely disruptive for developement. @phlax I know you're working on a fix but any ETA on this one?

phlax commented 2 hours ago

probably a week or 2 - maybe less - im getting a bit snagged by current dev, but will look at this once that is complete

we also have a pending release that might get in the way