WISE-Developers / WISE_Application

WISE_Application formerly known as WISE
GNU Affero General Public License v3.0
7 stars 2 forks source link

Address the issue of rate limiting in github workflows. #48

Open spydmobile opened 1 year ago

spydmobile commented 1 year ago

https://github.com/WISE-Developers/WISE_Application/blob/16d71890f9f0bafa6dbb5e0ac57d9030e56682ef/.github/workflows/cmake.yml#L553

From Travis: "I’ll note that the HSS SharePoint is used in several places but is only really required for the pre-built GDAL libraries and the pre-built timezone data. I moved a few external archives (including the protobuf source archive seen in the diagram) from it’s original location to SharePoint because we kept getting blocked from downloading them directly. I want to guess that the IP block used by GitHub Actions is flooding some of these download sites causing rate limits to be hit without any single user actually hitting the limit. This doesn’t make complete sense though because it was happening downloading files from GitHub releases as well, although the packages being downloaded were from relatively popular repositories so maybe a limit does still exist. The errors from GitHub included messages about Azure resource limits. "