DataBiosphere / toil

A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.
http://toil.ucsc-cgl.org/.
Apache License 2.0
899 stars 240 forks source link

AMI fetching may be flaky. #4536

Open DailyDreaming opened 1 year ago

DailyDreaming commented 1 year ago

Investigate gitlab run #46779.

┆Issue is synchronized with this Jira Story ┆Issue Number: TOIL-1372

unito-bot commented 1 year ago

➤ Adam Novak commented:

We want to pre-fetch the Flatcar feeds (when they are up) and commit a list of AMIs that we can fall back on when they are down. Then we will run the script every once in a while to update them.

adamnovak commented 3 weeks ago

This is related to but not a duplicate of #4475.