2i2c-org / infrastructure

Infrastructure for configuring and deploying our community JupyterHubs.
https://infrastructure.2i2c.org
BSD 3-Clause "New" or "Revised" License
103 stars 62 forks source link

Deploy to all cloudbank hubs can run into rate limitations #4379

Open consideRatio opened 2 months ago

consideRatio commented 2 months ago

When the deployer does the helm upgrade command, it can lead to the following error when doing it to soo many cloudbank hubs.

I have no clear action suggestion, but wanted to open an issue to represent work needed to spread awareness about this.

Error: UPGRADE FAILED: client rate limiter Wait returned an error: context deadline exceeded
sgibson91 commented 1 month ago

We could limit the number of concurrent jobs? https://docs.github.com/en/actions/writing-workflows/choosing-what-your-workflow-does/using-a-matrix-for-your-jobs#defining-the-maximum-number-of-concurrent-jobs