skyplane-project / skyplane

🔥 Blazing fast bulk data transfers between any cloud 🔥
https://skyplane.org
Apache License 2.0
1.08k stars 62 forks source link

fall back to smaller vm if necessary #815

Closed xTRam1 closed 1 year ago

xTRam1 commented 1 year ago

Uses the vcpus quota information saved at client initialization to dynamically switch to smaller VM instances if the default VM from the configuration file passes the quota limit:

There are two ways to "fall back": 1) Just use a smaller VM for the task 2) Partition the task to multiple tasks with smaller vms

Done:

Roadmap:

sarahwooders commented 1 year ago

This looks good! A few comments: