search

dstackai / dstack

dstack is an easy-to-use and flexible container orchestrator for running AI workloads in any cloud or data center.
https://dstack.ai
Mozilla Public License 2.0
1.24k stars 91 forks source link

Optimize getting run plan when using region/instance-type filters #1206

Open jvstme opened 2 months ago

jvstme commented 2 months ago

Current

The user can filter instance offers by region or instance type, e.g.:

dstack run . --region westus3

However, the current implementation always prepares offers for all regions and instance types and applies the filters only after that. This may slow down getting the run plan significantly due to checking quotas and availability for the instances that will then be filtered out.

Proposed

Pass these filters to Compute.get_offers and adjust backend implementations to only prepare offers for the requested regions and instance types.

peterschmidt85 commented 1 month ago

This issue is stale because it has been open for 30 days with no activity.

peterschmidt85 commented 3 weeks ago

This issue was closed because it has been inactive for 14 days since being marked as stale. Please reopen the issue if it is still relevant.

jvstme commented 3 weeks ago

Relevant