search

dstackai / dstack

dstack is a lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud & on-prem support. It natively supports NVIDIA, AMD, & TPU.
https://dstack.ai/docs
Mozilla Public License 2.0
1.57k stars 155 forks source link

[Feature]: OCI spot instances #1375

Open jvstme opened 4 months ago

jvstme commented 4 months ago

OCI provides preemptible (spot) instances with a 50% discount for most CPU shapes and some GPU shapes. At the moment the discount is available for P100 and V100 GPUs, but not A10 or A100.

jvstme commented 4 months ago

Implementation note: gpuhunt can use the allowPreemptible field in Cost Estimator's shapes.json to determine if the discount is available for a shape.

jvstme commented 4 months ago

OCI spot instances support is ready in dstack, but we cannot add spot offers to gpuhunt catalog yet, as they would break previous dstack versions that do not distinguish between on-demand and spot offers. We can add spot offers to catalog later, once dstack versions 0.18.3 and 0.18.4 become irrelevant.

peterschmidt85 commented 3 months ago

This issue is stale because it has been open for 30 days with no activity.