dstackai / dstack

dstack is an easy-to-use and flexible container orchestrator for running AI workloads in any cloud or data center.
https://dstack.ai
Mozilla Public License 2.0
1.19k stars 87 forks source link

[Feature]: OCI spot instances #1375

Open jvstme opened 2 days ago

jvstme commented 2 days ago

OCI provides preemptible (spot) instances with a 50% discount for most CPU shapes and some GPU shapes. At the moment the discount is available for P100 and V100 GPUs, but not A10 or A100.

jvstme commented 2 days ago

Implementation note: gpuhunt can use the allowPreemptible field in Cost Estimator's shapes.json to determine if the discount is available for a shape.