Need ability to choose disk size for vastai instead of the hardcoded 80GB

dstackai / dstack

dstack is a lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud & on-prem support. It natively supports NVIDIA, AMD, & TPU.

https://dstack.ai/docs

Mozilla Public License 2.0

1.6k stars 156 forks source link

Need ability to choose disk size for vastai instead of the hardcoded 80GB #973

Closed iRohith closed 7 months ago

r4victor commented 8 months ago

@iRohith, I'm not sure I understand what "hardcoded 80GB" is referring to. Can you please point in the code where the hardcode is and what it affects?

iRohith commented 8 months ago

@r4victor It is hard coded here https://github.com/dstackai/dstack/blob/28a72b170cbe77c034dbae1a3f9b94972350d7dc/src/dstack/_internal/core/backends/vastai/api_client.py#L12. Other providers like aws. gcp, azure create an instance with specific disk size when we specify disk size in requirements but not vast ai. It shows no offers when we specify exact disk size.

r4victor commented 8 months ago

Got it! Will take care of it.