Spot prices & GCP on-demand prices

skypilot-org / skypilot

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

https://skypilot.readthedocs.io

Apache License 2.0

6.49k stars 463 forks source link

Spot prices & GCP on-demand prices #976

Closed WoosukKwon closed 2 years ago

WoosukKwon commented 2 years ago

If I am understanding correctly, Sky is using stale or inaccurate prices for spot instances and on-demand GCP instances. I believe we should fix this problem before open sourcing.

concretevitamin commented 2 years ago

+1. At the minimum we should do a refresh of the catalogs. E.g., GCP just announced ARM-based VMs.

Michaelvll commented 2 years ago

Seems GCP provides an API for fetching all the prices here. Probably, we can utilize it to get the real price for different instances.

PS, the service ID for compute engine is services/6F81-5844-456A

WoosukKwon commented 2 years ago

@Michaelvll I tried to use the API, but it seems 1) we need to create an API key to use it (https://cloudbilling.googleapis.com/v1/services/6F81-5844-456A/skus?currencyCode=USD&key=[YOUR_API_KEY]), and 2) when I see the response queried by the API explorer, the queried json looks difficult to parse.