asaiacai
commented
1 year ago The folks over at Skypilot tell me they are releasing sky serve with spot serving capabilities. Going to wait for their update to land in skypilot before I update this.
Open caseyoneill opened 1 year ago
asaiacai
commented
1 year ago The folks over at Skypilot tell me they are releasing sky serve with spot serving capabilities. Going to wait for their update to land in skypilot before I update this.
Apparently Skypilot uses spot instances. Is there currently a way to activate this option when using llm-atc?