Closed strangiato closed 2 months ago
Resolves #22
Adding the progress-deadline annotation to the vllm deployment to allow the node to autoscale successfully and deploy the vLLM instance before the default timeout of 10m expires.
Resolves #22
Adding the progress-deadline annotation to the vllm deployment to allow the node to autoscale successfully and deploy the vLLM instance before the default timeout of 10m expires.