ray-project / kuberay

A toolkit to run Ray applications on Kubernetes
Apache License 2.0
963 stars 328 forks source link

RayService: Omits Min and Max replicas from hash calculation #2172

Closed kpitzen closed 1 month ago

kpitzen commented 1 month ago

Why are these changes needed?

Currently, when updating RayService config, changing MinReplicas or MaxReplicas in the autoscaling config triggers an entirely new RayCluster to be instantiated. In order to facilitate orchestrating canary deployments, we'd like to have the ability to scale those parameters on an existing cluster as we move traffic over.

Related issue number

Currently no issue linked, but I can create one if needed.

Checks

kousun12 commented 1 month ago

would love to see this in the next release