[Feature] How to deploy a RayService with deployment to exist RayCluster ?

ray-project / kuberay

A toolkit to run Ray applications on Kubernetes

Apache License 2.0

1.3k stars 414 forks source link

[Feature] How to deploy a RayService with deployment to exist RayCluster ? #2560

Open xushaoxiao opened 4 days ago

xushaoxiao commented 4 days ago

Search before asking

[X] I had searched in the issues and found no similar feature requirement.

Description

Hi teams, i want to deploy directly a application via rayservice to exist raycluster, what can do it ?

Now exist:

Use case

You can asume i have a new application serving by rayserve, the name is rayservice-app-one .

Related issues

No response

Are you willing to submit a PR?

[ ] Yes I am willing to submit a PR!

andrewsykim commented 4 days ago

You can connect to the Ray cluster and then use serve run to deploy your serve applications

xushaoxiao commented 4 days ago

You can connect to the Ray cluster and then use serve run to deploy your serve applications

via common "deployment" to kuberay cluster

kevin85421 commented 2 days ago

For prototyping, you can run serve run. However, for production, you should create a RayService CR with a new RayCluster. To achieve RayService high availability, all Pods must be configured with readiness probes which are different from RayCluster CR.