Add RayService Manifests for Stable Diffusion TPU Examples

ray-project / kuberay

A toolkit to run Ray applications on Kubernetes

Apache License 2.0

963 stars 328 forks source link

Closed ryanaoleary closed 3 days ago

ryanaoleary commented 1 week ago

Example RayService manifests using TPUs for documentation added in this PR: https://github.com/ray-project/ray/pull/45924. Once https://github.com/ray-project/serve_config_examples/pull/8 is merged I'll change the working_dir field for both RayServices (currently they point to my fork).

[ ] I've made sure the tests are passing.
Testing Strategy
- [ ] Unit tests
- [x] Manual tests
- [ ] This PR is not tested :(

ryanaoleary commented 6 days ago

@andrewsykim I don't have multi-host TPU from my side. I will merge the PR if you approve it. Thanks!

I think it's important to merge https://github.com/ray-project/serve_config_examples/pull/8 first so I can change the working_dir to point to the kuberay/master branch rather than my fork.

Update: The working_dir now points to the correct location.

kevin85421 commented 3 days ago

cc @andrewsykim is this PR ready to merge?