ray-project / ray-llm

RayLLM - LLMs on Ray
https://aviary.anyscale.com
Apache License 2.0
1.22k stars 87 forks source link

Update method of accessing Serve controller #71

Closed shrekris-anyscale closed 10 months ago

shrekris-anyscale commented 10 months ago

The get_global_client() method is deprecated in a Ray 2.7. The RayLLM frontend uses get_global_client() to get a handle to the controller, so the frontend doesn't work with Ray 2.7.

This change updates the method of accessing the Serve controller, so the frontend is also compatible with Ray 2.7. It remains compatible with previous versions as well.