GKE How-To is out-of-date

ray-project / ray-llm

RayLLM - LLMs on Ray

https://aviary.anyscale.com

Apache License 2.0

1.22k stars 89 forks source link

GKE How-To is out-of-date #48

Open NikitaSemenovAiforia opened 1 year ago

NikitaSemenovAiforia commented 1 year ago

This link contains heml chart with image anyscale/aviary:latest-tgi This image is out-of-date. Even yaml shemas for models are wrong. https://ray-project.github.io/aviary/kuberay/deploy-on-gke/

ravishtiwari commented 8 months ago

@NikitaSemenovAiforia - use this updated Docs from GCP, I have tried it with L4 and it worked in first attempt. It's not using latest RayLLM image, so, you may want to updated it to either latest or your preferred version.