search

ray-project / ray-llm

RayLLM - LLMs on Ray
https://aviary.anyscale.com
Apache License 2.0
1.2k stars 87 forks source link

[BUG] Docker -- anyscale/ray-llm:latest is essentially 0.3.0 #122

Closed JGSweets closed 6 months ago

JGSweets commented 6 months ago

When trying to run the docker image remotely on AWS, the Mixtral models fails to deploy due to the image being out of date with respect to the repository cluster config using latest as opposed to the tag.

https://hub.docker.com/r/anyscale/ray-llm/tags https://github.com/ray-project/ray-llm/blob/v0.5.0/deploy/ray/rayllm-cluster.yaml#L10

sihanwang41 commented 6 months ago

Hi @JGSweets , thank for raising the issue! I have already updated the latest image.