search

ray-project / ray-llm

RayLLM - LLMs on Ray
https://aviary.anyscale.com
Apache License 2.0
1.22k stars 87 forks source link

Anyscale Image #78

Open harsh-goglocal opened 10 months ago

harsh-goglocal commented 10 months ago

In the aviary cluster yaml file , image used is anyscale/aviary:test should it be changed to anyscale/ray-llm:latest

# An unique identifier for the head node and workers of this cluster.
cluster_name: aviary-deploy

# Cloud-provider specific configuration.
provider:
    type: aws
    region: us-west-2
    cache_stopped_nodes: False
docker:
    image: "anyscale/aviary:test"            #### --
    image: "anyscale/ray-llm:latest"            #### ++
    container_name: "aviary"
    run_options:
      - --entrypoint ""
harsh-goglocal commented 10 months ago

Hi @Yard1 ,

Could you tell if we should change the docker image to ray-llm? If yes then let's make a change in the readme as well

akshay-anyscale commented 10 months ago

hi @harsh-goglocal are you referring to this file - https://github.com/ray-project/ray-llm/blob/master/deploy/ray/rayllm-cluster.yaml ? It has been updated to reflect the new docker image