fixes cluster yaml to use the correct resource attribute naming

ray-project / ray-llm

RayLLM - LLMs on Ray

https://aviary.anyscale.com

Apache License 2.0

1.22k stars 87 forks source link

Closed JGSweets closed 10 months ago

JGSweets commented 11 months ago

Currently, the deployment cluster yaml specifies accelerator_type_a10_40g and accelerator_type_a10_80g .

However, these resources utilize A100s. This Pr simply updates the naming which is matched in the model deployment configs as well.

JGSweets commented 10 months ago

Looks fixed in the newest config.