What cluster configuration do I need to deploy Aviary?

[amogkam]

How do I know how many GPUs, memory, etc. I need in my Ray cluster to deploy Aviary? Or will it work regardless of what resources I have?

[Yard1]

You can view the default configuration in https://github.com/ray-project/aviary/blob/master/deploy/ray/aviary-cluster.yaml

[amogkam]

Got it. How about for each model in particular? Like for model X I need this instance type?

[Yard1]

The instance types per model are defined using Ray custom resources - see https://github.com/ray-project/aviary/blob/master/models/README.md for more details

[amogkam]

got it, thanks!