ray-project / ray-llm

RayLLM - LLMs on Ray
https://aviary.anyscale.com
Apache License 2.0
1.22k stars 87 forks source link

Create serve configs to deploy LLMs to production #54

Closed shrekris-anyscale closed 11 months ago

shrekris-anyscale commented 11 months ago

This change adds Serve configs that can be used to deploy Aviary models to production.