search

ray-project / ray-llm

RayLLM - LLMs on Ray
https://aviary.anyscale.com
Apache License 2.0
1.22k stars 87 forks source link

Support for multi-modal models #97

Open richardliaw opened 9 months ago

richardliaw commented 9 months ago

It'd be great to host Llava or an equivalent model on this project, with an OpenAI-compatible API.