chore(qol): update CLI options and performance upgrade for build cache

bentoml / OpenLLM

Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.

https://bentoml.com

Apache License 2.0

10.12k stars 641 forks source link

Closed aarnphm closed 6 months ago

aarnphm commented 6 months ago