bentoml / OpenLLM

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.
https://bentoml.com
Apache License 2.0
9.4k stars 597 forks source link

feat(models): command-r #1005

Closed aarnphm closed 1 month ago

aarnphm commented 1 month ago