fix: make sure to respect additional parameters parse

bentoml / OpenLLM

Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.

https://bentoml.com

Apache License 2.0

10.11k stars 640 forks source link

Closed aarnphm closed 6 months ago

aarnphm commented 6 months ago