fix: make sure to respect additional parameters parse

bentoml / OpenLLM

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.

https://bentoml.com

Apache License 2.0

9.7k stars 616 forks source link

Closed aarnphm closed 4 months ago

aarnphm commented 4 months ago