search

bentoml / BentoVLLM

Self-host LLMs with vLLM and BentoML
73 stars 12 forks source link

vLLM already supports openai, why use bentovllm_openai? #88

Open frei-x opened 2 weeks ago

frei-x commented 2 weeks ago

I just have some doubts, thanks for your work.