search

bentoml / BentoVLLM

Self-host LLMs with vLLM and BentoML
73 stars 12 forks source link

Add support for llama 3.1 #58

Closed rickzx closed 3 months ago