search

bentoml / BentoVLLM

Self-host LLMs with vLLM and BentoML
73 stars 12 forks source link

feat: add jamba-1.5-mini fp16 bento #90

Closed larme closed 1 week ago