search

bentoml / BentoVLLM

Self-host LLMs with vLLM and BentoML
73 stars 12 forks source link

fix: accurate num_gpus for jamba-1.5-mini #91

Closed larme closed 1 week ago