bentoml / BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
https://bentoml.com
Apache License 2.0
7.18k stars 793 forks source link

fix: circus graceful shutdown #5024

Closed bojiang closed 1 month ago