add option to kill later

michaelfeil / infinity

Infinity is a high-throughput, low-latency REST API for serving text-embeddings, reranking models and clip

https://michaelfeil.github.io/infinity/

MIT License

1.31k stars 96 forks source link

Closed michaelfeil closed 3 months ago