substratusai / lingo

Lightweight ML model proxy and autoscaler for kubernetes
https://www.substratus.ai
Apache License 2.0
102 stars 6 forks source link

Spike: Configurable concurrency #52

Open alpe opened 6 months ago

alpe commented 6 months ago

🚧 Spike - early version for feedback

Resolves substratusai#12