substratusai / lingo

Lightweight ML model proxy and autoscaler for kubernetes
https://www.substratus.ai
Apache License 2.0
96 stars 6 forks source link

Fix scale back to 0 with 300 requests scenario #76

Closed samos123 closed 5 months ago

samos123 commented 5 months ago

Fixes #73 and includes pr #70 and others from Alex

Co-author: @alpe