substratusai / lingo

Lightweight ML model proxy and autoscaler for kubernetes
https://www.substratus.ai
Apache License 2.0
102 stars 6 forks source link

add ability to configure scale down delay #33

Closed samos123 closed 7 months ago

samos123 commented 7 months ago

Also allows setting concurrency through environment variable so a configmap can be easily used in K8s

Fixes #32