search

substratusai / lingo

Lightweight ML model proxy and autoscaler for kubernetes
https://www.substratus.ai
Apache License 2.0
102 stars 6 forks source link

Scale back to 0 and then scale up not working #25

Closed samos123 closed 8 months ago

samos123 commented 8 months ago

Steps to reproduce:

  1. Scale from 0 to 1
  2. Wait for Scale from 1 to 0 to finish (pod gets deleted)
  3. Send request Scale from 0 to 1

Current result: Request from step 3 never gets sent to the pod that was scaled up