substratusai / lingo

Lightweight ML model proxy and autoscaler for kubernetes
https://www.substratus.ai
Apache License 2.0
102 stars 6 forks source link

WIP add batch inference test #29

Closed samos123 closed 7 months ago

samos123 commented 7 months ago

Closing this since I moved this to batchelor repo https://github.com/substratusai/batchelor