Spike: Add optional retry middleware

substratusai / lingo

Lightweight ML model proxy and autoscaler for kubernetes

https://www.substratus.ai

Apache License 2.0

102 stars 6 forks source link

Closed alpe closed 5 months ago

alpe commented 6 months ago

Resolves #48

the implementation is based on 2 elements:

not considered is a priority queue for retries

alpe commented 5 months ago

Closing this now in favour of #61