substratusai / lingo

Lightweight ML model proxy and autoscaler for kubernetes
https://www.substratus.ai
Apache License 2.0
96 stars 6 forks source link

Configuration options for hardcoded values #111

Closed nstogner closed 4 days ago

nstogner commented 4 days ago

For time window calc see: https://go.dev/play/p/b2GdRzMJPUb

nstogner commented 4 days ago

Fixes #109

nstogner commented 4 days ago

Fixes #108

samos123 commented 4 days ago

Is setting MESSENGER_ERROR_MAX_BACKOFF=0s the same as turning of the backoff? Would that work?

nstogner commented 4 days ago

Yep, that should disable