search

grafana / rollout-operator

Kubernetes Rollout Operator
Apache License 2.0
130 stars 17 forks source link

Support for delay between call to prepare-downscale and actual downscale. #119

Closed pstibrany closed 7 months ago

pstibrany commented 7 months ago

We plan to run new ingesters with delay between prepare-downscale and actual downscale. During this delay, ingesters will keep running, but will not receive any new data.

Timestamp of prepare-downscale call is recorded as Pod annotation.

After delay elapses (checked as max recorded timestamp in pod annotations), rollout operator's admission controller allows final downscale.

User can cancel the downscale during this delay, and scale up again. In that case rollout operator can be configured to call DELETE on prepare-downscale endpoint.

(draft, doing manual testing)

pstibrany commented 7 months ago

Closing this in favor of resource mirroring + delayed scaledown in controller.