neondatabase / autoscaling

Postgres vertical autoscaling in k8s
Apache License 2.0
163 stars 21 forks source link

Epic: Productionize automated live migration #834

Open sharnoff opened 8 months ago

sharnoff commented 8 months ago

Motivation

As a follow-up to solid manual migration (ref #832), we'd like to perform rebalancing automatically to reduce costs and provide better stability when faced with potential noisy neighbors.

There are daily and weekly fluctuations in load that mean sufficiently advanced migration (e.g., in order to allow removing nodes when there's extra resources) unlock significant potential cost savings beyond the "normal" right-sizing.

DoD

Automated live migration is stable and adequately reduces COGS while improving stability.

Implementation ideas

Basic implementation has been present for a long time; the individual tasks are "just" polishing it up.

Tasks

- [ ] #581
- [ ] #756

Other related tasks, Epics, and links