DevOps: migrate database to Postgres Operator - Metabase

pbastia commented 5 months ago

As a developer, I want to use the Postgres Operator database on the cluster, So I can use its latest features

Devise a migration process from the current spilo/patroni instance to the postgres operator
Document said process thoroughly (it will be reused)
Script said process, and test it as much as possible
Execute the migration in the -dev environment

Suggested steps:

spin up a crunchydb postgres instance using the operator
take down the application pods
take a pg_dump of the database
pg_restore to the new crunchy instance
ensure backups are being properly saved & data is up to date
update any secrets in the deployment that may have changed with the creation of the new cluster
restart application pods

pbastia commented 5 months ago

@dleard @TimCsaky this is our working ticket, it was mentioned you were interested ;) we'll let you know when we start work on it

pbastia commented 4 months ago

patriciarussellCAS commented 4 months ago

Will need similar tickets for CIIP, GGIRCS, Airflow, others? (shipit?)

pbastia commented 3 months ago

@TimCsaky We have a working solution in this chart https://github.com/bcgov/cas-postgres/tree/develop/helm/patroni-migration assuming you have a PGO instance to migrate to already. Let me know if you want to talk about it!

patriciarussellCAS commented 2 months ago

Next step: Push to test. Test it, then push to prod.

patriciarussellCAS commented 2 months ago

Think we can get this done next week before end of sprint?

patriciarussellCAS commented 1 month ago

@pbastia found it!!

patriciarussellCAS commented 1 month ago

Adding this to Sprint 20 so it doesn't get lost.

bcgov / cas-metabase