search

ministryofjustice / modernisation-platform

A place for the core work of the Modernisation Platform • This repository is defined and managed in Terraform
https://user-guide.modernisation-platform.service.justice.gov.uk
MIT License
681 stars 290 forks source link

Performance hub development legacy migration. #5214

Open ep-93 opened 1 year ago

ep-93 commented 1 year ago

User Story

As a MP Engineer & Performance Hub Engineer I want to move our only remaining environment from legacy AWS accounts to Mod Platform So that our pipeline is slick, our terraform is deployed via namespaces an in a tidy ci cd dpeloyment pipeline. No old terraform manual applies to old accounts, with different connectivity.

Even better if

As a MP Engineer & Performance Hub Engineer I need to move our only remaining environment from legacy AWS accounts to Mod Platform So that or pipeline conforms to XXXX and is the latest agreed version of MP pipeline that ensures XXXXX

Already have.

Useful Contacts

Jeremy Collins

Additional Information

The old account is pretty straightforward in terms of resources. There is..

S3 User generated content in a bucket, used during development. The equivalent bucket already exists in our MP environments, Jeremy is using the cicduser to migrate files from the legacy account to MP dev via cli.

A bucket used for data exchange with the AP. This bucket doesn't exist in MP envs yet, however I have linked Jeremy to our s3 module to help.

IAM There are 2 sets of users / roles / polices for writing to AP buckets / reading from our landing bucket. Jeremy needs to create these resources in MP, then needs to work with AP team to change their pipelines to write to the new S3 bucket in prod

RDS Jeremy needs to create the RDS instance in the dev environment on MP.

Once that's done we need to help to restore a snapshot cross-account.

Definition of Done

Tasks

ep-93 commented 11 months ago

@SimonPPledger Did you ever get an update on this?

ep-93 commented 9 months ago

Waiting on @jemnery

SimonPPledger commented 9 months ago

from Jeremy "Edd was really helpful, thanks. He couldn't see any issues with my setup, which led the investigation to the Analytical Platform side of this problem. It looks like it was a change their end causing the issue, so I don't think we'll need Edd for the next sprint."

ep-93 commented 1 week ago

Update

Really well, thanks to the leg up you gave us. Some more mucking about with snapshots and KMS keys, but the the DB in a good place, and as of yesterday we've switched to using the new MP instance. I've done a TF apply to check dev is all aligned. I'm going to leave the old RDS running for maybe a week, in case I've missed something. Then I'll take it down and we can get the old account closed.

ep-93 commented 1 week ago

Happy for this to be deleted from the 2nd of Dec