ebi-ait / hca-ebi-dev-team

Repository for hca ebi dev team agile management. See zenhub board
0 stars 0 forks source link

Update GCP service account key for prod Terra bucket access #478

Closed aaclan-ebi closed 2 years ago

aaclan-ebi commented 2 years ago

https://embl-ebi-ait.slack.com/archives/C01360XN04S/p1646834360690409

Tasks:

  1. Update secret in aws
  2. Redeploy secrets
  3. Redeploy exporter in prod
aaclan-ebi commented 2 years ago

For SOP:

  1. Go to ingest-kube-deployment local repository
    cd ingest-kube-deployment
  2. Initialise environment vars config
    source config/environment_prod
  3. Go to apps
    cd apps
  4. Redeploy secrets
    make deploy-secrets

    sample output:

    /Library/Developer/CommandLineTools/usr/bin/make set-context
    kubectx ingest-eks-prod
    Switched to context "ingest-eks-prod".
    kubens prod-environment
    Context "ingest-eks-prod" modified.
    Active namespace is "prod-environment".
    ./scripts/deploy_secrets
    Release "secrets" has been upgraded. Happy Helming!
    NAME: secrets
    LAST DEPLOYED: Thu Mar 10 16:08:22 2022
    NAMESPACE: prod-environment
    STATUS: deployed
    REVISION: 20
    TEST SUITE: None
    NOTES:
    Ingest secrets powered by helm charts
  5. Restart exporter.
    kubectl rollout restart deployment ingest-exporter

    sample output:

    deployment.apps/ingest-exporter restarted
  6. Run integration tests in prod (The ingest-to terra test doesn't run in prod, but it would be nice to run it and be able to delete any test project ) See ticket ebi-ait/dcp-ingest-central#699
Wkt8 commented 2 years ago

Secrets appear to be working in production - which fixed a submission which was stuck in re-exporting.

amnonkhen commented 4 months ago

sop in onboarding: https://ebi-ait.github.io/hca-ebi-dev-team/operations_tasks/update-exporter-gcp-creds.html