Deploy test ephermal cluster - Githubissues

department-of-veterans-affairs / va.gov-team

Public resources for building on and in support of VA.gov. Visit complete Knowledge Hub:

https://depo-platform-documentation.scrollhelp.site/index.html

282 stars 203 forks source link

Deploy test ephermal cluster #64016

Closed ericboehs closed 1 year ago

ericboehs commented 1 year ago

### Tasks
- [ ] Modify existing terraform to spin up new ephemeral cluster
- [ ] Deploy Vets API stack/helm chart
- [ ] Deploy Vets Website to cluster
- [ ] Determine how the shared s3 bucket works

ben-allen-oddball commented 1 year ago

vanilla cluster Ingress works with new VPC.
existing Dev VPC tier lacks the required tags (solved)
existing Dev VPC lacks external accessable subnets
- Workaround is to annotate the service to internal, however this does not expose the service to the world.

End of Day notes:

Create a review environment VPC with subnets.
- Name must match pattern: dsva-vagov-review-vpc
Create a new tier in platform distro for review
Deploy test cluster in review tier
Deploy Ingress Controller to review Tier
Document

ben-allen-oddball commented 1 year ago

Created Cluster Deploy Instructions: https://github.com/department-of-veterans-affairs/prt-tf-preview-clusters/tree/WIP

Created Repo Deployment Terraform: https://github.com/department-of-veterans-affairs/prt-tf-repos/tree/WIP

Created Terraform State Management for PRT: https://github.com/department-of-veterans-affairs/prt-tf-state

ben-allen-oddball commented 1 year ago

Added github action pipelines which auto plan on tf-state and tf-repos.

ben-allen-oddball commented 1 year ago

ToDo:

Add AWS_ASSUME_ROLE vars to action pipeline
Setup auto Apply on merge to main
Setup semantic versioning
Add users to a cluster

ben-allen-oddball commented 1 year ago

hand jammed http://vagov-next-ben-cluster.vfs.va.gov:9999/ in. Need to add to the ALB deploy. https://kubernetes-sigs.github.io/aws-load-balancer-controller/v2.6/guide/integrations/external_dns/

Added PoC for matrix of environments for Github action support of multiple TF workspaces. https://github.com/department-of-veterans-affairs/prt-tf-preview-clusters/blob/WIP/.github/workflows/tf-plan-pr..yml#L7-L12

ben-allen-oddball commented 1 year ago

Future for dynamic matrix https://www.jacobbolda.com/dynamic-matrix-jobs-in-github-actions

ben-allen-oddball commented 1 year ago

Need to add default tags.
Need to setup mirror (as github action) of public.ecr.aws/eks/aws-load-balancer-controller:vx.x.x to Gov Cloud.

ben-allen-oddball commented 1 year ago

Add default tags to all TF repos.