EBS CSI EKS support

[nickumia-reisys]

Related to https://github.com/GSA/datagov-deploy/issues/3127

Changes:

• Update Fairwinds VPC module to AWS VPC Module
• Update AWS Provider from 3.61.0 to 3.73.0
• Update Kubernetes Provider from 2.5 to 2.7.1
• Update Helm Provider from 2.3 to 2.4

New Additions:

• Provision EFS Volume alongside EKS cluster
• Setup security group for EFS Volume
• Mount EFS Volume to all private subnets in EKS cluster
  • No matter where a fargate node gets launched, it will have access to the EFS Volume
• Attach EFS Policy to Fargate profile to interact with EFS Volume
• EFS Volume Read/Write Test pulled from aws-efs-csi-driver repo

[nickumia-reisys]

Instructions on setting up EBS CSI Plugin: https://docs.aws.amazon.com/eks/latest/userguide/managing-ebs-csi.html

[nickumia-reisys]

@mogul We need to enable encryption for the EFS volume. We can't merge this yet!

[nickumia-reisys]

Commenting for reference, https://docs.aws.amazon.com/vpc/latest/userguide/amazon-vpc-limits.html

[nickumia-reisys]

Ughh... I think there are a couple of problems with the tests.. Fargate has the EFS driver installed by default, KiND does not.. Real EKS has the current kubernetes configs applied, KiND does not... Will fix in the morning.

[mogul]

Ughh... I think there are a couple of problems with the tests.. Fargate has the EFS driver installed by default, KiND does not.. Real EKS has the current kubernetes configs applied, KiND does not... Will fix in the morning.

The solr-operator doesn't care how PVs are implemented, only that they are available to make PVCs! So we don't need to set up EFS in KinD, we just need to set up KinD to have a local PV back-end and storageClass of its own available. This is how we do it.

[mogul]

A more in-depth example of implementing PVs in KinD, if we need to go any further than the SO answer linked above...

[nickumia-reisys]

Yay!! 🎈