Evaluate new EKS clusters

[glogiotatidis]

I'm going to setup Shynet to understand and evaluate the new EKS based cluster that @duallain created.

This issue holds all the information related to this project.

Repository: https://github.com/mozmeao/shynet Kubernetes Templates: https://github.com/mozmeao/shynet/tree/master/kubernetes Instance URL: https://analytics.moz.works Login Details: In 1password

All resources were created and managed using k8s templates except for the manually created:

• ACM cert for analytics.moz.works
• Route53 route analytics.moz.works

Current setup:

• shynet namespace in frankfurt EKS
• Runs
  • shynet webserver and celeryworker
  • redis StatefulSet
  • postgres StatefulSet linked with a 10Gb EBS volume for persistent storage
  • sevices for the above

EKS eval:

• Connecting to the cluster was very streamlined as long as you're connected to our ZT and using maws following the instructions
• It's very easy to setup using k8s templates:
  • A new namespace
  • Setup secrets
  • Django and celeryworker using the provided templates from shynet project (altered names and docker image version)
  • Redis
  • Postgres with permanent storage on EBS volume
  • ELB with HTTPS configuration
• Outside k8s templates I manually configured route53 and generated the ACM cert.

Overall this was uneventful and the best k8s experience I had so far. I feel we can move fwd with this platform. Thanks for working on this @duallain

[glogiotatidis]

Setting up a reminder to remove everything when we're done

/remind me in a month

[reminders[bot]]

@glogiotatidis set a reminder for Aug 30th 2020

[glogiotatidis]

We've now moved to EKS!