Decide which way to deploy SD Docker images on AWS

[JohnTigue]

There are multiple ways to deploy Docker containers on AWS. Which one should we use?

• [X] Lightsail: no GPUs
• [X] EKS: full power Kubernetes but needs to be run/managed/fed by trained workers
• [ ] #58 58: Goldilocks: GPUs but we don't have to manage the control plane

[JohnTigue]

AWS Blog, 2022-12 seems still no GPUs on Serverless AWS so need to stick to some EC2 based service (maybe EKS, maybe raw EC2?):

Many of the services selected are serverless, which will offer many benefits. At the time of writing, Stable Diffusion requires a GPU for inference. Amazon Elastic Compute Cloud (Amazon EC2) was selected because it provides GPUs.

[JohnTigue]

And this gets back to that ECR rigmarole I went through in 2022. There's some pretty simple, boilerplate aws-cli command sequence to build an image and publish it in a private registry on ECR. We already have a registry set up. See the closed issues in dev_tools:

• https://github.com/ManyHands/dev_tools/issues/26
• https://github.com/ManyHands/dev_tools/issues/84
• https://github.com/ManyHands/dev_tools/issues/88

[JohnTigue]

Going with ECS over EKS because the former automates the "undifferentiated heavy lifting" of the latter, which requires a trained Kubernetes team which we do not have. See Amazon ECS vs Amazon EKS: making sense of AWS container services