MountaintopLotus / braintrust

A Dockerized platform for running Stable Diffusion, on AWS (for now)
Apache License 2.0
1 stars 2 forks source link

ECR for Stable Dock images #67

Open JohnTigue opened 1 year ago

JohnTigue commented 1 year ago

There are some ECR Issues in the dev_tools repo (e.g., https://github.com/ManyHands/dev_tools/issues/152). This issue is specific to hypnowerk. We are probably going to have a whole bunch of Docker images in ECR for use in hypnowerk.

JohnTigue commented 1 year ago

First thing for exercising ECR would be to build and push the repo I've been working with for that last week or so see: https://github.com/ManyHands/hypnowerk/issues/47

JohnTigue commented 1 year ago

So, we want to have in ECR this repo from last week which is currently running in EC2 for us:

Previously I just spun this up manually (no ECR):

$ git clone https://github.com/AbdBarho/stable-diffusion-webui-docker.git
$ cd stable-diffusion-webui-docker
$ docker compose --profile download up --build
$ docker compose --profile invoke up --build
JohnTigue commented 1 year ago

One thing we definitely want is a base image. E.g., something which has the latest Docker tooling installed. Just that is getting from Step Zero to Step One. And after that things might branch in different directions. But simply have Docker Compose v2 "pre-installed" would be a nice start. And there will be other things we'll want in The Base Image.

JohnTigue commented 1 year ago

And if we're talking about a base image then should be a bit paranoid and not use the convenience scripts which curl from da interwebz. I.e., don't https://docs.docker.com/engine/install/ubuntu/#install-using-the-convenience-script

JohnTigue commented 1 year ago

I guess uninstall first is a good idea: https://docs.docker.com/engine/install/ubuntu/#uninstall-old-versions. They do warn about installing on an already installed.

JohnTigue commented 1 year ago

The place where we'll park all our hypnowerk images in ECR is: hypnowerk repo in ECR(us-west-2).

JohnTigue commented 1 year ago

On public ECR, AWS has Canonical's lts/ubuntu. If building from stock Ubuntu, that's probably a good place to start FROM in Dockerfile.

JohnTigue commented 1 year ago

Nvidia has an AMI they publish on AWS which has their drivers and other optimizations for running on AWS, on multiple OSes including Amazon Linux 2 and Ubuntu: "NVIDIA RTX Virtual Workstation - Amazon Linux 2": nvOffer-vgpu15.1-nv-amazon-linux-2-vWS-525.85.05-v202301200638-77bcb2ad-5bc4-4c98-bd7f-e157c3beeaef ami-0d46747a755864eed

So, let's give that a shot for TakeSix.

Screen Shot 2023-02-04 at 8 07 06 PM