SkunkworksAI / hydra-moe

410 stars 15 forks source link

Add docker quickstart #6

Closed fearnworks closed 1 year ago

fearnworks commented 1 year ago
fearnworks commented 1 year ago

Next item I am looking at here is to set up some way to persist model downloads across runs. I've used a mounted volume solution in the past for this with docker compose. That should cut down consecutive sessions with the container down significantly.

lpietrobon commented 1 year ago

@fearnworks is this to replace the sh setup_moe.sh setup currently suggested in the README?

fearnworks commented 1 year ago

@fearnworks is this to replace the sh setup_moe.sh setup currently suggested in the README?

This is an additional option to run the project inside of a container instead of directly in your local environment. It actually utilizes the setup_moe.sh as part of its image build process.

fearnworks commented 1 year ago

I am likely going to close this pull, I have extended this to include docker compose and the webui cli option in the ui branch.