oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.
GNU Affero General Public License v3.0
38.21k stars 5.08k forks source link

Docker Install - Launching the image - Potential command update required #5990

Open JonathanTurunen opened 1 month ago

JonathanTurunen commented 1 month ago

Describe the bug

I checked #5679 but it doesn't seem related to this since it's about the cpu build.

I believe the line in "Use these commands to launch the image" at https://github.com/oobabooga/text-generation-webui/wiki/09-%E2%80%90-Docker should be changed as per the below.

From:

ln -s docker/{nvidia/Dockerfile,docker-compose.yml,.dockerignore} .

To:

ln -s docker/{nvidia/Dockerfile,nvidia/docker-compose.yml,.dockerignore} .

The other two files are correctly linked but, unti l ran the latter command, the docker-compose.yml link was pointing at a nonexistent file.

Apologies if I've missed something, this is my first issue.

Is there an existing issue for this?

Reproduction

Run commands:

cd text-generation-webui
ln -s docker/{nvidia/Dockerfile,docker-compose.yml,.dockerignore} .
cp docker/.env.example .env
# Edit .env and set TORCH_CUDA_ARCH_LIST based on your GPU model
docker compose up --build

There will be an error since docker-compose.yml is found at nvidia/docker-compose.yml. Changing it to this should work:

cd text-generation-webui
ln -s docker/{nvidia/Dockerfile,nvidia/docker-compose.yml,.dockerignore} .
cp docker/.env.example .env
# Edit .env and set TORCH_CUDA_ARCH_LIST based on your GPU model
docker compose up --build

Screenshot

No response

Logs

N/A

System Info

N/A
romonwafa commented 3 weeks ago

Thank you. Initially, following the instructions provided in the repo wasn't working for me and I almost gave up until I saw this and it worked.

JonathanTurunen commented 3 weeks ago

Thanks for saying so, I wasn't sure if I'd missed something else myself. Glad to hear it worked for someone else!