search

oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.
GNU Affero General Public License v3.0
40.61k stars 5.31k forks source link

Building Docker Image Taking Forever - Hung on pip Dependency Resolution? #6476

Closed practical-dreamer closed 3 weeks ago

practical-dreamer commented 3 weeks ago

Describe the bug

Objective:

Having trouble building docker image from 'Alternative: Docker' section of README.md. - hoping some chad out there will help me figure why it's hanging.

Issue:

After half an hour docker compose is still running (see my logs) - doesn't seem normal when pip install -r requirements takes under 2 minutes in a fresh conda env.

Observation:

According to stdout from docker compose up --build it seems I'm downloading MULTIPLE versions of packages which does not occur when running pip install -r requirements from a conda env.

Here's a small sample (see the logs section for the complete output)

#11 1173.8 Collecting tokenizers!=0.11.3,<0.14,>=0.11.1 (from transformers>=4.33.0->TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 1173.8   Downloading tokenizers-0.13.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB)
#11 1192.1 Collecting transformers>=4.33.0 (from TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 1192.1   Downloading transformers-4.33.2-py3-none-any.whl.metadata (119 kB)
#11 1210.4   Downloading transformers-4.33.1-py3-none-any.whl.metadata (119 kB)
#11 1228.8   Downloading transformers-4.33.0-py3-none-any.whl.metadata (119 kB)
#11 1247.4 Collecting spacy[ja]>=3 (from TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 1247.4   Using cached spacy-3.8.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (27 kB)
#11 1977.8   Downloading spacy-3.7.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (27 kB)
#11 1977.8 INFO: pip is looking at multiple versions of spacy[ja] to determine which version is compatible with other requirements. This could take a while.
#11 1977.9   Downloading spacy-3.7.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (27 kB)
#11 1977.9   Downloading spacy-3.7.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)

Is there an existing issue for this?

Reproduction

curl -fsSL https://get.docker.com -o get-docker.sh sudo sh get-docker.sh sudo usermod -aG docker $USER

ln -s docker/{nvidia/Dockerfile,nvidia/docker-compose.yml,.dockerignore} . cp docker/.env.example .env mkdir -p logs cache docker compose up --build | tee docker_output.log

Screenshot

image

Logs

user@hostname:~/REPOS/text-generation-webui$ cat docker_output.log
#0 building with "default" instance using docker driver

#1 [text-generation-webui internal] load build definition from Dockerfile
#1 transferring dockerfile: 1.20kB done
#1 DONE 0.0s

#2 [text-generation-webui internal] load metadata for docker.io/library/ubuntu:22.04
#2 DONE 0.8s

#3 [text-generation-webui internal] load .dockerignore
#3 transferring context: 204B done
#3 DONE 0.0s

#4 [text-generation-webui stage-0 1/9] FROM docker.io/library/ubuntu:22.04@sha256:58b87898e82351c6cf9cf5b9f3c20257bb9e2dcf33af051e12ce532d7f94e3fe
#4 DONE 0.0s

#5 [text-generation-webui stage-0 2/9] WORKDIR /builder
#5 CACHED

#6 [text-generation-webui stage-0 3/9] RUN --mount=type=cache,target=/var/cache/apt,sharing=locked,rw     apt update &&     apt install --no-install-recommends -y git vim build-essential python3-dev pip bash curl &&     rm -rf /var/lib/apt/lists/*
#6 CACHED

#7 [text-generation-webui stage-0 4/9] WORKDIR /home/app/
#7 CACHED

#8 [text-generation-webui stage-0 5/9] RUN git clone https://github.com/oobabooga/text-generation-webui.git
#8 CACHED

#9 [text-generation-webui stage-0 6/9] WORKDIR /home/app/text-generation-webui
#9 CACHED

#10 [text-generation-webui internal] load build context
#10 transferring context: 34B done
#10 DONE 0.0s

#11 [text-generation-webui stage-0 7/9] RUN GPU_CHOICE=A USE_CUDA118=FALSE LAUNCH_AFTER_INSTALL=FALSE INSTALL_EXTENSIONS=TRUE ./start_linux.sh --verbose
#11 0.191 Downloading Miniconda from https://repo.anaconda.com/miniconda/Miniconda3-py310_23.3.1-0-Linux-x86_64.sh to /home/app/text-generation-webui/installer_files/miniconda_installer.sh
#11 0.195   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
#11 0.195                                  Dload  Upload   Total   Spent    Left  Speed
100 69.7M  100 69.7M    0     0  50.8M      0  0:00:01  0:00:01 --:--:-- 50.8M
#11 1.571 PREFIX=/home/app/text-generation-webui/installer_files/conda
#11 1.707 Unpacking payload ...

#11 3.320 Installing base environment...
#11 3.320 
#11 3.693 
#11 3.693 Downloading and Extracting Packages
#11 3.693 
#11 3.693 
#11 3.693 Downloading and Extracting Packages
#11 3.693 
#11 3.693 Preparing transaction: ...working... done
#11 4.012 Executing transaction: ...working... done
#11 5.430 installation finished.
#11 5.430 Miniconda version:
#11 5.695 conda 23.3.1
#11 6.008 Collecting package metadata (current_repodata.json): ...working... done
#11 9.310 Solving environment: ...working... done
#11 9.378 
#11 9.378 
#11 9.378 ==> WARNING: A newer version of conda exists. <==
#11 9.378   current version: 23.3.1
#11 9.378   latest version: 24.9.2
#11 9.378 
#11 9.378 Please update conda by running
#11 9.378 
#11 9.378     $ conda update -n base -c defaults conda
#11 9.378 
#11 9.378 Or to minimize the number of packages updated during conda update use
#11 9.378 
#11 9.378      conda install conda=24.9.2
#11 9.378 
#11 9.378 
#11 9.393 
#11 9.393 ## Package Plan ##
#11 9.393 
#11 9.393   environment location: /home/app/text-generation-webui/installer_files/env
#11 9.393 
#11 9.393   added / updated specs:
#11 9.393     - python=3.11
#11 9.393 
#11 9.393 
#11 9.393 The following packages will be downloaded:
#11 9.393 
#11 9.393     package                    |            build
#11 9.393     ---------------------------|-----------------
#11 9.393     bzip2-1.0.8                |       h5eee18b_6         262 KB
#11 9.393     ca-certificates-2024.9.24  |       h06a4308_0         130 KB
#11 9.393     ld_impl_linux-64-2.40      |       h12ee557_0         710 KB
#11 9.393     libffi-3.4.4               |       h6a678d5_1         141 KB
#11 9.393     openssl-3.0.15             |       h5eee18b_0         5.2 MB
#11 9.393     pip-24.2                   |  py311h06a4308_0         2.8 MB
#11 9.393     python-3.11.10             |       he870216_0        32.9 MB
#11 9.393     setuptools-75.1.0          |  py311h06a4308_0         2.2 MB
#11 9.393     sqlite-3.45.3              |       h5eee18b_0         1.2 MB
#11 9.393     tk-8.6.14                  |       h39e8969_0         3.4 MB
#11 9.393     tzdata-2024b               |       h04d1e81_0         115 KB
#11 9.393     wheel-0.44.0               |  py311h06a4308_0         145 KB
#11 9.393     xz-5.4.6                   |       h5eee18b_1         643 KB
#11 9.393     zlib-1.2.13                |       h5eee18b_1         111 KB
#11 9.393     ------------------------------------------------------------
#11 9.393                                            Total:        50.0 MB
#11 9.393 
#11 9.393 The following NEW packages will be INSTALLED:
#11 9.393 
#11 9.393   _libgcc_mutex      pkgs/main/linux-64::_libgcc_mutex-0.1-main 
#11 9.393   _openmp_mutex      pkgs/main/linux-64::_openmp_mutex-5.1-1_gnu 
#11 9.393   bzip2              pkgs/main/linux-64::bzip2-1.0.8-h5eee18b_6 
#11 9.393   ca-certificates    pkgs/main/linux-64::ca-certificates-2024.9.24-h06a4308_0 
#11 9.393   ld_impl_linux-64   pkgs/main/linux-64::ld_impl_linux-64-2.40-h12ee557_0 
#11 9.393   libffi             pkgs/main/linux-64::libffi-3.4.4-h6a678d5_1 
#11 9.393   libgcc-ng          pkgs/main/linux-64::libgcc-ng-11.2.0-h1234567_1 
#11 9.393   libgomp            pkgs/main/linux-64::libgomp-11.2.0-h1234567_1 
#11 9.393   libstdcxx-ng       pkgs/main/linux-64::libstdcxx-ng-11.2.0-h1234567_1 
#11 9.393   libuuid            pkgs/main/linux-64::libuuid-1.41.5-h5eee18b_0 
#11 9.393   ncurses            pkgs/main/linux-64::ncurses-6.4-h6a678d5_0 
#11 9.393   openssl            pkgs/main/linux-64::openssl-3.0.15-h5eee18b_0 
#11 9.393   pip                pkgs/main/linux-64::pip-24.2-py311h06a4308_0 
#11 9.393   python             pkgs/main/linux-64::python-3.11.10-he870216_0 
#11 9.393   readline           pkgs/main/linux-64::readline-8.2-h5eee18b_0 
#11 9.393   setuptools         pkgs/main/linux-64::setuptools-75.1.0-py311h06a4308_0 
#11 9.393   sqlite             pkgs/main/linux-64::sqlite-3.45.3-h5eee18b_0 
#11 9.393   tk                 pkgs/main/linux-64::tk-8.6.14-h39e8969_0 
#11 9.393   tzdata             pkgs/main/noarch::tzdata-2024b-h04d1e81_0 
#11 9.393   wheel              pkgs/main/linux-64::wheel-0.44.0-py311h06a4308_0 
#11 9.393   xz                 pkgs/main/linux-64::xz-5.4.6-h5eee18b_1 
#11 9.393   zlib               pkgs/main/linux-64::zlib-1.2.13-h5eee18b_1 
#11 9.393 
#11 9.393 
#11 9.393 
#11 9.393 Downloading and Extracting Packages

#11 11.30 Preparing transaction: ...working... done  
#11 11.55 Verifying transaction: ...working... done  
#11 12.69 Executing transaction: ...working... done  
#11 13.58 #                                          
#11 13.58 # To activate this environment, use        
#11 13.58 #                                          
#11 13.58 #     $ conda activate /home/app/text-generation-webui/installer_files/env
#11 13.58 #                                          
#11 13.58 # To deactivate an active environment, use 
#11 13.58 #                                          
#11 13.58 #     $ conda deactivate                   
#11 13.58                                            
#11 15.05 Collecting package metadata (current_repodata.json): ...working... done
#11 17.39 Solving environment: ...working... done
#11 17.65 
#11 17.65 
#11 17.65 ==> WARNING: A newer version of conda exists. <==
#11 17.65   current version: 23.3.1
#11 17.65   latest version: 24.9.2
#11 17.65 
#11 17.65 Please update conda by running
#11 17.65 
#11 17.65     $ conda update -n base -c defaults conda
#11 17.65 
#11 17.65 Or to minimize the number of packages updated during conda update use
#11 17.65 
#11 17.65      conda install conda=24.9.2
#11 17.65 
#11 17.65 
#11 17.67 
#11 17.67 ## Package Plan ##
#11 17.67 
#11 17.67   environment location: /home/app/text-generation-webui/installer_files/env
#11 17.67 
#11 17.67   added / updated specs:
#11 17.67     - git
#11 17.67     - ninja
#11 17.67 
#11 17.67 
#11 17.67 The following packages will be downloaded:
#11 17.67 
#11 17.67     package                    |            build
#11 17.67     ---------------------------|-----------------
#11 17.67     c-ares-1.19.1              |       h5eee18b_0         118 KB
#11 17.67     curl-8.9.1                 |       hdbd6064_0          87 KB
#11 17.67     expat-2.6.3                |       h6a678d5_0         176 KB
#11 17.67     gdbm-1.18                  |       hd4cb3f1_4         194 KB
#11 17.67     gettext-0.21.0             |       hedfda30_2         3.0 MB
#11 17.67     git-2.45.2                 | pl5340h9abc3c3_1        10.1 MB
#11 17.67     icu-73.1                   |       h6a678d5_0        25.9 MB
#11 17.67     krb5-1.20.1                |       h143b758_1         1.3 MB
#11 17.67     libcurl-8.9.1              |       h251f7ec_0         439 KB
#11 17.67     libedit-3.1.20230828       |       h5eee18b_0         179 KB
#11 17.67     libev-4.33                 |       h7f8727e_1         111 KB
#11 17.67     libnghttp2-1.57.0          |       h2d74bed_0         674 KB
#11 17.67     libssh2-1.11.0             |       h251f7ec_0         282 KB
#11 17.67     libxml2-2.13.1             |       hfdd30dd_2         739 KB
#11 17.67     ninja-1.10.2               |       h06a4308_5           8 KB
#11 17.67     ninja-base-1.10.2          |       hd09550d_5         109 KB
#11 17.67     pcre2-10.42                |       hebb0a14_1         1.3 MB
#11 17.67     perl-5.34.0                |       h5eee18b_2        12.4 MB
#11 17.67     ------------------------------------------------------------
#11 17.67                                            Total:        57.1 MB
#11 17.67 
#11 17.67 The following NEW packages will be INSTALLED:
#11 17.67 
#11 17.67   c-ares             pkgs/main/linux-64::c-ares-1.19.1-h5eee18b_0 
#11 17.67   curl               pkgs/main/linux-64::curl-8.9.1-hdbd6064_0 
#11 17.67   expat              pkgs/main/linux-64::expat-2.6.3-h6a678d5_0 
#11 17.67   gdbm               pkgs/main/linux-64::gdbm-1.18-hd4cb3f1_4 
#11 17.67   gettext            pkgs/main/linux-64::gettext-0.21.0-hedfda30_2 
#11 17.67   git                pkgs/main/linux-64::git-2.45.2-pl5340h9abc3c3_1 
#11 17.67   icu                pkgs/main/linux-64::icu-73.1-h6a678d5_0 
#11 17.67   krb5               pkgs/main/linux-64::krb5-1.20.1-h143b758_1 
#11 17.67   libcurl            pkgs/main/linux-64::libcurl-8.9.1-h251f7ec_0 
#11 17.67   libedit            pkgs/main/linux-64::libedit-3.1.20230828-h5eee18b_0 
#11 17.67   libev              pkgs/main/linux-64::libev-4.33-h7f8727e_1 
#11 17.67   libnghttp2         pkgs/main/linux-64::libnghttp2-1.57.0-h2d74bed_0 
#11 17.67   libssh2            pkgs/main/linux-64::libssh2-1.11.0-h251f7ec_0 
#11 17.67   libxml2            pkgs/main/linux-64::libxml2-2.13.1-hfdd30dd_2 
#11 17.67   ninja              pkgs/main/linux-64::ninja-1.10.2-h06a4308_5 
#11 17.67   ninja-base         pkgs/main/linux-64::ninja-base-1.10.2-hd09550d_5 
#11 17.67   pcre2              pkgs/main/linux-64::pcre2-10.42-hebb0a14_1 
#11 17.67   perl               pkgs/main/linux-64::perl-5.34.0-h5eee18b_2 
#11 17.67 
#11 17.67 
#11 17.67 
#11 17.67 Downloading and Extracting Packages

#11 19.60 Preparing transaction: ...working... done  
#11 19.75 Verifying transaction: ...working... done  
#11 20.35 Executing transaction: ...working... done  
#11 21.29 Looking in indexes: https://download.pytorch.org/whl/cu121
#11 21.76 Collecting torch==2.4.1                    
#11 21.78   Downloading https://download.pytorch.org/whl/cu121/torch-2.4.1%2Bcu121-cp311-cp311-linux_x86_64.whl (799.0 MB)

... <truncated> ...

#11 388.7   Preparing metadata (setup.py): started
#11 388.8   Preparing metadata (setup.py): finished with status 'done'
#11 392.1   Downloading umap-learn-0.5.1.tar.gz (80 kB)
#11 392.1   Preparing metadata (setup.py): started
#11 392.3   Preparing metadata (setup.py): finished with status 'done'
#11 396.8 Collecting transformers>=4.33.0 (from TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 396.8   Using cached transformers-4.45.2-py3-none-any.whl.metadata (44 kB)
#11 415.1   Downloading transformers-4.45.1-py3-none-any.whl.metadata (44 kB)
#11 433.3   Downloading transformers-4.45.0-py3-none-any.whl.metadata (44 kB)
#11 452.0   Downloading transformers-4.44.2-py3-none-any.whl.metadata (43 kB)
#11 452.3 Collecting tokenizers<0.20,>=0.19 (from transformers>=4.33.0->TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 452.3   Downloading tokenizers-0.19.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB)
#11 470.5 Collecting transformers>=4.33.0 (from TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 470.5   Downloading transformers-4.44.1-py3-none-any.whl.metadata (43 kB)
#11 488.8   Downloading transformers-4.44.0-py3-none-any.whl.metadata (43 kB)
#11 507.1   Downloading transformers-4.43.4-py3-none-any.whl.metadata (43 kB)
#11 525.3   Downloading transformers-4.43.3-py3-none-any.whl.metadata (43 kB)
#11 543.5   Downloading transformers-4.43.2-py3-none-any.whl.metadata (43 kB)
#11 561.8   Downloading transformers-4.43.1-py3-none-any.whl.metadata (43 kB)
#11 580.1   Downloading transformers-4.43.0-py3-none-any.whl.metadata (43 kB)
#11 598.4   Downloading transformers-4.42.4-py3-none-any.whl.metadata (43 kB)
#11 616.8   Downloading transformers-4.42.3-py3-none-any.whl.metadata (43 kB)
#11 635.3   Downloading transformers-4.42.2-py3-none-any.whl.metadata (43 kB)
#11 654.1   Downloading transformers-4.42.1-py3-none-any.whl.metadata (43 kB)
#11 672.9   Downloading transformers-4.42.0-py3-none-any.whl.metadata (43 kB)
#11 691.5   Downloading transformers-4.41.2-py3-none-any.whl.metadata (43 kB)
#11 709.9   Downloading transformers-4.41.1-py3-none-any.whl.metadata (43 kB)
#11 728.4   Downloading transformers-4.41.0-py3-none-any.whl.metadata (43 kB)
#11 747.2   Downloading transformers-4.40.2-py3-none-any.whl.metadata (137 kB)
#11 765.6   Downloading transformers-4.40.1-py3-none-any.whl.metadata (137 kB)
#11 784.0   Downloading transformers-4.40.0-py3-none-any.whl.metadata (137 kB)
#11 802.4   Downloading transformers-4.39.3-py3-none-any.whl.metadata (134 kB)
#11 802.5 Collecting tokenizers<0.19,>=0.14 (from transformers>=4.33.0->TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 802.5   Downloading tokenizers-0.15.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB)
#11 820.8 Collecting transformers>=4.33.0 (from TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 820.9   Downloading transformers-4.39.2-py3-none-any.whl.metadata (134 kB)
#11 839.4   Downloading transformers-4.39.1-py3-none-any.whl.metadata (134 kB)
#11 858.4   Downloading transformers-4.39.0-py3-none-any.whl.metadata (134 kB)
#11 876.9   Downloading transformers-4.38.2-py3-none-any.whl.metadata (130 kB)
#11 895.3   Downloading transformers-4.38.1-py3-none-any.whl.metadata (131 kB)
#11 914.0   Downloading transformers-4.38.0-py3-none-any.whl.metadata (131 kB)
#11 932.6   Downloading transformers-4.37.2-py3-none-any.whl.metadata (129 kB)
#11 951.7   Downloading transformers-4.37.1-py3-none-any.whl.metadata (129 kB)
#11 970.7   Downloading transformers-4.37.0-py3-none-any.whl.metadata (129 kB)
#11 989.2   Downloading transformers-4.36.2-py3-none-any.whl.metadata (126 kB)
#11 1007.9   Downloading transformers-4.36.1-py3-none-any.whl.metadata (126 kB)
#11 1026.5   Downloading transformers-4.36.0-py3-none-any.whl.metadata (126 kB)
#11 1045.2   Downloading transformers-4.35.2-py3-none-any.whl.metadata (123 kB)
#11 1063.8   Downloading transformers-4.35.1-py3-none-any.whl.metadata (123 kB)
#11 1063.9 Collecting tokenizers<0.15,>=0.14 (from transformers>=4.33.0->TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 1063.9   Downloading tokenizers-0.14.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB)
#11 1082.5 Collecting transformers>=4.33.0 (from TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 1082.5   Downloading transformers-4.35.0-py3-none-any.whl.metadata (123 kB)
#11 1101.1   Downloading transformers-4.34.1-py3-none-any.whl.metadata (121 kB)
#11 1120.1   Downloading transformers-4.34.0-py3-none-any.whl.metadata (121 kB)
#11 1138.7   Downloading transformers-4.33.3-py3-none-any.whl.metadata (119 kB)
#11 1138.8 Collecting tokenizers!=0.11.3,<0.14,>=0.11.1 (from transformers>=4.33.0->TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 1138.8   Downloading tokenizers-0.13.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB)
#11 1157.5 Collecting transformers>=4.33.0 (from TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 1157.6   Downloading transformers-4.33.2-py3-none-any.whl.metadata (119 kB)
#11 1176.3   Downloading transformers-4.33.1-py3-none-any.whl.metadata (119 kB)
#11 1195.0   Downloading transformers-4.33.0-py3-none-any.whl.metadata (119 kB)
#11 1213.9 Collecting spacy[ja]>=3 (from TTS==0.21.*->-r extensions/coqui_tts/requirements.txt (line 1))
#11 1213.9   Using cached spacy-3.8.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (27 kB)
#11 1959.3   Downloading spacy-3.7.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (27 kB)
#11 1959.4 INFO: pip is looking at multiple versions of spacy[ja] to determine which version is compatible with other requirements. This could take a while.
#11 1959.4   Downloading spacy-3.7.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (27 kB)
#11 1959.5   Downloading spacy-3.7.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1959.5   Downloading spacy-3.7.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1959.6   Downloading spacy-3.7.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1959.7   Downloading spacy-3.6.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1959.7   Downloading spacy-3.6.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (19 kB)
#11 1959.8   Downloading spacy-3.5.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1959.8 INFO: pip is still looking at multiple versions of spacy[ja] to determine which version is compatible with other requirements. This could take a while.
#11 1959.9   Downloading spacy-3.5.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1959.9   Downloading spacy-3.5.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1960.0   Downloading spacy-3.5.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1960.0   Downloading spacy-3.5.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (25 kB)
#11 1960.1   Downloading spacy-3.4.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (24 kB)
#11 1960.1 INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
#11 1960.2   Downloading spacy-3.4.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (24 kB)
#11 1960.2   Downloading spacy-3.4.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (24 kB)
#11 1960.3   Downloading spacy-3.4.1.tar.gz (1.2 MB)
#11 1960.4      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 16.8 MB/s eta 0:00:00
#11 1960.6   Installing build dependencies: started
#11 1969.1   Installing build dependencies: finished with status 'done'
#11 1969.1   Getting requirements to build wheel: started
#11 2004.2   Getting requirements to build wheel: finished with status 'done'
#11 2004.2   Preparing metadata (pyproject.toml): started
#11 2004.7   Preparing metadata (pyproject.toml): finished with status 'done'
#11 2004.8   Downloading spacy-3.4.0.tar.gz (1.2 MB)
#11 2004.8      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 22.5 MB/s eta 0:00:00
#11 2005.0   Installing build dependencies: started
#11 2012.1   Installing build dependencies: finished with status 'done'
#11 2012.1   Getting requirements to build wheel: started
#11 2046.9   Getting requirements to build wheel: finished with status 'done'
#11 2046.9   Preparing metadata (pyproject.toml): started
#11 2047.4   Preparing metadata (pyproject.toml): finished with status 'done'
#11 2047.5   Downloading spacy-3.3.3.tar.gz (1.1 MB)
#11 2047.5      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 22.7 MB/s eta 0:00:00
#11 2047.7   Installing build dependencies: started
#11 2075.7   Installing build dependencies: finished with status 'done'
#11 2075.7   Getting requirements to build wheel: started
#11 2109.4   Getting requirements to build wheel: finished with status 'done'
#11 2109.4   Preparing metadata (pyproject.toml): started
#11 2109.9   Preparing metadata (pyproject.toml): finished with status 'done'
#11 2110.0   Downloading spacy-3.3.2.tar.gz (1.1 MB)
#11 2110.0      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 23.2 MB/s eta 0:00:00
#11 2110.3   Installing build dependencies: started
#11 2116.2   Installing build dependencies: finished with status 'done'
#11 2116.2   Getting requirements to build wheel: started
#11 2150.1   Getting requirements to build wheel: finished with status 'done'
#11 2150.1   Preparing metadata (pyproject.toml): started
#11 2150.6   Preparing metadata (pyproject.toml): finished with status 'done'
#11 2150.6   Downloading spacy-3.3.1.tar.gz (1.1 MB)
#11 2150.8      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 7.1 MB/s eta 0:00:00
#11 2151.0   Installing build dependencies: started
#11 2157.2   Installing build dependencies: finished with status 'done'
#11 2157.2   Getting requirements to build wheel: started
#11 2191.7   Getting requirements to build wheel: finished with status 'done'
#11 2191.7   Preparing metadata (pyproject.toml): started
#11 2192.3   Preparing metadata (pyproject.toml): finished with status 'done'
#11 2192.3   Downloading spacy-3.3.0.tar.gz (1.1 MB)
#11 2192.4      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 24.0 MB/s eta 0:00:00
#11 2192.6   Installing build dependencies: started
#11 2198.8   Installing build dependencies: finished with status 'done'
#11 2198.8   Getting requirements to build wheel: started

System Info

user@hostname:~/REPOS/text-generation-webui$ neofetch
             ...-:::::-...                 user@hostname 
          .-MMMMMMMMMMMMMMM-.              ------------- 
      .-MMMM`..-:::::::-..`MMMM-.          OS: Linux Mint 21.1 x86_64 
    .:MMMM.:MMMMMMMMMMMMMMM:.MMMM:.        Kernel: 5.15.0-56-generic 
   -MMM-M---MMMMMMMMMMMMMMMMMMM.MMM-       Uptime: 1 hour, 57 mins 
 `:MMM:MM`  :MMMM:....::-...-MMMM:MMM:`    Packages: 2150 (dpkg) 
 :MMM:MMM`  :MM:`  ``    ``  `:MMM:MMM:    Shell: bash 5.1.16 
.MMM.MMMM`  :MM.  -MM.  .MM-  `MMMM.MMM.   Resolution: 2560x1440 
:MMM:MMMM`  :MM.  -MM-  .MM:  `MMMM-MMM:   DE: Cinnamon 5.6.5 
:MMM:MMMM`  :MM.  -MM-  .MM:  `MMMM:MMM:   WM: Mutter (Muffin) 
:MMM:MMMM`  :MM.  -MM-  .MM:  `MMMM-MMM:   WM Theme: Mint-Y-Dark-Aqua (Mint-Y) 
.MMM.MMMM`  :MM:--:MM:--:MM:  `MMMM.MMM.   Theme: Mint-Y-Aqua [GTK2/3] 
 :MMM:MMM-  `-MMMMMMMMMMMM-`  -MMM-MMM:    Icons: Mint-Y-Aqua [GTK2/3] 
  :MMM:MMM:`                `:MMM:MMM:     Terminal: gnome-terminal 
   .MMM.MMMM:--------------:MMMM.MMM.      CPU: AMD Ryzen 5 5600X (12) @ 4.200GHz 
     '-MMMM.-MMMMMMMMMMMMMMM-.MMMM-'       GPU: NVIDIA GeForce RTX 3090 
       '.-MMMM``--:::::--``MMMM-.'         GPU: NVIDIA GeForce RTX 3090 
            '-MMMMMMMMMMMMM-'              Memory: 3348MiB / 80343MiB 
               ``-:::::-``

user@hostname:~/REPOS/text-generation-webui$ speedtest-cli --simple
Ping: 32.698 ms
Download: 324.88 Mbit/s
Upload: 20.03 Mbit/s
user@hostname:~/REPOS/text-generation-webui$
practical-dreamer commented 3 weeks ago

Update: I'm pretty sure this issue is not specific to docker - I adjusted INSTALL_EXTENSIONS=FALSE in the dockerfile and it finally worked. I'm now getting Error response from daemon: could not select device driver "nvidia" with capabilities: [[gpu]] probably because I need the NVIDIA container toolkit but at least the build completed... My theory is the package dependency issue is a problem with one of the extensions and would be observed if I called INSTALL_EXTENSIONS=FALSE ./start_linux.sh directly...

Unsure what extension is the issue

practical-dreamer commented 3 weeks ago

I am closing this issue as my original objective of building a docker image can be accomplished by modifying INSTALL_EXTENSIONS=TRUE to INSTALL_EXTENSIONS=FALSE in the dockerfile.

However, I may end up reopening or reinvestigating why pip is getting stuck when trying to download dependencies for the extensions... Not sure which extension is causing problems but this probably is causing problems for others and should be looked into...

Also just FYI if anyone gets to this page and is trying to figure how to get docker with cuda support to work I made a short gist hoping to help anyone along the path - accessible here: https://gist.github.com/practical-dreamer/79c26931d99bc6a7f28271b3612907a9