search

explosion / spaCy

💫 Industrial-strength Natural Language Processing (NLP) in Python
https://spacy.io
MIT License
30.32k stars 4.41k forks source link

Not able to install Spacy v3 with GPU support on Windows #12143

Closed mbledkowski closed 1 year ago

mbledkowski commented 1 year ago

How to reproduce the behaviour

Hello, When I try to install Spacy with support for training and cuda on Windows, pip cannot find any Spacy v3 package that support cuda-autodetect. I attach the output below

mble@neptune MINGW64 ~
$ pip install -U 'spacy[cuda-autodetect,transformers,lookups]'
Requirement already satisfied: spacy[cuda-autodetect,lookups,transformers] in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (3.5.0)
Requirement already satisfied: spacy-legacy<3.1.0,>=3.0.11 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (3.0.11)
Requirement already satisfied: spacy-loggers<2.0.0,>=1.0.0 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (1.0.4)
Requirement already satisfied: murmurhash<1.1.0,>=0.28.0 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (1.0.9)
Requirement already satisfied: cymem<2.1.0,>=2.0.2 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (2.0.7)
Requirement already satisfied: preshed<3.1.0,>=3.0.2 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (3.0.8)
Requirement already satisfied: thinc<8.2.0,>=8.1.0 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (8.1.7)
Requirement already satisfied: wasabi<1.2.0,>=0.9.1 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (1.1.1)
Requirement already satisfied: srsly<3.0.0,>=2.4.3 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (2.4.5)
Requirement already satisfied: catalogue<2.1.0,>=2.0.6 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (2.0.8)
Requirement already satisfied: typer<0.8.0,>=0.3.0 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (0.7.0)
Requirement already satisfied: pathy>=0.10.0 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (0.10.1)
Requirement already satisfied: smart-open<7.0.0,>=5.2.1 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (6.3.0)
Requirement already satisfied: tqdm<5.0.0,>=4.38.0 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (4.64.1)
Requirement already satisfied: numpy>=1.15.0 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (1.24.1)
Requirement already satisfied: requests<3.0.0,>=2.13.0 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (2.28.2)
Requirement already satisfied: pydantic!=1.8,!=1.8.1,<1.11.0,>=1.7.4 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (1.10.4)
Requirement already satisfied: jinja2 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (3.1.2)
Requirement already satisfied: setuptools in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (66.1.1)
Requirement already satisfied: packaging>=20.0 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (23.0)
Requirement already satisfied: langcodes<4.0.0,>=3.2.0 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (3.3.0)
Requirement already satisfied: cupy-wheel<12.0.0,>=11.0.0 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (11.5.0)
Collecting spacy-lookups-data<1.1.0,>=1.0.3
  Using cached spacy_lookups_data-1.0.3-py2.py3-none-any.whl (98.5 MB)
Collecting spacy-transformers<1.3.0,>=1.1.2
  Using cached spacy-transformers-1.2.0.tar.gz (45 kB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: cupy-cuda12x==11.5.0 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from cupy-wheel<12.0.0,>=11.0.0->spacy[cuda-autodetect,lookups,transformers]) (11.5.0)
Requirement already satisfied: fastrlock>=0.5 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from cupy-cuda12x==11.5.0->cupy-wheel<12.0.0,>=11.0.0->spacy[cuda-autodetect,lookups,transformers]) (0.8.1)
Requirement already satisfied: typing-extensions>=4.2.0 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from pydantic!=1.8,!=1.8.1,<1.11.0,>=1.7.4->spacy[cuda-autodetect,lookups,transformers]) (4.4.0)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from requests<3.0.0,>=2.13.0->spacy[cuda-autodetect,lookups,transformers]) (3.0.1)
Requirement already satisfied: idna<4,>=2.5 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from requests<3.0.0,>=2.13.0->spacy[cuda-autodetect,lookups,transformers]) (3.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from requests<3.0.0,>=2.13.0->spacy[cuda-autodetect,lookups,transformers]) (1.26.14)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from requests<3.0.0,>=2.13.0->spacy[cuda-autodetect,lookups,transformers]) (2022.12.7)
Collecting transformers<4.26.0,>=3.4.0
  Using cached transformers-4.25.1-py3-none-any.whl (5.8 MB)
Collecting spacy-transformers<1.3.0,>=1.1.2
  Using cached spacy_transformers-1.1.9-py2.py3-none-any.whl (53 kB)
  Using cached spacy_transformers-1.1.8-py2.py3-none-any.whl (53 kB)
Collecting transformers<4.22.0,>=3.4.0
  Using cached transformers-4.21.3-py3-none-any.whl (4.7 MB)
Collecting spacy-transformers<1.3.0,>=1.1.2
  Using cached spacy_transformers-1.1.7-py2.py3-none-any.whl (53 kB)
Collecting transformers<4.21.0,>=3.4.0
  Using cached transformers-4.20.1-py3-none-any.whl (4.4 MB)
Collecting spacy-transformers<1.3.0,>=1.1.2
  Using cached spacy_transformers-1.1.6-py2.py3-none-any.whl (51 kB)
Collecting transformers<4.20.0,>=3.4.0
  Using cached transformers-4.19.4-py3-none-any.whl (4.2 MB)
Collecting spacy-transformers<1.3.0,>=1.1.2
  Using cached spacy_transformers-1.1.5-py2.py3-none-any.whl (51 kB)
Collecting transformers<4.18.0,>=3.4.0
  Using cached transformers-4.17.0-py3-none-any.whl (3.8 MB)
Collecting spacy-transformers<1.3.0,>=1.1.2
  Using cached spacy_transformers-1.1.4-py2.py3-none-any.whl (51 kB)
Collecting transformers<4.16.0,>=3.4.0
  Using cached transformers-4.15.0-py3-none-any.whl (3.4 MB)
Collecting spacy-transformers<1.3.0,>=1.1.2
  Using cached spacy_transformers-1.1.3-py2.py3-none-any.whl (51 kB)
Collecting transformers<4.13.0,>=3.4.0
  Using cached transformers-4.12.5-py3-none-any.whl (3.1 MB)
Collecting spacy-transformers<1.3.0,>=1.1.2
  Using cached spacy_transformers-1.1.2-py2.py3-none-any.whl (51 kB)
Collecting transformers<4.12.0,>=3.4.0
  Using cached transformers-4.11.3-py3-none-any.whl (2.9 MB)
INFO: pip is looking at multiple versions of <Python from Requires-Python> to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of spacy-lookups-data to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of spacy-loggers to determine which version is compatible with other requirements. This could take a while.
Collecting spacy-loggers<2.0.0,>=1.0.0
  Using cached spacy_loggers-1.0.4-py3-none-any.whl (11 kB)
INFO: pip is looking at multiple versions of spacy-legacy to determine which version is compatible with other requirements. This could take a while.
Collecting spacy-legacy<3.1.0,>=3.0.11
  Using cached spacy_legacy-3.0.11-py2.py3-none-any.whl (24 kB)
INFO: pip is looking at multiple versions of smart-open to determine which version is compatible with other requirements. This could take a while.
Collecting smart-open<7.0.0,>=5.2.1
  Using cached smart_open-6.3.0-py3-none-any.whl (56 kB)
INFO: pip is looking at multiple versions of requests to determine which version is compatible with other requirements. This could take a while.
Collecting requests<3.0.0,>=2.13.0
  Using cached requests-2.28.2-py3-none-any.whl (62 kB)
INFO: pip is looking at multiple versions of pydantic to determine which version is compatible with other requirements. This could take a while.
Collecting pydantic!=1.8,!=1.8.1,<1.11.0,>=1.7.4
  Using cached pydantic-1.10.4-cp311-cp311-win_amd64.whl (2.1 MB)
INFO: pip is looking at multiple versions of preshed to determine which version is compatible with other requirements. This could take a while.
Collecting preshed<3.1.0,>=3.0.2
  Using cached preshed-3.0.8-cp311-cp311-win_amd64.whl (91 kB)
INFO: pip is looking at multiple versions of pathy to determine which version is compatible with other requirements. This could take a while.
Collecting pathy>=0.10.0
  Using cached pathy-0.10.1-py3-none-any.whl (48 kB)
INFO: pip is looking at multiple versions of packaging to determine which version is compatible with other requirements. This could take a while.
Collecting packaging>=20.0
  Using cached packaging-23.0-py3-none-any.whl (42 kB)
INFO: pip is looking at multiple versions of numpy to determine which version is compatible with other requirements. This could take a while.
Collecting numpy>=1.15.0
  Using cached numpy-1.24.1-cp311-cp311-win_amd64.whl (14.8 MB)
INFO: pip is looking at multiple versions of murmurhash to determine which version is compatible with other requirements. This could take a while.
Collecting murmurhash<1.1.0,>=0.28.0
  Using cached murmurhash-1.0.9-cp311-cp311-win_amd64.whl (18 kB)
INFO: pip is looking at multiple versions of langcodes to determine which version is compatible with other requirements. This could take a while.
Collecting langcodes<4.0.0,>=3.2.0
  Using cached langcodes-3.3.0-py3-none-any.whl (181 kB)
INFO: pip is looking at multiple versions of cymem to determine which version is compatible with other requirements. This could take a while.
Collecting cymem<2.1.0,>=2.0.2
  Using cached cymem-2.0.7-cp311-cp311-win_amd64.whl (28 kB)
INFO: pip is looking at multiple versions of cupy-cuda12x to determine which version is compatible with other requirements. This could take a while.
Collecting cupy-cuda12x==11.5.0
  Using cached cupy_cuda12x-11.5.0-cp311-cp311-win_amd64.whl (64.7 MB)
INFO: pip is looking at multiple versions of cupy-wheel to determine which version is compatible with other requirements. This could take a while.
Collecting cupy-wheel<12.0.0,>=11.0.0
  Using cached cupy-wheel-11.5.0.tar.gz (3.1 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
INFO: pip is looking at multiple versions of catalogue to determine which version is compatible with other requirements. This could take a while.
Collecting catalogue<2.1.0,>=2.0.6
  Using cached catalogue-2.0.8-py3-none-any.whl (17 kB)
INFO: pip is looking at multiple versions of spacy[cuda-autodetect,lookups,transformers] to determine which version is compatible with other requirements. This could take a while.
Collecting spacy[cuda-autodetect,lookups,transformers]
  Using cached spacy-3.5.0-cp311-cp311-win_amd64.whl (12.2 MB)
  Using cached spacy-3.4.4-cp311-cp311-win_amd64.whl (11.9 MB)
Collecting wasabi<1.1.0,>=0.9.1
  Using cached wasabi-0.10.1-py3-none-any.whl (26 kB)
Collecting spacy[cuda-autodetect,lookups,transformers]
  Using cached spacy-3.4.3-cp311-cp311-win_amd64.whl (11.8 MB)
  Using cached spacy-3.4.2-cp311-cp311-win_amd64.whl (11.8 MB)
Collecting typer<0.5.0,>=0.3.0
  Using cached typer-0.4.2-py3-none-any.whl (27 kB)
Collecting spacy[cuda-autodetect,lookups,transformers]
  Using cached spacy-3.4.1.tar.gz (1.2 MB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.4.1 does not provide the extra 'cuda-autodetect'
Collecting pydantic!=1.8,!=1.8.1,<1.10.0,>=1.7.4
  Using cached pydantic-1.9.2-py3-none-any.whl (143 kB)
Collecting spacy[cuda-autodetect,lookups,transformers]
  Using cached spacy-3.4.0.tar.gz (1.2 MB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.4.0 does not provide the extra 'cuda-autodetect'
  Using cached spacy-3.3.2.tar.gz (1.1 MB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.3.2 does not provide the extra 'cuda-autodetect'
Collecting thinc<8.1.0,>=8.0.14
  Using cached thinc-8.0.17-cp311-cp311-win_amd64.whl
Requirement already satisfied: blis<0.8.0,>=0.4.0 in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from spacy[cuda-autodetect,lookups,transformers]) (0.7.9)
Collecting pydantic!=1.8,!=1.8.1,<1.9.0,>=1.7.4
  Using cached pydantic-1.8.2-py3-none-any.whl (126 kB)
INFO: pip is looking at multiple versions of spacy[cuda-autodetect,lookups,transformers] to determine which version is compatible with other requirements. This could take a while.
Collecting spacy[cuda-autodetect,lookups,transformers]
  Downloading spacy-3.3.1.tar.gz (1.1 MB)
     ---------------------------------------- 1.1/1.1 MB 1.1 MB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.3.1 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.3.0.tar.gz (1.1 MB)
     ---------------------------------------- 1.1/1.1 MB 1.1 MB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.3.0 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.2.5-cp311-cp311-win_amd64.whl (11.3 MB)
     -------------------------------------- 11.3/11.3 MB 922.6 kB/s eta 0:00:00
WARNING: spacy 3.2.5 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.2.4.tar.gz (1.1 MB)
     ---------------------------------------- 1.1/1.1 MB 1.2 MB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.2.4 does not provide the extra 'cuda-autodetect'
Collecting click<8.1.0
  Downloading click-8.0.4-py3-none-any.whl (97 kB)
     ---------------------------------------- 97.5/97.5 kB 1.1 MB/s eta 0:00:00
Collecting spacy[cuda-autodetect,lookups,transformers]
  Downloading spacy-3.2.3.tar.gz (1.1 MB)
     ---------------------------------------- 1.1/1.1 MB 193.3 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.2.3 does not provide the extra 'cuda-autodetect'
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
  Downloading spacy-3.2.2.tar.gz (1.1 MB)
     ---------------------------------------- 1.1/1.1 MB 55.8 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.2.2 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.2.1.tar.gz (1.1 MB)
     ---------------------------------------- 1.1/1.1 MB 58.3 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.2.1 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.2.0.tar.gz (1.1 MB)
     ---------------------------------------- 1.1/1.1 MB 68.8 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.2.0 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.1.7-cp311-cp311-win_amd64.whl (11.2 MB)
     --------------------------------------- 11.2/11.2 MB 97.3 kB/s eta 0:00:00
WARNING: spacy 3.1.7 does not provide the extra 'cuda-autodetect'
Collecting spacy-transformers<1.2.0,>=1.0.1
  Downloading spacy_transformers-1.1.1-py2.py3-none-any.whl (50 kB)
     -------------------------------------- 51.0/51.0 kB 108.6 kB/s eta 0:00:00
  Downloading spacy_transformers-1.1.0-py2.py3-none-any.whl (50 kB)
     --------------------------------------- 50.8/50.8 kB 74.2 kB/s eta 0:00:00
  Downloading spacy_transformers-1.0.6-py2.py3-none-any.whl (42 kB)
     --------------------------------------- 42.6/42.6 kB 98.5 kB/s eta 0:00:00
Collecting transformers<4.10.0,>=3.4.0
  Downloading transformers-4.9.2-py3-none-any.whl (2.6 MB)
     ---------------------------------------- 2.6/2.6 MB 126.7 kB/s eta 0:00:00
Collecting spacy-transformers<1.2.0,>=1.0.1
  Downloading spacy_transformers-1.0.5-py2.py3-none-any.whl (42 kB)
     -------------------------------------- 42.6/42.6 kB 115.0 kB/s eta 0:00:00
  Downloading spacy_transformers-1.0.4-py2.py3-none-any.whl (40 kB)
     -------------------------------------- 40.1/40.1 kB 173.6 kB/s eta 0:00:00
  Downloading spacy_transformers-1.0.3-py2.py3-none-any.whl (39 kB)
Collecting transformers<4.7.0,>=3.4.0
  Downloading transformers-4.6.1-py3-none-any.whl (2.2 MB)
     ---------------------------------------- 2.2/2.2 MB 261.6 kB/s eta 0:00:00
Collecting spacy-transformers<1.2.0,>=1.0.1
  Downloading spacy_transformers-1.0.2-py2.py3-none-any.whl (39 kB)
  Downloading spacy_transformers-1.0.1-py2.py3-none-any.whl (38 kB)
Collecting transformers<4.3.0,>=3.1.0
  Downloading transformers-4.2.2-py3-none-any.whl (1.8 MB)
     ---------------------------------------- 1.8/1.8 MB 369.8 kB/s eta 0:00:00
Collecting spacy[cuda-autodetect,lookups,transformers]
  Downloading spacy-3.1.6.tar.gz (1.0 MB)
     ---------------------------------------- 1.0/1.0 MB 268.5 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.1.6 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.1.5.tar.gz (1.0 MB)
     ---------------------------------------- 1.0/1.0 MB 205.0 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.1.5 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.1.4.tar.gz (1.0 MB)
     ---------------------------------------- 1.0/1.0 MB 115.5 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.1.4 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.1.3.tar.gz (1.0 MB)
     ---------------------------------------- 1.0/1.0 MB 174.1 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.1.3 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.1.2.tar.gz (1.0 MB)
     ---------------------------------------- 1.0/1.0 MB 513.2 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.1.2 does not provide the extra 'cuda-autodetect'
Collecting typer<0.4.0,>=0.3.0
  Downloading typer-0.3.2-py3-none-any.whl (21 kB)
Collecting spacy[cuda-autodetect,lookups,transformers]
  Downloading spacy-3.1.1.tar.gz (1.0 MB)
     ---------------------------------------- 1.0/1.0 MB 402.7 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.1.1 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.1.0.tar.gz (1.0 MB)
     ---------------------------------------- 1.0/1.0 MB 437.1 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.1.0 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.0.9.tar.gz (989 kB)
     ------------------------------------ 989.2/989.2 kB 754.8 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.0.9 does not provide the extra 'cuda-autodetect'
Collecting transformers<4.6.0,>=3.4.0
  Downloading transformers-4.5.1-py3-none-any.whl (2.1 MB)
     ---------------------------------------- 2.1/2.1 MB 599.2 kB/s eta 0:00:00
Collecting spacy[cuda-autodetect,lookups,transformers]
  Downloading spacy-3.0.8.tar.gz (989 kB)
     ------------------------------------ 989.0/989.0 kB 321.2 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.0.8 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.0.7.tar.gz (987 kB)
     ------------------------------------ 988.0/988.0 kB 718.9 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.0.7 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.0.6.tar.gz (7.1 MB)
     ---------------------------------------- 7.1/7.1 MB 671.8 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.0.6 does not provide the extra 'cuda-autodetect'
Collecting pydantic<1.8.0,>=1.7.1
  Downloading pydantic-1.7.4-py3-none-any.whl (107 kB)
     ------------------------------------ 107.9/107.9 kB 368.5 kB/s eta 0:00:00
Collecting spacy[cuda-autodetect,lookups,transformers]
  Downloading spacy-3.0.5.tar.gz (7.0 MB)
     ---------------------------------------- 7.0/7.0 MB 500.0 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.0.5 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.0.4.tar.gz (7.0 MB)
     ---------------------------------------- 7.0/7.0 MB 166.7 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.0.4 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.0.3.tar.gz (7.0 MB)
     ---------------------------------------- 7.0/7.0 MB 170.5 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.0.3 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.0.2.tar.gz (7.0 MB)
     ---------------------------------------- 7.0/7.0 MB 129.5 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.0.2 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.0.1.tar.gz (7.0 MB)
     ---------------------------------------- 7.0/7.0 MB 134.7 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.0.1 does not provide the extra 'cuda-autodetect'
  Downloading spacy-3.0.0.tar.gz (7.0 MB)
     ---------------------------------------- 7.0/7.0 MB 105.0 kB/s eta 0:00:00
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: still running...
  Getting requirements to build wheel: finished with status 'done'
  Installing backend dependencies: started
  Installing backend dependencies: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
WARNING: spacy 3.0.0 does not provide the extra 'cuda-autodetect'
Collecting spacy-transformers<1.1.0,>=1.0.0
  Downloading spacy_transformers-1.0.0-py2.py3-none-any.whl (37 kB)
Collecting spacy[cuda-autodetect,lookups,transformers]
  Downloading spacy-2.3.9-cp311-cp311-win_amd64.whl (9.1 MB)
     ---------------------------------------- 9.1/9.1 MB 201.3 kB/s eta 0:00:00
WARNING: spacy 2.3.9 does not provide the extra 'cuda-autodetect'
WARNING: spacy 2.3.9 does not provide the extra 'transformers'
Collecting thinc<7.5.0,>=7.4.1
  Downloading thinc-7.4.6-cp311-cp311-win_amd64.whl (806 kB)
     ------------------------------------ 806.8/806.8 kB 119.4 kB/s eta 0:00:00
Collecting srsly<1.1.0,>=1.0.2
  Downloading srsly-1.0.6-cp311-cp311-win_amd64.whl (194 kB)
     ------------------------------------ 195.0/195.0 kB 215.1 kB/s eta 0:00:00
Collecting catalogue<1.1.0,>=0.0.7
  Downloading catalogue-1.0.2-py2.py3-none-any.whl (16 kB)
Collecting plac<1.2.0,>=0.9.6
  Downloading plac-1.1.3-py2.py3-none-any.whl (20 kB)
Collecting spacy-lookups-data<0.4.0,>=0.3.2
  Downloading spacy_lookups_data-0.3.2.tar.gz (93.8 MB)
     -------------------------------------- 93.8/93.8 MB 401.7 kB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: colorama in c:\users\mble\appdata\local\programs\python\python311\lib\site-packages (from tqdm<5.0.0,>=4.38.0->spacy[cuda-autodetect,lookups,transformers]) (0.4.6)
Building wheels for collected packages: spacy-lookups-data
  Building wheel for spacy-lookups-data (setup.py): started
  Building wheel for spacy-lookups-data (setup.py): finished with status 'done'
  Created wheel for spacy-lookups-data: filename=spacy_lookups_data-0.3.2-py2.py3-none-any.whl size=93807600 sha256=a4d54e1b4fba1f3e6d82e2bcbd298fa676436c23f8dfb56d6483f273cf465616
  Stored in directory: c:\users\mble\appdata\local\pip\cache\wheels\75\a3\89\2d0d7523f81d2bacdd3c08e0c4969bc71f967f157d49f5d568
Successfully built spacy-lookups-data
Installing collected packages: wasabi, plac, srsly, spacy-lookups-data, catalogue, thinc, spacy
  Attempting uninstall: wasabi
    Found existing installation: wasabi 1.1.1
    Uninstalling wasabi-1.1.1:
      Successfully uninstalled wasabi-1.1.1
  Attempting uninstall: srsly
    Found existing installation: srsly 2.4.5
    Uninstalling srsly-2.4.5:
      Successfully uninstalled srsly-2.4.5
  Attempting uninstall: catalogue
    Found existing installation: catalogue 2.0.8
    Uninstalling catalogue-2.0.8:
      Successfully uninstalled catalogue-2.0.8
  Attempting uninstall: thinc
    Found existing installation: thinc 8.1.7
    Uninstalling thinc-8.1.7:
      Successfully uninstalled thinc-8.1.7
  Attempting uninstall: spacy
    Found existing installation: spacy 3.5.0
    Uninstalling spacy-3.5.0:
      Successfully uninstalled spacy-3.5.0
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
confection 0.0.4 requires srsly<3.0.0,>=2.4.0, but you have srsly 1.0.6 which is incompatible.
Successfully installed catalogue-1.0.2 plac-1.1.3 spacy-2.3.9 spacy-lookups-data-0.3.2 srsly-1.0.6 thinc-7.4.6 wasabi-0.10.1

Your Environment

adrianeboyd commented 1 year ago

The pip output and behavior is very confusing here, but the problem is that pytorch doesn't currently support windows for python 3.11. You'll need to downgrade to python 3.10 or earlier.

Our recommendation if you run into installation problems with spacy+transformers: first install pytorch according to their quickstart (https://pytorch.org/get-started/locally/), then install spacy.

adrianeboyd commented 1 year ago

Let me move this to the installation section of the discussion board...