Compiling the Torch C++ extension results in a `ModuleNotFoundError: No module named 'torch'` error, even though torch is installed.

ThomasBaruzier commented 6 months ago

(exllama) ~/files/ai/exllama pip show torch
Name: torch
Version: 2.2.1
Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
Home-page: https://pytorch.org/
Author: PyTorch Team
Author-email: packages@pytorch.org
License: BSD-3
Location: /home/tyra/files/ai/envs/exllama/lib/python3.11/site-packages
Requires: filelock, fsspec, jinja2, networkx, nvidia-cublas-cu12, nvidia-cuda-cupti-cu12, nvidia-cuda-nvrtc-cu12, nvidia-cuda-runtime-cu12, nvidia-cudnn-cu12, nvidia-cufft-cu12, nvidia-curand-cu12, nvidia-cusolver-cu12, nvidia-cusparse-cu12, nvidia-nccl-cu12, nvidia-nvtx-cu12, sympy, triton, typing-extensions
Required-by: torchaudio, torchvision
(exllama) ~/files/ai/exllama pip install .
Processing /home/tyra/files/ai/exllama
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error
(exllama) ~/files/ai/exllama pip install .
  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [20 lines of output]
      Traceback (most recent call last):
        File "/home/tyra/files/ai/envs/exllama/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
          main()
        File "/home/tyra/files/ai/envs/exllama/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/home/tyra/files/ai/envs/exllama/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
          return hook(config_settings)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-c1t5tyap/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 325, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=['wheel'])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-c1t5tyap/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 295, in _get_build_requires
          self.run_setup()
        File "/tmp/pip-build-env-c1t5tyap/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 487, in run_setup
          super().run_setup(setup_script=setup_script)
        File "/tmp/pip-build-env-c1t5tyap/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 311, in run_setup
          exec(code, locals())
        File "<string>", line 2, in <module>
      ModuleNotFoundError: No module named 'torch'
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
(exllama) ~/files/ai/exllama

Hello, When trying to recompile the Torch C++ extension for my rtx 3090 on arch linux, I get a ModuleNotFoundError error for torch apparently not being installed. The issue is that it is, proved by the output of pip show torch. All I did was cloning the repo, sourcing a newly created pip environment with python 3.11.8, execute pip install -r requirements.txt followed by pip install .. What did I miss? Thanks

turboderp commented 6 months ago

I think I've seen this recently, and if I recall correctly the solution was upgrading the setuptools package.

ThomasBaruzier commented 6 months ago

Thanks. setuptools wasn't the issue, but wheel not being installed. Maybe it could be included in the requirements.txt?

turboderp / exllamav2

Compiling the Torch C++ extension results in a `ModuleNotFoundError: No module named 'torch'` error, even though torch is installed. #377