Open Nero10578 opened 3 days ago
Numpy isn't an issue, that's mostly a benign error. The real issue is here:
-- Configuring done (17.7s)
CMake Error: The following variables are used in this project, but they are set to NOTFOUND.
Please set them or make sure they are set and tested correctly in the CMake files:
LIBNVTOOLSEXT
It seems your setup is missing libnvtoolsext
. Probably an incomplete CUDA installation. Would you mind trying ./runtime.sh aphrodite run EleutherAI/pythia-70m
(or any other model)? That should create a conda env with a full cuda installation, then build aphrodite there.
Numpy isn't an issue, that's mostly a benign error. The real issue is here:
-- Configuring done (17.7s) CMake Error: The following variables are used in this project, but they are set to NOTFOUND. Please set them or make sure they are set and tested correctly in the CMake files: LIBNVTOOLSEXT
It seems your setup is missing
libnvtoolsext
. Probably an incomplete CUDA installation. Would you mind trying./runtime.sh aphrodite run EleutherAI/pythia-70m
(or any other model)? That should create a conda env with a full cuda installation, then build aphrodite there.
Huh ok. So it's an issue with cuda toolkit installation? Somehow aprhodite versions with pytorch <2.4.0 works fine though. Which makes this confusing. I will try that and report back.
Your current environment
How did you install Aphrodite?
I keep getting the error when trying to install from source starting from when pytorch was bumped to 2.4.0. It works fine for commits before that. Doing pip install numpy also didn't help.
Also tried running these which usually helps fix any compile errors previously.
/tmp/pip-build-env-84gx5762/overlay/lib/python3.11/site-packages/torch/_subclasses/functional_tensor.py:258: UserWarning: Failed to initialize NumPy: No module named 'numpy' (Triggered internally at ../torch/csrc/utils/tensor_numpy.cpp:84.)