Closed ddetone closed 1 year ago
I haven't come across this error, but one thing to try might be re-downloading a tarball of cudnn from the nvidia website and overriding the cudnn filepaths in cmake by setting
export CMAKE_ARGS="-DCUDNN_LIBRARY_PATH=<unzipped-tarball>/lib -DCUDNN_INCLUDE_PATH=<unzipped-tarball>/include"
before running pip install ./DPViewer
@ddetone If you're still having issues setting up DPVO, we just created a docker for it: https://github.com/princeton-vl/DPVO_Docker
Hmm, still seeing the same issue after trying your recommended fix. I don't think it is a cudnn actually but the error message is quite vague:
pip install ./DPViewer
Processing ./DPViewer
Building wheels for collected packages: dpviewer
Building wheel for dpviewer (setup.py) ... error
ERROR: Command errored out with exit status 1:
command: /home/ddetone/anaconda3/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-req-build-tc9s5h7_/setup.py'"'"'; __file__='"'"'/tmp/pip-req-build-tc9s5h7_/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-6j70tgzb
cwd: /tmp/pip-req-build-tc9s5h7_/
Complete output (109 lines):
running bdist_wheel
running build
running build_py
creating build/lib.linux-x86_64-3.8
creating build/lib.linux-x86_64-3.8/dpviewer
copying dpviewer/__init__.py -> build/lib.linux-x86_64-3.8/dpviewer
running build_ext
-- The C compiler identification is GNU 7.5.0
-- The CXX compiler identification is GNU 7.5.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- The CUDA compiler identification is NVIDIA 11.3.58
-- Check for working CUDA compiler: /usr/local/cuda-11.3/bin/nvcc
-- Check for working CUDA compiler: /usr/local/cuda-11.3/bin/nvcc -- works
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- Automatic GPU detection failed. Building for common architectures.
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - not found
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE
-- Found CUDA: /usr/local/cuda-11.3 (found version "11.3")
-- Caffe2: CUDA detected: 11.3
-- Caffe2: CUDA nvcc is: /usr/local/cuda-11.3/bin/nvcc
-- Caffe2: CUDA toolkit directory: /usr/local/cuda-11.3
-- Caffe2: Header version is: 11.3
-- Found CUDNN: /usr/lib/x86_64-linux-gnu/libcudnn.so
-- Found cuDNN: v8.5.0 (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libcudnn.so)
-- /usr/local/cuda-11.3/lib64/libnvrtc.so shorthash is 8aa72235
-- Autodetected CUDA architecture(s): 7.5
-- Added CUDA NVCC flags for: -gencode;arch=compute_75,code=sm_75
CMake Warning at /home/ddetone/anaconda3/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:22 (message):
static library kineto_LIBRARY-NOTFOUND not found.
Call Stack (most recent call first):
/home/ddetone/anaconda3/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:127 (append_torchlib_if_found)
CMakeLists.txt:24 (find_package)
-- Found Torch: /home/ddetone/anaconda3/lib/python3.8/site-packages/torch/lib/libtorch.so
-- pybind11 v2.10.0 dev1
-- Found PythonInterp: /home/ddetone/anaconda3/bin/python (found suitable version "3.8.3", minimum required is "3.6")
-- Found PythonLibs: /home/ddetone/anaconda3/lib/libpython3.8.so
-- Performing Test HAS_FLTO
-- Performing Test HAS_FLTO - Success
-- Configuring done
CMake Error at pybind11/tools/pybind11Tools.cmake:173 (add_library):
CUDA_STANDARD is set to invalid value '17'
Call Stack (most recent call first):
dpviewer/CMakeLists.txt:8 (pybind11_add_module)
-- Generating done
-- Build files have been written to: /tmp/pip-req-build-tc9s5h7_/build/temp.linux-x86_64-3.8
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/tmp/pip-req-build-tc9s5h7_/setup.py", line 123, in <module>
setup(
File "/home/ddetone/anaconda3/lib/python3.8/site-packages/setuptools/__init__.py", line 165, in setup
return distutils.core.setup(**attrs)
File "/home/ddetone/anaconda3/lib/python3.8/distutils/core.py", line 148, in setup
dist.run_commands()
File "/home/ddetone/anaconda3/lib/python3.8/distutils/dist.py", line 966, in run_commands
self.run_command(cmd)
File "/home/ddetone/anaconda3/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/home/ddetone/anaconda3/lib/python3.8/site-packages/wheel/bdist_wheel.py", line 223, in run
self.run_command('build')
File "/home/ddetone/anaconda3/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/home/ddetone/anaconda3/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/home/ddetone/anaconda3/lib/python3.8/distutils/command/build.py", line 135, in run
self.run_command(cmd_name)
File "/home/ddetone/anaconda3/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/home/ddetone/anaconda3/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/home/ddetone/anaconda3/lib/python3.8/site-packages/setuptools/command/build_ext.py", line 87, in run
_build_ext.run(self)
File "/home/ddetone/anaconda3/lib/python3.8/site-packages/Cython/Distutils/old_build_ext.py", line 186, in run
_build_ext.build_ext.run(self)
File "/home/ddetone/anaconda3/lib/python3.8/distutils/command/build_ext.py", line 340, in run
self.build_extensions()
File "/home/ddetone/anaconda3/lib/python3.8/site-packages/Cython/Distutils/old_build_ext.py", line 195, in build_extensions
_build_ext.build_ext.build_extensions(self)
File "/home/ddetone/anaconda3/lib/python3.8/distutils/command/build_ext.py", line 449, in build_extensions
self._build_extensions_serial()
File "/home/ddetone/anaconda3/lib/python3.8/distutils/command/build_ext.py", line 474, in _build_extensions_serial
self.build_extension(ext)
File "/tmp/pip-req-build-tc9s5h7_/setup.py", line 112, in build_extension
subprocess.check_call(
File "/home/ddetone/anaconda3/lib/python3.8/subprocess.py", line 364, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['cmake', '/tmp/pip-req-build-tc9s5h7_', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/tmp/pip-req-build-tc9s5h7_/build/lib.linux-x86_64-3.8/', '-DPYTHON_EXECUTABLE=/home/ddetone/anaconda3/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DTORCH_PATH=/home/ddetone/anaconda3/lib/python3.8/site-packages/torch', '-DEXAMPLE_VERSION_INFO=0.0.1']' returned non-zero exit status 1.
----------------------------------------
ERROR: Failed building wheel for dpviewer
Running setup.py clean for dpviewer
Failed to build dpviewer
Installing collected packages: dpviewer
Running setup.py install for dpviewer ... error
ERROR: Command errored out with exit status 1:
command: /home/ddetone/anaconda3/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-req-build-tc9s5h7_/setup.py'"'"'; __file__='"'"'/tmp/pip-req-build-tc9s5h7_/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-y5sx2aqq/install-record.txt --single-version-externally-managed --compile --install-headers /home/ddetone/anaconda3/include/python3.8/dpviewer
cwd: /tmp/pip-req-build-tc9s5h7_/
Complete output (111 lines):
running install
running build
running build_py
creating build/lib.linux-x86_64-3.8
creating build/lib.linux-x86_64-3.8/dpviewer
copying dpviewer/__init__.py -> build/lib.linux-x86_64-3.8/dpviewer
running build_ext
-- The C compiler identification is GNU 7.5.0
-- The CXX compiler identification is GNU 7.5.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- The CUDA compiler identification is NVIDIA 11.3.58
-- Check for working CUDA compiler: /usr/local/cuda-11.3/bin/nvcc
-- Check for working CUDA compiler: /usr/local/cuda-11.3/bin/nvcc -- works
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- Automatic GPU detection failed. Building for common architectures.
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - not found
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE
-- Found CUDA: /usr/local/cuda-11.3 (found version "11.3")
-- Caffe2: CUDA detected: 11.3
-- Caffe2: CUDA nvcc is: /usr/local/cuda-11.3/bin/nvcc
-- Caffe2: CUDA toolkit directory: /usr/local/cuda-11.3
-- Caffe2: Header version is: 11.3
-- Found CUDNN: /usr/lib/x86_64-linux-gnu/libcudnn.so
-- Found cuDNN: v8.5.0 (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libcudnn.so)
-- /usr/local/cuda-11.3/lib64/libnvrtc.so shorthash is 8aa72235
-- Autodetected CUDA architecture(s): 7.5
-- Added CUDA NVCC flags for: -gencode;arch=compute_75,code=sm_75
CMake Warning at /home/ddetone/anaconda3/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:22 (message):
static library kineto_LIBRARY-NOTFOUND not found.
Call Stack (most recent call first):
/home/ddetone/anaconda3/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:127 (append_torchlib_if_found)
CMakeLists.txt:24 (find_package)
-- Found Torch: /home/ddetone/anaconda3/lib/python3.8/site-packages/torch/lib/libtorch.so
-- pybind11 v2.10.0 dev1
-- Found PythonInterp: /home/ddetone/anaconda3/bin/python (found suitable version "3.8.3", minimum required is "3.6")
-- Found PythonLibs: /home/ddetone/anaconda3/lib/libpython3.8.so
-- Performing Test HAS_FLTO
-- Performing Test HAS_FLTO - Success
-- Configuring done
CMake Error at pybind11/tools/pybind11Tools.cmake:173 (add_library):
CUDA_STANDARD is set to invalid value '17'
Call Stack (most recent call first):
dpviewer/CMakeLists.txt:8 (pybind11_add_module)
-- Generating done
-- Build files have been written to: /tmp/pip-req-build-tc9s5h7_/build/temp.linux-x86_64-3.8
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/tmp/pip-req-build-tc9s5h7_/setup.py", line 123, in <module>
setup(
File "/home/ddetone/anaconda3/lib/python3.8/site-packages/setuptools/__init__.py", line 165, in setup
return distutils.core.setup(**attrs)
File "/home/ddetone/anaconda3/lib/python3.8/distutils/core.py", line 148, in setup
dist.run_commands()
File "/home/ddetone/anaconda3/lib/python3.8/distutils/dist.py", line 966, in run_commands
self.run_command(cmd)
File "/home/ddetone/anaconda3/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/home/ddetone/anaconda3/lib/python3.8/site-packages/setuptools/command/install.py", line 61, in run
return orig.install.run(self)
File "/home/ddetone/anaconda3/lib/python3.8/distutils/command/install.py", line 545, in run
self.run_command('build')
File "/home/ddetone/anaconda3/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/home/ddetone/anaconda3/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/home/ddetone/anaconda3/lib/python3.8/distutils/command/build.py", line 135, in run
self.run_command(cmd_name)
File "/home/ddetone/anaconda3/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/home/ddetone/anaconda3/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/home/ddetone/anaconda3/lib/python3.8/site-packages/setuptools/command/build_ext.py", line 87, in run
_build_ext.run(self)
File "/home/ddetone/anaconda3/lib/python3.8/site-packages/Cython/Distutils/old_build_ext.py", line 186, in run
_build_ext.build_ext.run(self)
File "/home/ddetone/anaconda3/lib/python3.8/distutils/command/build_ext.py", line 340, in run
self.build_extensions()
File "/home/ddetone/anaconda3/lib/python3.8/site-packages/Cython/Distutils/old_build_ext.py", line 195, in build_extensions
_build_ext.build_ext.build_extensions(self)
File "/home/ddetone/anaconda3/lib/python3.8/distutils/command/build_ext.py", line 449, in build_extensions
self._build_extensions_serial()
File "/home/ddetone/anaconda3/lib/python3.8/distutils/command/build_ext.py", line 474, in _build_extensions_serial
self.build_extension(ext)
File "/tmp/pip-req-build-tc9s5h7_/setup.py", line 112, in build_extension
subprocess.check_call(
File "/home/ddetone/anaconda3/lib/python3.8/subprocess.py", line 364, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['cmake', '/tmp/pip-req-build-tc9s5h7_', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/tmp/pip-req-build-tc9s5h7_/build/lib.linux-x86_64-3.8/', '-DPYTHON_EXECUTABLE=/home/ddetone/anaconda3/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DTORCH_PATH=/home/ddetone/anaconda3/lib/python3.8/site-packages/torch', '-DEXAMPLE_VERSION_INFO=0.0.1']' returned non-zero exit status 1.
----------------------------------------
ERROR: Command errored out with exit status 1: /home/ddetone/anaconda3/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-req-build-tc9s5h7_/setup.py'"'"'; __file__='"'"'/tmp/pip-req-build-tc9s5h7_/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-y5sx2aqq/install-record.txt --single-version-externally-managed --compile --install-headers /home/ddetone/anaconda3/include/python3.8/dpviewer Check the logs for full command output.
I'll give the docker a go too, see if I can get that working
I got it working with docker yay! I guess I can close this.
I haven't come across this error, but one thing to try might be re-downloading a tarball of cudnn from the nvidia website and overriding the cudnn filepaths in cmake by setting
export CMAKE_ARGS="-DCUDNN_LIBRARY_PATH=<unzipped-tarball>/lib -DCUDNN_INCLUDE_PATH=<unzipped-tarball>/include"
before running
pip install ./DPViewer
Thank you so much! Yes. I solved the problem this way and installed dpviewer successfully.
` subprocess.CalledProcessError: Command '['cmake', '/home/lzy/workingspace/DPVO/DPViewer', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/lzy/workingspace/DPVO/DPViewer/build/lib.linux-x86_64-cpython-310/', '-DPYTHON_EXECUTABLE=/home/lzy/miniconda3/envs/dpvo/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DTORCH_PATH=/home/lzy/miniconda3/envs/dpvo/lib/python3.10/site-packages/torch', '-DEXAMPLE_VERSION_INFO=0.0.1']' returned non-zero exit status 1. [end of output]
note: This error originates from a subprocess, and is likely not a problem with pip. error: legacy-install-failure
× Encountered error while trying to install package. ╰─> dpviewer
note: This is an issue with the package mentioned above, not pip. hint: See above for output from the failure. `
Then , it is fixed as
(dpvo) lzy@lzy:~/workingspace/DPVO$ export CMAKE_ARGS="-DCUDNN_LIBRARY_PATH=/home/lzy/Downloads/cudnn-linux-x86_64-8.5.0.96_cuda11-archive/lib -DCUDNN_INCLUDE_PATH=/home/lzy/Downloads/cudnn-linux-x86_64-8.5.0.96_cuda11-archive/include" (dpvo) lzy@lzy:~/workingspace/DPVO$ pip install ./DPViewer Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Processing ./DPViewer Preparing metadata (setup.py) ... done Building wheels for collected packages: dpviewer Building wheel for dpviewer (setup.py) ... done Created wheel for dpviewer: filename=dpviewer-0.0.1-cp310-cp310-linux_x86_64.whl size=82191 sha256=bfc18886df66bda84751d3987bb3e2fdb83db3898d681d5bb6fcc881006c8d93 Stored in directory: /tmp/pip-ephem-wheel-cache-ttgn7c1w/wheels/03/cf/4c/781dad81380ee0347fa94f4a3fee558d68aef9521636a5a0c2 Successfully built dpviewer Installing collected packages: dpviewer Successfully installed dpviewer-0.0.1
And I have successfully run the demo 'iphone'. I'll try to train the dpvo.
I'm a little stuck at this point in the setup:
I get the following message:
Any ideas? Maybe something wrong with my cudnn install?