search

pytorch / audio

Data manipulation and transformation for audio signal processing, powered by PyTorch
https://pytorch.org/audio
BSD 2-Clause "Simplified" License
2.44k stars 636 forks source link

torchaudio build not working #3703

Open jdgh000 opened 8 months ago

jdgh000 commented 8 months ago

🐛 Describe the bug

I kept getting following errors, can someone shed a light? I can' see any hint of logs etc.,


rm -rf build ; CXX=hipcc  USE_FFMPEG=0 USE_ROCM=1 USE_CUDA=0 BUILD_SOX=0 BUILD_KALDI=0 BUILD_RNNT=0 python3 setup.py develop

- Git branch: main
-- Git SHA: ccd78ffba3208b4a9f5face4bd76e942ddc2d4a3
-- Git tag: None
-- PyTorch dependency: torch
-- Building version 2.2.0a0+ccd78ff
running develop
running egg_info
writing src/torchaudio.egg-info/PKG-INFO
writing dependency_links to src/torchaudio.egg-info/dependency_links.txt
writing requirements to src/torchaudio.egg-info/requires.txt
writing top-level names to src/torchaudio.egg-info/top_level.txt
reading manifest file 'src/torchaudio.egg-info/SOURCES.txt'
adding license file 'LICENSE'
writing manifest file 'src/torchaudio.egg-info/SOURCES.txt'
running build_ext
-- The C compiler identification is GNU 11.4.1
-- The CXX compiler identification is Clang 17.0.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/bin/cc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/hipcc - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Found HIP: /opt/rocm-5.7.1/hip (found suitable version "5.7.31921-1949b1621", minimum required is "1.0")
-- Performing Test HIP_CLANG_SUPPORTS_PARALLEL_JOBS
-- Performing Test HIP_CLANG_SUPPORTS_PARALLEL_JOBS - Success
HIP VERSION: 5.7.31921-1949b1621
CMake Error at cmake/LoadHIP.cmake:149 (file):
  file failed to open for reading (No such file or directory):

    /opt/rocm/.info/version-dev
Call Stack (most recent call first):
  CMakeLists.txt:75 (include)

CMake Error at cmake/LoadHIP.cmake:150 (string):
  string sub-command REGEX, mode MATCH needs at least 5 arguments total to
  command.
Call Stack (most recent call first):
  CMakeLists.txt:75 (include)

***** ROCm version from /opt/rocm/.info/version-dev ****

ROCM_VERSION_DEV:
ROCM_VERSION_DEV_MAJOR:
ROCM_VERSION_DEV_MINOR:
ROCM_VERSION_DEV_PATCH:

***** Library versions from dpkg *****

***** Library versions from cmake find_package *****

CMake Deprecation Warning at /opt/rocm/hip/lib/cmake/hip/hip-config.cmake:20 (cmake_minimum_required):
  Compatibility with CMake < 3.5 will be removed from a future version of
  CMake.

  Update the VERSION argument <min> value or use a ...<max> suffix to tell
  CMake that the project does not need compatibility with older versions.
Call Stack (most recent call first):
  cmake/LoadHIP.cmake:138 (find_package)
  cmake/LoadHIP.cmake:194 (find_package_and_print_version)
  CMakeLists.txt:75 (include)

CMake Deprecation Warning at /opt/rocm-5.7.1/lib/cmake/hip/hip-config-amd.cmake:21 (cmake_minimum_required):
  Compatibility with CMake < 3.5 will be removed from a future version of
  CMake.

  Update the VERSION argument <min> value or use a ...<max> suffix to tell
  CMake that the project does not need compatibility with older versions.
Call Stack (most recent call first):
  /opt/rocm/hip/lib/cmake/hip/hip-config.cmake:150 (include)
  cmake/LoadHIP.cmake:138 (find_package)
  cmake/LoadHIP.cmake:194 (find_package_and_print_version)
  CMakeLists.txt:75 (include)

-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
-- Found Threads: TRUE
-- hip::amdhip64 is SHARED_LIBRARY
hip VERSION: 5.7.23384
hsa-runtime64 VERSION: 1.11.50701
amd_comgr VERSION: 2.5.0
CMake Deprecation Warning at /opt/rocm/hip/lib/cmake/hip/hip-config.cmake:20 (cmake_minimum_required):
  Compatibility with CMake < 3.5 will be removed from a future version of
  CMake.

  Update the VERSION argument <min> value or use a ...<max> suffix to tell
  CMake that the project does not need compatibility with older versions.
Call Stack (most recent call first):
  /usr/local/lib64/python3.9/site-packages/cmake/data/share/cmake-3.27/Modules/CMakeFindDependencyMacro.cmake:76 (find_package)
  /opt/rocm/lib/cmake/rocrand/rocrand-config.cmake:90 (find_dependency)
  cmake/LoadHIP.cmake:138 (find_package)
  cmake/LoadHIP.cmake:197 (find_package_and_print_version)
  CMakeLists.txt:75 (include)

CMake Deprecation Warning at /opt/rocm-5.7.1/lib/cmake/hip/hip-config-amd.cmake:21 (cmake_minimum_required):
  Compatibility with CMake < 3.5 will be removed from a future version of
  CMake.

  Update the VERSION argument <min> value or use a ...<max> suffix to tell
  CMake that the project does not need compatibility with older versions.
Call Stack (most recent call first):
  /opt/rocm/hip/lib/cmake/hip/hip-config.cmake:150 (include)
  /usr/local/lib64/python3.9/site-packages/cmake/data/share/cmake-3.27/Modules/CMakeFindDependencyMacro.cmake:76 (find_package)
  /opt/rocm/lib/cmake/rocrand/rocrand-config.cmake:90 (find_dependency)
  cmake/LoadHIP.cmake:138 (find_package)
  cmake/LoadHIP.cmake:197 (find_package_and_print_version)
  CMakeLists.txt:75 (include)

-- hip::amdhip64 is SHARED_LIBRARY
rocrand VERSION: 2.10.17
hiprand VERSION: 2.10.16
rocblas VERSION: 3.1.0
miopen VERSION: 2.20.0
rocfft VERSION: 1.0.23
hipsparse VERSION: 2.3.8
CMake Deprecation Warning at /opt/rocm/hip/lib/cmake/hip/hip-config.cmake:20 (cmake_minimum_required):
  Compatibility with CMake < 3.5 will be removed from a future version of
  CMake.

  Update the VERSION argument <min> value or use a ...<max> suffix to tell
  CMake that the project does not need compatibility with older versions.
Call Stack (most recent call first):
  /usr/local/lib64/python3.9/site-packages/cmake/data/share/cmake-3.27/Modules/CMakeFindDependencyMacro.cmake:76 (find_package)
  /opt/rocm/lib/cmake/rccl/rccl-config.cmake:90 (find_dependency)
  cmake/LoadHIP.cmake:138 (find_package)
  cmake/LoadHIP.cmake:206 (find_package_and_print_version)
  CMakeLists.txt:75 (include)

CMake Deprecation Warning at /opt/rocm-5.7.1/lib/cmake/hip/hip-config-amd.cmake:21 (cmake_minimum_required):
  Compatibility with CMake < 3.5 will be removed from a future version of
  CMake.

  Update the VERSION argument <min> value or use a ...<max> suffix to tell
  CMake that the project does not need compatibility with older versions.
Call Stack (most recent call first):
  /opt/rocm/hip/lib/cmake/hip/hip-config.cmake:150 (include)
  /usr/local/lib64/python3.9/site-packages/cmake/data/share/cmake-3.27/Modules/CMakeFindDependencyMacro.cmake:76 (find_package)
  /opt/rocm/lib/cmake/rccl/rccl-config.cmake:90 (find_dependency)
  cmake/LoadHIP.cmake:138 (find_package)
  cmake/LoadHIP.cmake:206 (find_package_and_print_version)
  CMakeLists.txt:75 (include)

-- hip::amdhip64 is SHARED_LIBRARY
rccl VERSION: 2.17.1
rocprim VERSION: 2.13.1
hipcub VERSION: 2.13.1
rocthrust VERSION: 2.18.0
HIP library name: amdhip64
Building PyTorch for GPU arch: gfx90a
-- Found HIP: /opt/rocm-5.7.1/hip (found suitable version "5.7.31921-1949b1621", minimum required is "1.0")
HIP VERSION: 5.7.31921-1949b1621
-- Caffe2: Header version is: 5.7.1

***** ROCm version from rocm_version.h ****

ROCM_VERSION_DEV: 5.7.1
ROCM_VERSION_DEV_MAJOR: 5
ROCM_VERSION_DEV_MINOR: 7
ROCM_VERSION_DEV_PATCH: 1
ROCM_VERSION_DEV_INT:   50701
HIP_VERSION_MAJOR: 5
HIP_VERSION_MINOR: 7
TORCH_HIP_VERSION: 507

***** Library versions from dpkg *****

***** Library versions from cmake find_package *****

CMake Deprecation Warning at /opt/rocm/lib/cmake/hip/hip-config.cmake:20 (cmake_minimum_required):
  Compatibility with CMake < 3.5 will be removed from a future version of
  CMake.

  Update the VERSION argument <min> value or use a ...<max> suffix to tell
  CMake that the project does not need compatibility with older versions.
Call Stack (most recent call first):
  /root/gg/git/pytorch/torch/share/cmake/Caffe2/public/LoadHIP.cmake:154 (find_package)
  /root/gg/git/pytorch/torch/share/cmake/Caffe2/public/LoadHIP.cmake:279 (find_package_and_print_version)
  /root/gg/git/pytorch/torch/share/cmake/Caffe2/Caffe2Config.cmake:74 (include)
  /root/gg/git/pytorch/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)
  cmake/TorchAudioHelper.cmake:1 (find_package)
  CMakeLists.txt:93 (include)

CMake Deprecation Warning at /opt/rocm/lib/cmake/hip/hip-config-amd.cmake:21 (cmake_minimum_required):
  Compatibility with CMake < 3.5 will be removed from a future version of
  CMake.

  Update the VERSION argument <min> value or use a ...<max> suffix to tell
  CMake that the project does not need compatibility with older versions.
Call Stack (most recent call first):
  /opt/rocm/lib/cmake/hip/hip-config.cmake:150 (include)
  /root/gg/git/pytorch/torch/share/cmake/Caffe2/public/LoadHIP.cmake:154 (find_package)
  /root/gg/git/pytorch/torch/share/cmake/Caffe2/public/LoadHIP.cmake:279 (find_package_and_print_version)
  /root/gg/git/pytorch/torch/share/cmake/Caffe2/Caffe2Config.cmake:74 (include)
  /root/gg/git/pytorch/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)
  cmake/TorchAudioHelper.cmake:1 (find_package)
  CMakeLists.txt:93 (include)

-- hip::amdhip64 is SHARED_LIBRARY
hip VERSION: 5.7.23384
hsa-runtime64 VERSION: 1.11.50701
amd_comgr VERSION: 2.5.0
rocrand VERSION: 2.10.17
hiprand VERSION: 2.10.16
rocblas VERSION: 3.1.0
hipblas VERSION: 1.1.0
miopen VERSION: 2.20.0
hipfft VERSION: 1.0.12
hipsparse VERSION: 2.3.8
rccl VERSION: 2.17.1
rocprim VERSION: 2.13.1
hipcub VERSION: 2.13.1
rocthrust VERSION: 2.18.0
hipsolver VERSION: 1.8.2
-- Found Torch: /root/gg/git/pytorch/torch/lib/libtorch.so
-- Found OpenMP_C: -fopenmp (found version "4.5")
-- Found OpenMP_CXX: -fopenmp=libomp
-- Found OpenMP: TRUE (found version "4.5")
-- Found ccache
-- Configuring incomplete, errors occurred!
Traceback (most recent call last):
  File "/root/gg/git/audio/setup.py", line 143, in <module>
    _main()
  File "/root/gg/git/audio/setup.py", line 99, in _main
    setup(
  File "/usr/lib/python3.9/site-packages/setuptools/__init__.py", line 153, in setup
    return distutils.core.setup(**attrs)
  File "/usr/lib64/python3.9/distutils/core.py", line 148, in setup
    dist.run_commands()
  File "/usr/lib64/python3.9/distutils/dist.py", line 966, in run_commands
    self.run_command(cmd)
  File "/usr/lib64/python3.9/distutils/dist.py", line 985, in run_command
    cmd_obj.run()
  File "/usr/lib/python3.9/site-packages/setuptools/command/develop.py", line 34, in run
    self.install_for_development()
  File "/usr/lib/python3.9/site-packages/setuptools/command/develop.py", line 136, in install_for_development
    self.run_command('build_ext')
  File "/usr/lib64/python3.9/distutils/cmd.py", line 313, in run_command
    self.distribution.run_command(command)
  File "/usr/lib64/python3.9/distutils/dist.py", line 985, in run_command
    cmd_obj.run()
  File "/root/gg/git/audio/tools/setup_helpers/extension.py", line 99, in run
    super().run()
  File "/usr/lib/python3.9/site-packages/setuptools/command/build_ext.py", line 79, in run
    _build_ext.run(self)
  File "/usr/lib64/python3.9/distutils/command/build_ext.py", line 340, in run
    self.build_extensions()
  File "/usr/lib64/python3.9/distutils/command/build_ext.py", line 449, in build_extensions
    self._build_extensions_serial()
  File "/usr/lib64/python3.9/distutils/command/build_ext.py", line 474, in _build_extensions_serial
    self.build_extension(ext)
  File "/root/gg/git/audio/tools/setup_helpers/extension.py", line 182, in build_extension
    subprocess.check_call(["cmake", str(_ROOT_DIR)] + cmake_args, cwd=self.build_temp)
  File "/usr/lib64/python3.9/subprocess.py", line 373, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['cmake', '/root/gg/git/audio', '-DCMAKE_BUILD_TYPE=Release', '-DCMAKE_PREFIX_PATH=/root/gg/git/pytorch/torch/share/cmake', '-DCMAKE_INSTALL_PREFIX=/root/gg/git/audio/build/lib.linux-x86_64-3.9/', '-DCMAKE_VERBOSE_MAKEFILE=ON', '-DPython_INCLUDE_DIR=/usr/include/python3.9', '-DBUILD_CPP_TEST=OFF', '-DBUILD_SOX:BOOL=OFF', '-DBUILD_RIR:BOOL=ON', '-DBUILD_RNNT:BOOL=OFF', '-DBUILD_ALIGN:BOOL=ON', '-DBUILD_CUDA_CTC_DECODER:BOOL=OFF', '-DBUILD_TORCHAUDIO_PYTHON_EXTENSION:BOOL=ON', '-DBUILD_TORIO_PYTHON_EXTENSION:BOOL=ON', '-DUSE_ROCM:BOOL=ON', '-DUSE_CUDA:BOOL=OFF', '-DUSE_OPENMP:BOOL=ON', '-DUSE_FFMPEG:BOOL=OFF', '-GNinja']' returned non-zero exit status 1.

Versions

ROCm5.7