Closed MisakaMikoto96 closed 1 year ago
csukuangfj
commented
1 year ago Looks like you have installed multiple versions of CUDA toolkit.
Please refer to https://k2-fsa.github.io/k2/installation/cuda-cudnn.html to install cuda toolkit and cuDNN.
Make sure that you have set up the environment variables correctly by following the above doc.
Also make sure to remove the build directory before you re-build k2.
MisakaMikoto96
commented
1 year ago Looks like you have installed multiple versions of CUDA toolkit.
Please refer to https://k2-fsa.github.io/k2/installation/cuda-cudnn.html to install cuda toolkit and cuDNN.
Make sure that you have set up the environment variables correctly by following the above doc.
Also make sure to remove the
builddirectory before you re-build k2.
hi, thanks for your reply, i have multiple cuda versions but set 10.2 in ~/.bashrc, I do not know why the log show me that - Caffe2: CUDA detected: 9.1 (even I did not install this version)
MisakaMikoto96
commented
1 year ago Looks like you have installed multiple versions of CUDA toolkit.
Please refer to https://k2-fsa.github.io/k2/installation/cuda-cudnn.html to install cuda toolkit and cuDNN.
Make sure that you have set up the environment variables correctly by following the above doc.
Also make sure to remove the
builddirectory before you re-build k2.
I will try your recipe first, thank u so much.
MisakaMikoto96
commented
1 year ago Looks like you have installed multiple versions of CUDA toolkit.
Please refer to https://k2-fsa.github.io/k2/installation/cuda-cudnn.html to install cuda toolkit and cuDNN.
Make sure that you have set up the environment variables correctly by following the above doc.
Also make sure to remove the
builddirectory before you re-build k2.
hi, I set up the environment variables follow your document but also get:
-- Found CUDA: /mnt/sdb/saikidee/cuda-10.2 (found version "10.2")
-- The CUDA compiler identification is unknown
-- Check for working CUDA compiler: /usr/bin/nvcc
-- Check for working CUDA compiler: /usr/bin/nvcc -- broken
CMake Error at /usr/share/cmake-3.10/Modules/CMakeTestCUDACompiler.cmake:46 (message):
The CUDA compiler
"/usr/bin/nvcc"
is not able to compile a simple test program.
It fails with the following output:
Change Dir: /mnt/sdb/saikidee/k2/build/temp.linux-x86_64-3.7/CMakeFiles/CMakeTmp
Run Build Command:"/usr/bin/make" "cmTC_082d5/fast"
/usr/bin/make -f CMakeFiles/cmTC_082d5.dir/build.make CMakeFiles/cmTC_082d5.dir/build
make[1]: Entering directory '/mnt/sdb/saikidee/k2/build/temp.linux-x86_64-3.7/CMakeFiles/CMakeTmp'
Building CUDA object CMakeFiles/cmTC_082d5.dir/main.cu.o
/usr/bin/nvcc -x cu -c /mnt/sdb/saikidee/k2/build/temp.linux-x86_64-3.7/CMakeFiles/CMakeTmp/main.cu -o CMakeFiles/cmTC_082d5.dir/main.cu.o
nvcc fatal : Path to libdevice library not specified
CMakeFiles/cmTC_082d5.dir/build.make:65: recipe for target 'CMakeFiles/cmTC_082d5.dir/main.cu.o' failed
make[1]: *** [CMakeFiles/cmTC_082d5.dir/main.cu.o] Error 1
make[1]: Leaving directory '/mnt/sdb/saikidee/k2/build/temp.linux-x86_64-3.7/CMakeFiles/CMakeTmp'
Makefile:126: recipe for target 'cmTC_082d5/fast' failed
make: *** [cmTC_082d5/fast] Error 2
What is the output of
which gccWhat is the output of
which gcc
which gcc
>> /usr/bin/gccand i change the compiler path in CMakeLists.txt and is running now
if (NOT CMAKE_CUDA_COMPILER)
set(CMAKE_CUDA_COMPILER "$the_cuda_path_i_download_from_your_doc")
endif()waiting ...
Using /home/saikidee/anaconda3/envs/nvidiaT2/lib/python3.7/site-packages
Finished processing dependencies for k2==1.23.4.dev20230210+cpu.torch1.12.0seems Done successfully?? 🎉
csukuangfj
commented
1 year ago Congratulations! You have installed k2 from source successfully.
MisakaMikoto96
commented
1 year ago Congratulations! You have installed k2 from source successfully.
https://k2-fsa.github.io/k2/installation/cuda-cudnn.html#cuda-11-6 hi, I find a new problem in your doc that cuda11.6 match cudnn8.2.0
my torch version to match cuda 11.6 below⬇️：
torch==1.12.0+cu116 \ torchaudio==0.12.0+cu116 \ torchvision==0.13.0+cu116
when I import torch and run
it shows：
RuntimeError: cuDNN version incompatibility: PyTorch was compiled against (8, 3, 2) but linked against (8, 2, 0)
seems the cudnn should be updated to 8.3.2?
how can I fix that?
thanks for your time!
MisakaMikoto96
commented
1 year ago resolve this problem by using cuda 11.5
kin0303
commented
1 year ago I got this error too, Can you help to fix my errors too? @csukuangfj
CUDA Version:
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2019 NVIDIA Corporation
Built on Wed_Oct_23_19:24:38_PDT_2019
Cuda compilation tools, release 10.2, V10.2.89and the error:
python setup.py installrunning install
running bdist_egg
running egg_info
creating k2.egg-info
writing k2.egg-info/PKG-INFO
writing dependency_links to k2.egg-info/dependency_links.txt
writing requirements to k2.egg-info/requires.txt
writing top-level names to k2.egg-info/top_level.txt
writing manifest file 'k2.egg-info/SOURCES.txt'
Generating grammar tables from /usr/lib/python3.8/lib2to3/Grammar.txt
Generating grammar tables from /usr/lib/python3.8/lib2to3/PatternGrammar.txt
reading manifest file 'k2.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
writing manifest file 'k2.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
creating build
creating build/lib.linux-x86_64-3.8
creating build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/autograd.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/autograd_utils.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/ctc_loss.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/decode.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/dense_fsa_vec.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/fsa.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/fsa_algo.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/fsa_properties.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/mutual_information.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/mwer_loss.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/nbest.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/online_dense_intersecter.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/ops.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/rnnt_decode.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/rnnt_loss.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/symbol_table.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/utils.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/__init__.py -> build/lib.linux-x86_64-3.8/k2
creating build/lib.linux-x86_64-3.8/k2/ragged
copying k2/python/k2/ragged/__init__.py -> build/lib.linux-x86_64-3.8/k2/ragged
creating build/lib.linux-x86_64-3.8/k2/sparse
copying k2/python/k2/sparse/autograd.py -> build/lib.linux-x86_64-3.8/k2/sparse
copying k2/python/k2/sparse/__init__.py -> build/lib.linux-x86_64-3.8/k2/sparse
creating build/lib.linux-x86_64-3.8/k2/version
copying k2/python/k2/version/version.py -> build/lib.linux-x86_64-3.8/k2/version
copying k2/python/k2/version/__init__.py -> build/lib.linux-x86_64-3.8/k2/version
copying k2/python/k2/version/__main__.py -> build/lib.linux-x86_64-3.8/k2/version
running build_ext
cmake_path: /usr/bin/cmake
Setting PYTHON_EXECUTABLE to /media/7A76476176471D6F/VALL-E/valle_env/bin/python
build command is:
cd build/temp.linux-x86_64-3.8
cmake -DK2_WITH_CUDA=OFF -DPYTHON_EXECUTABLE=/media/7A76476176471D6F/VALL-E/valle_env/bin/python -DK2_ENABLE_BENCHMARK=OFF -DK2_ENABLE_TESTS=OFF -DCMAKE_INSTALL_PREFIX=/media/7A76476176471D6F/VALL-E/k2/build/lib.linux-x86_64-3.8/k2 /media/7A76476176471D6F/VALL-E/k2
cat k2/csrc/version.h
make -j12 install
-- CMAKE_VERSION: 3.16.3
-- Disable CUDA support
-- Enabled languages: CXX
-- The CXX compiler identification is GNU 9.4.0
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- No CMAKE_BUILD_TYPE given, default to Release
-- Set K2_ENABLE_NVTX to OFF since K2_WITH_CUDA is OFF
-- K2_OS: Ubuntu 20.04.5 LTS
-- Found Git: /usr/bin/git (found version "2.25.1")
-- Looking for C++ include cxxabi.h
-- Looking for C++ include cxxabi.h - found
-- Looking for C++ include execinfo.h
-- Looking for C++ include execinfo.h - found
-- Performing Test K2_COMPILER_SUPPORTS_CXX14
-- Performing Test K2_COMPILER_SUPPORTS_CXX14 - Success
-- C++ Standard version: 14
-- Could NOT find Valgrind (missing: Valgrind_INCLUDE_DIR Valgrind_EXECUTABLE)
-- Downloading pybind11 from https://github.com/pybind/pybind11/archive/5bc0943ed96836f46489f53961f6c438d2935357.zip
-- pybind11 is downloaded to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/pybind11-src
-- pybind11 v2.11.0 dev1
-- Found PythonInterp: /media/7A76476176471D6F/VALL-E/valle_env/bin/python (found suitable version "3.8.10", minimum required is "3.6")
-- Found PythonLibs: /usr/lib/x86_64-linux-gnu/libpython3.8.so
-- Performing Test HAS_FLTO
-- Performing Test HAS_FLTO - Success
-- Python executable: /media/7A76476176471D6F/VALL-E/valle_env/bin/python
-- Looking for C++ include pthread.h
-- Looking for C++ include pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE
-- Found CUDA: /usr/local/cuda-10.2 (found version "10.2")
-- The CUDA compiler identification is unknown
-- Check for working CUDA compiler: /usr/local/cuda-10.2/bin/nvcc
-- Check for working CUDA compiler: /usr/local/cuda-10.2/bin/nvcc -- broken
CMake Error at /usr/share/cmake-3.16/Modules/CMakeTestCUDACompiler.cmake:46 (message):
The CUDA compiler
"/usr/local/cuda-10.2/bin/nvcc"
is not able to compile a simple test program.
It fails with the following output:
Change Dir: /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/CMakeFiles/CMakeTmp
Run Build Command(s):/usr/bin/make cmTC_137e7/fast && /usr/bin/make -f CMakeFiles/cmTC_137e7.dir/build.make CMakeFiles/cmTC_137e7.dir/build
make[1]: Entering directory '/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/CMakeFiles/CMakeTmp'
Building CUDA object CMakeFiles/cmTC_137e7.dir/main.cu.o
/usr/local/cuda-10.2/bin/nvcc -x cu -c /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/CMakeFiles/CMakeTmp/main.cu -o CMakeFiles/cmTC_137e7.dir/main.cu.o
In file included from /usr/local/cuda-10.2/bin/../targets/x86_64-linux/include/cuda_runtime.h:83,
from <command-line>:
/usr/local/cuda-10.2/bin/../targets/x86_64-linux/include/crt/host_config.h:138:2: error: #error -- unsupported GNU version! gcc versions later than 8 are not supported!
138 | #error -- unsupported GNU version! gcc versions later than 8 are not supported!
| ^~~~~
make[1]: *** [CMakeFiles/cmTC_137e7.dir/build.make:66: CMakeFiles/cmTC_137e7.dir/main.cu.o] Error 1
make[1]: Leaving directory '/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/CMakeFiles/CMakeTmp'
make: *** [Makefile:121: cmTC_137e7/fast] Error 2
CMake will not be able to correctly generate this project.
Call Stack (most recent call first):
/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:47 (enable_language)
/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:92 (include)
/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)
cmake/torch.cmake:11 (find_package)
CMakeLists.txt:292 (include)
-- Configuring incomplete, errors occurred!
See also "/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/CMakeFiles/CMakeOutput.log".
See also "/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/CMakeFiles/CMakeError.log".
cat: k2/csrc/version.h: No such file or directory
make: *** No rule to make target 'install'. Stop.
Traceback (most recent call last):
File "setup.py", line 234, in <module>
setuptools.setup(
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/__init__.py", line 145, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python3.8/distutils/core.py", line 148, in setup
dist.run_commands()
File "/usr/lib/python3.8/distutils/dist.py", line 966, in run_commands
self.run_command(cmd)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/install.py", line 67, in run
self.do_egg_install()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/install.py", line 109, in do_egg_install
self.run_command('bdist_egg')
File "/usr/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/bdist_egg.py", line 172, in run
cmd = self.call_command('install_lib', warn_dir=0)
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/bdist_egg.py", line 158, in call_command
self.run_command(cmdname)
File "/usr/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/install_lib.py", line 23, in run
self.build()
File "/usr/lib/python3.8/distutils/command/install_lib.py", line 109, in build
self.run_command('build_ext')
File "/usr/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/build_ext.py", line 84, in run
_build_ext.run(self)
File "/usr/lib/python3.8/distutils/command/build_ext.py", line 340, in run
self.build_extensions()
File "/usr/lib/python3.8/distutils/command/build_ext.py", line 449, in build_extensions
self._build_extensions_serial()
File "/usr/lib/python3.8/distutils/command/build_ext.py", line 474, in _build_extensions_serial
self.build_extension(ext)
File "setup.py", line 206, in build_extension
raise Exception("Failed to build k2")
Exception: Failed to build k2From the error log
-- The CXX compiler identification is GNU 9.4.0
/usr/local/cuda-10.2/bin/../targets/x86_64-linux/include/crt/host_config.h:138:2: error: #error -- unsupported GNU version! gcc versions later than 8 are not supported!
138 | #error -- unsupported GNU version! gcc versions later than 8 are not supported!
| ^~~~~
make[1]: *** [CMakeFiles/cmTC_137e7.dir/build.make:66: CMakeFiles/cmTC_137e7.dir/main.cu.o] Error 1Please either switch to a lower version of GCC, e.g., GCC 7.5 or upgrade your CUDA toolkit.
CUDA 10.2 does not support GCC 9.4.0
Please see https://docs.nvidia.com/cuda/archive/10.2/cuda-installation-guide-linux/index.html
kin0303
commented
1 year ago Please either switch to a lower version of GCC, e.g., GCC 7.5 or upgrade your CUDA toolkit.
Okay, I'll try that and I'll update the progress. Thank you so much
kin0303
commented
1 year ago Hi @csukuangfj, I've tried that, but still error
gcc --version
gcc (Ubuntu 7.5.0-6ubuntu2) 7.5.0
Copyright (C) 2017 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.running install
running bdist_egg
running egg_info
writing k2.egg-info/PKG-INFO
writing dependency_links to k2.egg-info/dependency_links.txt
writing requirements to k2.egg-info/requires.txt
writing top-level names to k2.egg-info/top_level.txt
Generating grammar tables from /usr/lib/python3.8/lib2to3/Grammar.txt
Generating grammar tables from /usr/lib/python3.8/lib2to3/PatternGrammar.txt
reading manifest file 'k2.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
writing manifest file 'k2.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
copying k2/python/k2/__init__.py -> build/lib.linux-x86_64-3.8/k2
running build_ext
cmake_path: /usr/bin/cmake
Setting PYTHON_EXECUTABLE to /media/VALL-E/valle_env/bin/python
build command is:
cd build/temp.linux-x86_64-3.8
cmake -DK2_WITH_CUDA=OFF -DPYTHON_EXECUTABLE=/media/VALL-E/valle_env/bin/python -DK2_ENABLE_BENCHMARK=OFF -DK2_ENABLE_TESTS=OFF -DCMAKE_INSTALL_PREFIX=/media/VALL-E/k2/build/lib.linux-x86_64-3.8/k2 /media/VALL-E/k2
cat k2/csrc/version.h
make -j12 install
-- CMAKE_VERSION: 3.16.3
-- Disable CUDA support
-- Enabled languages: CXX
-- No CMAKE_BUILD_TYPE given, default to Release
-- Set K2_ENABLE_NVTX to OFF since K2_WITH_CUDA is OFF
-- K2_OS: Ubuntu 20.04.5 LTS
-- C++ Standard version: 14
-- Could NOT find Valgrind (missing: Valgrind_INCLUDE_DIR Valgrind_EXECUTABLE)
-- Downloading pybind11 from https://github.com/pybind/pybind11/archive/5bc0943ed96836f46489f53961f6c438d2935357.zip
-- pybind11 is downloaded to /media/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/pybind11-src
-- pybind11 v2.11.0 dev1
-- Python executable: /media/VALL-E/valle_env/bin/python
-- The CUDA compiler identification is unknown
CMake Error at /media/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:47 (enable_language):
The CMAKE_CUDA_COMPILER:
/usr/local/cuda-10.2/bin/nvcc
is not a full path to an existing compiler tool.
Tell CMake where to find the compiler by setting either the environment
variable "CUDACXX" or the CMake cache entry CMAKE_CUDA_COMPILER to the full
path to the compiler, or to the compiler name if it is in the PATH.
Call Stack (most recent call first):
/media/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:92 (include)
/media/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)
cmake/torch.cmake:11 (find_package)
CMakeLists.txt:292 (include)
-- Configuring incomplete, errors occurred!
See also "/media/VALL-E/k2/build/temp.linux-x86_64-3.8/CMakeFiles/CMakeOutput.log".
See also "/media/VALL-E/k2/build/temp.linux-x86_64-3.8/CMakeFiles/CMakeError.log".
cat: k2/csrc/version.h: No such file or directory
make: *** No rule to make target 'install'. Stop.
Traceback (most recent call last):
File "setup.py", line 234, in <module>
setuptools.setup(
File "/media/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/__init__.py", line 145, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python3.8/distutils/core.py", line 148, in setup
dist.run_commands()
File "/usr/lib/python3.8/distutils/dist.py", line 966, in run_commands
self.run_command(cmd)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/install.py", line 67, in run
self.do_egg_install()
File "/media/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/install.py", line 109, in do_egg_install
self.run_command('bdist_egg')
File "/usr/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/bdist_egg.py", line 172, in run
cmd = self.call_command('install_lib', warn_dir=0)
File "/media/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/bdist_egg.py", line 158, in call_command
self.run_command(cmdname)
File "/usr/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/install_lib.py", line 23, in run
self.build()
File "/usr/lib/python3.8/distutils/command/install_lib.py", line 109, in build
self.run_command('build_ext')
File "/usr/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/build_ext.py", line 84, in run
_build_ext.run(self)
File "/usr/lib/python3.8/distutils/command/build_ext.py", line 340, in run
self.build_extensions()
File "/usr/lib/python3.8/distutils/command/build_ext.py", line 449, in build_extensions
self._build_extensions_serial()
File "/usr/lib/python3.8/distutils/command/build_ext.py", line 474, in _build_extensions_serial
self.build_extension(ext)
File "setup.py", line 206, in build_extension
raise Exception("Failed to build k2")
Exception: Failed to build k2Hi @csukuangfj, I've tried that, but still error
Could you delete the build directory and run it again?
I need the log of your first run.
The logs you posted don't come from the first run.
csukuangfj
commented
1 year ago By the way, could you describe how you install cudatoolkit and cuDNN?
Did you follow https://k2-fsa.github.io/k2/installation/cuda-cudnn.html ?
kin0303
commented
1 year ago Hi @csukuangfj, I've tried that, but still error
Could you delete the build directory and run it again?
I need the log of your first run.
The logs you posted don't come from the first run.
I've tried that, but still error. My gcc version 7.5.0
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/7/lto-wrapper
OFFLOAD_TARGET_NAMES=nvptx-none
OFFLOAD_TARGET_DEFAULT=1
Target: x86_64-linux-gnu
Configured with: ../src/configure -v --with-pkgversion='Ubuntu 7.5.0-6ubuntu2' --with-bugurl=file:///usr/share/doc/gcc-7/README.Bugs --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --prefix=/usr --with-gcc-major-version-only --program-suffix=-7 --program-prefix=x86_64-linux-gnu- --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --libdir=/usr/lib --enable-nls --enable-bootstrap --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new --enable-gnu-unique-object --disable-vtable-verify --enable-libmpx --enable-plugin --enable-default-pie --with-system-zlib --with-target-system-zlib --enable-objc-gc=auto --enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64 --with-multilib-list=m32,m64,mx32 --enable-multilib --with-tune=generic --enable-offload-targets=nvptx-none --without-cuda-driver --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=x86_64-linux-gnu
Thread model: posix
gcc version 7.5.0 (Ubuntu 7.5.0-6ubuntu2) But when I'm running python setup.py install
I got error like this:
python setup.py install
running install
running bdist_egg
running egg_info
writing k2.egg-info/PKG-INFO
writing dependency_links to k2.egg-info/dependency_links.txt
writing requirements to k2.egg-info/requires.txt
writing top-level names to k2.egg-info/top_level.txt
Generating grammar tables from /usr/lib/python3.8/lib2to3/Grammar.txt
Generating grammar tables from /usr/lib/python3.8/lib2to3/PatternGrammar.txt
reading manifest file 'k2.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
writing manifest file 'k2.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
creating build
creating build/lib.linux-x86_64-3.8
creating build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/autograd.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/autograd_utils.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/ctc_loss.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/decode.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/dense_fsa_vec.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/fsa.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/fsa_algo.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/fsa_properties.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/mutual_information.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/mwer_loss.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/nbest.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/online_dense_intersecter.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/ops.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/rnnt_decode.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/rnnt_loss.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/symbol_table.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/utils.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/__init__.py -> build/lib.linux-x86_64-3.8/k2
creating build/lib.linux-x86_64-3.8/k2/ragged
copying k2/python/k2/ragged/__init__.py -> build/lib.linux-x86_64-3.8/k2/ragged
creating build/lib.linux-x86_64-3.8/k2/sparse
copying k2/python/k2/sparse/autograd.py -> build/lib.linux-x86_64-3.8/k2/sparse
copying k2/python/k2/sparse/__init__.py -> build/lib.linux-x86_64-3.8/k2/sparse
creating build/lib.linux-x86_64-3.8/k2/version
copying k2/python/k2/version/version.py -> build/lib.linux-x86_64-3.8/k2/version
copying k2/python/k2/version/__init__.py -> build/lib.linux-x86_64-3.8/k2/version
copying k2/python/k2/version/__main__.py -> build/lib.linux-x86_64-3.8/k2/version
running build_ext
cmake_path: /usr/bin/cmake
Setting PYTHON_EXECUTABLE to /media/7A76476176471D6F/VALL-E/valle_env/bin/python
build command is:
cd build/temp.linux-x86_64-3.8
cmake -DK2_WITH_CUDA=OFF -DPYTHON_EXECUTABLE=/media/7A76476176471D6F/VALL-E/valle_env/bin/python -DK2_ENABLE_BENCHMARK=OFF -DK2_ENABLE_TESTS=OFF -DCMAKE_INSTALL_PREFIX=/media/7A76476176471D6F/VALL-E/k2/build/lib.linux-x86_64-3.8/k2 /media/7A76476176471D6F/VALL-E/k2
cat k2/csrc/version.h
make -j12 install
-- CMAKE_VERSION: 3.16.3
-- Disable CUDA support
-- Enabled languages: CXX
-- The CXX compiler identification is GNU 9.4.0
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- No CMAKE_BUILD_TYPE given, default to Release
-- Set K2_ENABLE_NVTX to OFF since K2_WITH_CUDA is OFF
-- K2_OS: Ubuntu 20.04.5 LTS
-- Found Git: /usr/bin/git (found version "2.25.1")
-- Looking for C++ include cxxabi.h
-- Looking for C++ include cxxabi.h - found
-- Looking for C++ include execinfo.h
-- Looking for C++ include execinfo.h - found
-- Performing Test K2_COMPILER_SUPPORTS_CXX14
-- Performing Test K2_COMPILER_SUPPORTS_CXX14 - Success
-- C++ Standard version: 14
-- Could NOT find Valgrind (missing: Valgrind_INCLUDE_DIR Valgrind_EXECUTABLE)
-- Downloading pybind11 from https://github.com/pybind/pybind11/archive/5bc0943ed96836f46489f53961f6c438d2935357.zip
-- pybind11 is downloaded to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/pybind11-src
-- pybind11 v2.11.0 dev1
-- Found PythonInterp: /media/7A76476176471D6F/VALL-E/valle_env/bin/python (found suitable version "3.8.10", minimum required is "3.6")
-- Found PythonLibs: /usr/lib/x86_64-linux-gnu/libpython3.8.so
-- Performing Test HAS_FLTO
-- Performing Test HAS_FLTO - Success
-- Python executable: /media/7A76476176471D6F/VALL-E/valle_env/bin/python
-- Looking for C++ include pthread.h
-- Looking for C++ include pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE
-- Found CUDA: /usr/local/cuda-10.2 (found version "10.2")
-- The CUDA compiler identification is NVIDIA 10.2.89
-- Check for working CUDA compiler: /usr/local/cuda-10.2/bin/nvcc
-- Check for working CUDA compiler: /usr/local/cuda-10.2/bin/nvcc -- works
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- Caffe2: CUDA detected: 10.2
-- Caffe2: CUDA nvcc is: /usr/local/cuda-10.2/bin/nvcc
-- Caffe2: CUDA toolkit directory: /usr/local/cuda-10.2
-- Caffe2: Header version is: 10.2
-- Could NOT find CUDNN (missing: CUDNN_LIBRARY_PATH CUDNN_INCLUDE_PATH)
CMake Warning at /media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:120 (message):
Caffe2: Cannot find cuDNN library. Turning the option off
Call Stack (most recent call first):
/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:92 (include)
/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)
cmake/torch.cmake:11 (find_package)
CMakeLists.txt:292 (include)
-- /usr/local/cuda-10.2/lib64/libnvrtc.so shorthash is 08c4863f
-- Autodetected CUDA architecture(s): 7.5
-- Added CUDA NVCC flags for: -gencode;arch=compute_75,code=sm_75
CMake Error at /media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:100 (message):
Your installed Caffe2 version uses cuDNN but I cannot find the cuDNN
libraries. Please set the proper cuDNN prefixes and / or install cuDNN.
Call Stack (most recent call first):
/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)
cmake/torch.cmake:11 (find_package)
CMakeLists.txt:292 (include)
-- Configuring incomplete, errors occurred!
See also "/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/CMakeFiles/CMakeOutput.log".
See also "/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/CMakeFiles/CMakeError.log".
cat: k2/csrc/version.h: No such file or directory
make: *** No rule to make target 'install'. Stop.
Traceback (most recent call last):
File "setup.py", line 234, in <module>
setuptools.setup(
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/__init__.py", line 145, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python3.8/distutils/core.py", line 148, in setup
dist.run_commands()
File "/usr/lib/python3.8/distutils/dist.py", line 966, in run_commands
self.run_command(cmd)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/install.py", line 67, in run
self.do_egg_install()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/install.py", line 109, in do_egg_install
self.run_command('bdist_egg')
File "/usr/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/bdist_egg.py", line 172, in run
cmd = self.call_command('install_lib', warn_dir=0)
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/bdist_egg.py", line 158, in call_command
self.run_command(cmdname)
File "/usr/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/install_lib.py", line 23, in run
self.build()
File "/usr/lib/python3.8/distutils/command/install_lib.py", line 109, in build
self.run_command('build_ext')
File "/usr/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/build_ext.py", line 84, in run
_build_ext.run(self)
File "/usr/lib/python3.8/distutils/command/build_ext.py", line 340, in run
self.build_extensions()
File "/usr/lib/python3.8/distutils/command/build_ext.py", line 449, in build_extensions
self._build_extensions_serial()
File "/usr/lib/python3.8/distutils/command/build_ext.py", line 474, in _build_extensions_serial
self.build_extension(ext)
File "setup.py", line 206, in build_extension
raise Exception("Failed to build k2")
Exception: Failed to build k2From your error log:
-- CMAKE_VERSION: 3.16.3
-- Disable CUDA support
-- Enabled languages: CXX
-- The CXX compiler identification is GNU 9.4.0You have several GCC installed.
So please check the following items: (1) remove the build directory before you continue (2) check whether you have set environment variables for GCC 7.5. Please refer to https://k2-fsa.github.io/k2/installation/faqs.html#error-c-14-or-later-compatible-compiler-is-required-to-use-aten
kin0303
commented
1 year ago From your error log:
-- CMAKE_VERSION: 3.16.3 -- Disable CUDA support -- Enabled languages: CXX -- The CXX compiler identification is GNU 9.4.0You have several GCC installed.
So please check the following items: (1) remove the build directory before you continue (2) check whether you have set environment variables for GCC 7.5. Please refer to https://k2-fsa.github.io/k2/installation/faqs.html#error-c-14-or-later-compatible-compiler-is-required-to-use-aten
Hi @csukuangfj, it's still error
python setup.py installrunning install
running bdist_egg
running egg_info
writing k2.egg-info/PKG-INFO
writing dependency_links to k2.egg-info/dependency_links.txt
writing requirements to k2.egg-info/requires.txt
writing top-level names to k2.egg-info/top_level.txt
Generating grammar tables from /usr/lib/python3.8/lib2to3/Grammar.txt
Generating grammar tables from /usr/lib/python3.8/lib2to3/PatternGrammar.txt
reading manifest file 'k2.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
writing manifest file 'k2.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
creating build
creating build/lib.linux-x86_64-3.8
creating build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/autograd.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/autograd_utils.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/ctc_loss.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/decode.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/dense_fsa_vec.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/fsa.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/fsa_algo.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/fsa_properties.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/mutual_information.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/mwer_loss.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/nbest.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/online_dense_intersecter.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/ops.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/rnnt_decode.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/rnnt_loss.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/symbol_table.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/utils.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/__init__.py -> build/lib.linux-x86_64-3.8/k2
creating build/lib.linux-x86_64-3.8/k2/ragged
copying k2/python/k2/ragged/__init__.py -> build/lib.linux-x86_64-3.8/k2/ragged
creating build/lib.linux-x86_64-3.8/k2/sparse
copying k2/python/k2/sparse/autograd.py -> build/lib.linux-x86_64-3.8/k2/sparse
copying k2/python/k2/sparse/__init__.py -> build/lib.linux-x86_64-3.8/k2/sparse
creating build/lib.linux-x86_64-3.8/k2/version
copying k2/python/k2/version/version.py -> build/lib.linux-x86_64-3.8/k2/version
copying k2/python/k2/version/__init__.py -> build/lib.linux-x86_64-3.8/k2/version
copying k2/python/k2/version/__main__.py -> build/lib.linux-x86_64-3.8/k2/version
running build_ext
cmake_path: /usr/bin/cmake
Setting PYTHON_EXECUTABLE to /media/7A76476176471D6F/VALL-E/valle_env/bin/python
build command is:
cd build/temp.linux-x86_64-3.8
cmake -DK2_WITH_CUDA=OFF -DPYTHON_EXECUTABLE=/media/7A76476176471D6F/VALL-E/valle_env/bin/python -DK2_ENABLE_BENCHMARK=OFF -DK2_ENABLE_TESTS=OFF -DCMAKE_INSTALL_PREFIX=/media/7A76476176471D6F/VALL-E/k2/build/lib.linux-x86_64-3.8/k2 /media/7A76476176471D6F/VALL-E/k2
cat k2/csrc/version.h
make -j12 install
-- CMAKE_VERSION: 3.16.3
-- Disable CUDA support
-- Enabled languages: CXX
-- The CXX compiler identification is GNU 7.5.0
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- No CMAKE_BUILD_TYPE given, default to Release
-- Set K2_ENABLE_NVTX to OFF since K2_WITH_CUDA is OFF
-- K2_OS: Ubuntu 20.04.5 LTS
-- Found Git: /usr/bin/git (found version "2.25.1")
-- Looking for C++ include cxxabi.h
-- Looking for C++ include cxxabi.h - found
-- Looking for C++ include execinfo.h
-- Looking for C++ include execinfo.h - found
-- Performing Test K2_COMPILER_SUPPORTS_CXX14
-- Performing Test K2_COMPILER_SUPPORTS_CXX14 - Success
-- C++ Standard version: 14
-- Found Valgrind: /usr/bin
-- Found Valgrind: /usr/bin/valgrind
-- To check memory, run `ctest -R <NAME> -D ExperimentalMemCheck`
-- Downloading pybind11 from https://github.com/pybind/pybind11/archive/5bc0943ed96836f46489f53961f6c438d2935357.zip
-- pybind11 is downloaded to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/pybind11-src
-- pybind11 v2.11.0 dev1
-- Found PythonInterp: /media/7A76476176471D6F/VALL-E/valle_env/bin/python (found suitable version "3.8.10", minimum required is "3.6")
-- Found PythonLibs: /usr/lib/x86_64-linux-gnu/libpython3.8.so
-- Performing Test HAS_FLTO
-- Performing Test HAS_FLTO - Success
-- Python executable: /media/7A76476176471D6F/VALL-E/valle_env/bin/python
-- Looking for C++ include pthread.h
-- Looking for C++ include pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE
-- Found CUDA: /usr/local/cuda-10.2 (found version "10.2")
-- The CUDA compiler identification is NVIDIA 10.2.89
-- Check for working CUDA compiler: /usr/local/cuda-10.2/bin/nvcc
-- Check for working CUDA compiler: /usr/local/cuda-10.2/bin/nvcc -- works
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- Caffe2: CUDA detected: 10.2
-- Caffe2: CUDA nvcc is: /usr/local/cuda-10.2/bin/nvcc
-- Caffe2: CUDA toolkit directory: /usr/local/cuda-10.2
-- Caffe2: Header version is: 10.2
-- Could NOT find CUDNN (missing: CUDNN_LIBRARY_PATH CUDNN_INCLUDE_PATH)
CMake Warning at /media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:120 (message):
Caffe2: Cannot find cuDNN library. Turning the option off
Call Stack (most recent call first):
/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:92 (include)
/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)
cmake/torch.cmake:11 (find_package)
CMakeLists.txt:292 (include)
-- /usr/local/cuda-10.2/lib64/libnvrtc.so shorthash is 08c4863f
-- Autodetected CUDA architecture(s): 7.5
-- Added CUDA NVCC flags for: -gencode;arch=compute_75,code=sm_75
CMake Error at /media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:100 (message):
Your installed Caffe2 version uses cuDNN but I cannot find the cuDNN
libraries. Please set the proper cuDNN prefixes and / or install cuDNN.
Call Stack (most recent call first):
/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)
cmake/torch.cmake:11 (find_package)
CMakeLists.txt:292 (include)
-- Configuring incomplete, errors occurred!
See also "/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/CMakeFiles/CMakeOutput.log".
See also "/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/CMakeFiles/CMakeError.log".
cat: k2/csrc/version.h: No such file or directory
make: *** No rule to make target 'install'. Stop.
Traceback (most recent call last):
File "setup.py", line 234, in <module>
setuptools.setup(
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/__init__.py", line 145, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python3.8/distutils/core.py", line 148, in setup
dist.run_commands()
File "/usr/lib/python3.8/distutils/dist.py", line 966, in run_commands
self.run_command(cmd)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/install.py", line 67, in run
self.do_egg_install()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/install.py", line 109, in do_egg_install
self.run_command('bdist_egg')
File "/usr/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/bdist_egg.py", line 172, in run
cmd = self.call_command('install_lib', warn_dir=0)
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/bdist_egg.py", line 158, in call_command
self.run_command(cmdname)
File "/usr/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/install_lib.py", line 23, in run
self.build()
File "/usr/lib/python3.8/distutils/command/install_lib.py", line 109, in build
self.run_command('build_ext')
File "/usr/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/build_ext.py", line 84, in run
_build_ext.run(self)
File "/usr/lib/python3.8/distutils/command/build_ext.py", line 340, in run
self.build_extensions()
File "/usr/lib/python3.8/distutils/command/build_ext.py", line 449, in build_extensions
self._build_extensions_serial()
File "/usr/lib/python3.8/distutils/command/build_ext.py", line 474, in _build_extensions_serial
self.build_extension(ext)
File "setup.py", line 206, in build_extension
raise Exception("Failed to build k2")
Exception: Failed to build k2CMake Error at /media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:100 (message): Your installed Caffe2 version uses cuDNN but I cannot find the cuDNN libraries. Please set the proper cuDNN prefixes and / or install cuDNN.
The error shows you have not installed cuDNN yet.
Please, please, please follow our documentation to install cudatoolkit and cuDNN. https://k2-fsa.github.io/k2/installation/cuda-cudnn.html
If you still have errors after following our documentation, please ask it gain.
kin0303
commented
1 year ago CMake Error at /media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:100 (message): Your installed Caffe2 version uses cuDNN but I cannot find the cuDNN libraries. Please set the proper cuDNN prefixes and / or install cuDNN.
The error shows you have not installed cuDNN yet.
Please, please, please follow our documentation to install cudatoolkit and cuDNN. https://k2-fsa.github.io/k2/installation/cuda-cudnn.html
If you still have errors after following our documentation, please ask it gain.
CMake Error at /media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:100 (message): Your installed Caffe2 version uses cuDNN but I cannot find the cuDNN libraries. Please set the proper cuDNN prefixes and / or install cuDNN.
The error shows you have not installed cuDNN yet.
Please, please, please follow our documentation to install cudatoolkit and cuDNN. https://k2-fsa.github.io/k2/installation/cuda-cudnn.html
If you still have errors after following our documentation, please ask it gain.
But I have it installed
nvcc -V
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2019 NVIDIA Corporation
Built on Wed_Oct_23_19:24:38_PDT_2019
Cuda compilation tools, release 10.2, V10.2.89But I have it installed
nvcc only shows that you have installed cudatoolkit.
cudatoolkit does not contain cuDNN. Please install cuDNN first.
kin0303
commented
1 year ago But I have it installed
nvcc only shows that you have installed cudatoolkit.
cudatoolkit does not contain cuDNN. Please install cuDNN first.
Hi @csukuangfj, the result is still the same
python setup.py installrunning bdist_egg
running egg_info
writing k2.egg-info/PKG-INFO
writing dependency_links to k2.egg-info/dependency_links.txt
writing requirements to k2.egg-info/requires.txt
writing top-level names to k2.egg-info/top_level.txt
Generating grammar tables from /usr/lib/python3.8/lib2to3/Grammar.txt
Generating grammar tables from /usr/lib/python3.8/lib2to3/PatternGrammar.txt
reading manifest file 'k2.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
writing manifest file 'k2.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
creating build
creating build/lib.linux-x86_64-3.8
creating build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/autograd.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/autograd_utils.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/ctc_loss.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/decode.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/dense_fsa_vec.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/fsa.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/fsa_algo.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/fsa_properties.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/mutual_information.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/mwer_loss.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/nbest.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/online_dense_intersecter.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/ops.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/rnnt_decode.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/rnnt_loss.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/symbol_table.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/utils.py -> build/lib.linux-x86_64-3.8/k2
copying k2/python/k2/__init__.py -> build/lib.linux-x86_64-3.8/k2
creating build/lib.linux-x86_64-3.8/k2/ragged
copying k2/python/k2/ragged/__init__.py -> build/lib.linux-x86_64-3.8/k2/ragged
creating build/lib.linux-x86_64-3.8/k2/sparse
copying k2/python/k2/sparse/autograd.py -> build/lib.linux-x86_64-3.8/k2/sparse
copying k2/python/k2/sparse/__init__.py -> build/lib.linux-x86_64-3.8/k2/sparse
creating build/lib.linux-x86_64-3.8/k2/version
copying k2/python/k2/version/version.py -> build/lib.linux-x86_64-3.8/k2/version
copying k2/python/k2/version/__init__.py -> build/lib.linux-x86_64-3.8/k2/version
copying k2/python/k2/version/__main__.py -> build/lib.linux-x86_64-3.8/k2/version
running build_ext
cmake_path: /usr/bin/cmake
Setting PYTHON_EXECUTABLE to /media/7A76476176471D6F/VALL-E/valle_env/bin/python
build command is:
cd build/temp.linux-x86_64-3.8
cmake -DK2_WITH_CUDA=OFF -DPYTHON_EXECUTABLE=/media/7A76476176471D6F/VALL-E/valle_env/bin/python -DK2_ENABLE_BENCHMARK=OFF -DK2_ENABLE_TESTS=OFF -DCMAKE_INSTALL_PREFIX=/media/7A76476176471D6F/VALL-E/k2/build/lib.linux-x86_64-3.8/k2 /media/7A76476176471D6F/VALL-E/k2
cat k2/csrc/version.h
make -j12 install
-- CMAKE_VERSION: 3.16.3
-- Disable CUDA support
-- Enabled languages: CXX
-- The CXX compiler identification is GNU 7.5.0
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- No CMAKE_BUILD_TYPE given, default to Release
-- Set K2_ENABLE_NVTX to OFF since K2_WITH_CUDA is OFF
-- K2_OS: Ubuntu 20.04.5 LTS
-- Found Git: /usr/bin/git (found version "2.25.1")
-- Looking for C++ include cxxabi.h
-- Looking for C++ include cxxabi.h - found
-- Looking for C++ include execinfo.h
-- Looking for C++ include execinfo.h - found
-- Performing Test K2_COMPILER_SUPPORTS_CXX14
-- Performing Test K2_COMPILER_SUPPORTS_CXX14 - Success
-- C++ Standard version: 14
-- Found Valgrind: /usr/bin
-- Found Valgrind: /usr/bin/valgrind
-- To check memory, run `ctest -R <NAME> -D ExperimentalMemCheck`
-- Downloading pybind11 from https://github.com/pybind/pybind11/archive/5bc0943ed96836f46489f53961f6c438d2935357.zip
-- pybind11 is downloaded to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/pybind11-src
-- pybind11 v2.11.0 dev1
-- Found PythonInterp: /media/7A76476176471D6F/VALL-E/valle_env/bin/python (found suitable version "3.8.10", minimum required is "3.6")
-- Found PythonLibs: /usr/lib/x86_64-linux-gnu/libpython3.8.so
-- Performing Test HAS_FLTO
-- Performing Test HAS_FLTO - Success
-- Python executable: /media/7A76476176471D6F/VALL-E/valle_env/bin/python
-- Looking for C++ include pthread.h
-- Looking for C++ include pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE
-- Found CUDA: /usr/local/cuda-10.2 (found version "10.2")
-- The CUDA compiler identification is NVIDIA 10.2.89
-- Check for working CUDA compiler: /usr/local/cuda-10.2/bin/nvcc
-- Check for working CUDA compiler: /usr/local/cuda-10.2/bin/nvcc -- works
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- Caffe2: CUDA detected: 10.2
-- Caffe2: CUDA nvcc is: /usr/local/cuda-10.2/bin/nvcc
-- Caffe2: CUDA toolkit directory: /usr/local/cuda-10.2
-- Caffe2: Header version is: 10.2
-- Found CUDNN: /usr/lib/x86_64-linux-gnu/libcudnn.so
-- Found cuDNN: v7.6.5 (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libcudnn.so)
-- /usr/local/cuda-10.2/lib64/libnvrtc.so shorthash is 08c4863f
-- Autodetected CUDA architecture(s): 7.5
-- Added CUDA NVCC flags for: -gencode;arch=compute_75,code=sm_75
CMake Warning at /media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:22 (message):
static library kineto_LIBRARY-NOTFOUND not found.
Call Stack (most recent call first):
/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:127 (append_torchlib_if_found)
cmake/torch.cmake:11 (find_package)
CMakeLists.txt:292 (include)
-- Found Torch: /media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/lib/libtorch.so
-- K2_TORCH_VERSION: 1.13
-- PyTorch version: 1.13.1+cu117
-- Generated /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/torch_version.py
-- CMAKE_CXX_FLAGS: -D_GLIBCXX_USE_CXX11_ABI=0 -Wno-unused-variable -Wno-strict-overflow
-- CMAKE_CUDA_FLAGS: -DONNX_NAMESPACE=onnx_c2 -gencode arch=compute_75,code=sm_75 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=integer_sign_change,--diag_suppress=useless_using_declaration,--diag_suppress=set_but_not_used,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=implicit_return_from_non_void_function,--diag_suppress=unsigned_compare_with_zero,--diag_suppress=declared_but_not_referenced,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda
-- Generated /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc/version.h
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/log.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//log.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/algorithms.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//algorithms.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/array_of_ragged.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//array_of_ragged.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/array_ops.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//array_ops.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/connect.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//connect.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/context.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//context.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/dtype.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//dtype.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/fsa.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//fsa.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/fsa_algo.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//fsa_algo.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/fsa_utils.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//fsa_utils.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/hash.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//hash.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/host_shim.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//host_shim.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/intersect.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//intersect.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/intersect_dense.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//intersect_dense.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/intersect_dense_pruned.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//intersect_dense_pruned.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/math.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//math.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/moderngpu_allocator.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//moderngpu_allocator.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/pinned_context.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//pinned_context.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/ragged.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//ragged.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/ragged_ops.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//ragged_ops.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/ragged_utils.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//ragged_utils.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/rand.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//rand.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/reverse.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//reverse.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/rm_epsilon.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//rm_epsilon.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/rnnt_decode.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//rnnt_decode.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/tensor.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//tensor.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/tensor_ops.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//tensor_ops.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/thread_pool.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//thread_pool.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/timer.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//timer.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/top_sort.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//top_sort.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/torch_util.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//torch_util.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/utils.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//utils.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/nbest.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//nbest.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/csrc/pytorch_context.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/csrc//pytorch_context.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/k2.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc//k2.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc//torch.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/version.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc//version.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch/arc.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/torch/arc.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch/fsa.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/torch/fsa.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch/fsa_algo.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/torch/fsa_algo.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch/index_add.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/torch/index_add.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch/index_select.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/torch/index_select.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch/mutual_information.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/torch/mutual_information.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch/mutual_information_cpu.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/torch/mutual_information_cpu.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch/nbest.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/torch/nbest.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch/ragged.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/torch/ragged.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch/ragged_ops.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/torch/ragged_ops.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch/rnnt_decode.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/torch/rnnt_decode.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch/v2/any.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/torch/v2/any.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch/v2/autograd/swoosh.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/torch/v2/autograd/swoosh.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch/v2/doc/doc.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/torch/v2/doc/doc.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch/v2/k2.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/torch/v2/k2.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch/v2/ragged_any.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/torch/v2/ragged_any.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/python/csrc/torch/v2/ragged_shape.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/torch/v2/ragged_shape.cc
-- PYTHON_LIBRARY: /usr/lib/x86_64-linux-gnu/libpython3.8.so
-- Including k2/torch. K2_TORCH_VERSION is 1.13
-- Downloading kaldifeat from https://github.com/csukuangfj/kaldifeat/archive/refs/tags/v1.20.tar.gz
-- kaldifeat is downloaded to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/kaldifeat-src
-- kaldifeat's binary dir is /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/kaldifeat-build
-- The C compiler identification is GNU 7.5.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- C++ Standard version: 14
-- Python executable: /media/7A76476176471D6F/VALL-E/valle_env/bin/python
CMake Warning at /media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:22 (message):
static library kineto_LIBRARY-NOTFOUND not found.
Call Stack (most recent call first):
/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:127 (append_torchlib_if_found)
cmake/torch.cmake:11 (find_package)
build/temp.linux-x86_64-3.8/_deps/kaldifeat-src/CMakeLists.txt:55 (include)
-- K2_TORCH_VERSION: 1.13
-- PyTorch version: 1.13.1+cu117
-- CMAKE_CXX_FLAGS: -D_GLIBCXX_USE_CXX11_ABI=0 -Wno-unused-variable -Wno-strict-overflow -D_GLIBCXX_USE_CXX11_ABI=0
-- CMAKE_INSTALL_PREFIX: /media/7A76476176471D6F/VALL-E/k2/build/lib.linux-x86_64-3.8/k2
-- All headers: /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/kaldifeat-src/kaldifeat/csrc/feature-common-inl.h;/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/kaldifeat-src/kaldifeat/csrc/feature-common.h;/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/kaldifeat-src/kaldifeat/csrc/feature-fbank.h;/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/kaldifeat-src/kaldifeat/csrc/feature-functions.h;/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/kaldifeat-src/kaldifeat/csrc/feature-mfcc.h;/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/kaldifeat-src/kaldifeat/csrc/feature-plp.h;/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/kaldifeat-src/kaldifeat/csrc/feature-spectrogram.h;/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/kaldifeat-src/kaldifeat/csrc/feature-window.h;/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/kaldifeat-src/kaldifeat/csrc/log.h;/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/kaldifeat-src/kaldifeat/csrc/matrix-functions.h;/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/kaldifeat-src/kaldifeat/csrc/mel-computations.h;/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/kaldifeat-src/kaldifeat/csrc/online-feature-itf.h;/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/kaldifeat-src/kaldifeat/csrc/online-feature.h;/media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/_deps/kaldifeat-src/kaldifeat/csrc/pitch-functions.h
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/csrc/beam_search.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/csrc//beam_search.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/csrc/decode.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/csrc//decode.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/csrc/dense_fsa_vec.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/csrc//dense_fsa_vec.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/csrc/deserialization.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/csrc//deserialization.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/csrc/fsa_algo.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/csrc//fsa_algo.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/csrc/fsa_class.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/csrc//fsa_class.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/csrc/hypothesis.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/csrc//hypothesis.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/csrc/nbest.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/csrc//nbest.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/csrc/parse_options.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/csrc//parse_options.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/csrc/symbol_table.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/csrc//symbol_table.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/csrc/utils.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/csrc//utils.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/csrc/wave_reader.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/csrc//wave_reader.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/csrc/torch_api.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/csrc//torch_api.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/bin/ctc_decode.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/bin//ctc_decode.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/bin/hlg_decode.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/bin//hlg_decode.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/bin/ngram_lm_rescore.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/bin//ngram_lm_rescore.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/bin/attention_rescore.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/bin//attention_rescore.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/bin/online_decode.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/bin//online_decode.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/bin/rnnt_demo.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/bin//rnnt_demo.cc
-- Renaming /media/7A76476176471D6F/VALL-E/k2/k2/torch/bin/pruned_stateless_transducer.cu to /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/torch/bin//pruned_stateless_transducer.cc
-- Configuring done
-- Generating done
-- Build files have been written to: /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8
/**
* @brief
* This file contains information for building k2, which is helpful
* for describing the environment in which k2 is used when creating
* an issue on GitHub.
*
* @copyright
* Copyright (c) 2020 Mobvoi Inc. (authors: Fangjun Kuang)
*
* @copyright
* See LICENSE for clarification regarding multiple authors
*
* @caution
* This file is auto-generated by CMake. Do NOT edit!
* You can find it at build_dir/k2/csrc/version.h
*/
#ifndef K2_CSRC_VERSION_H_
#define K2_CSRC_VERSION_H_
namespace k2 {
// Version of k2 in "major.minor.patch" format
static constexpr const char *kVersion = "1.23.4";
// The commit used to build k2
static constexpr const char *kGitSha1 = "9426c9f730820d291f5dcb06be337662595fa7b4";
// Date of the commit used to build k2
static constexpr const char *kGitDate = "Sun Feb 5 16:35:01 2023";
// Version of CUDA used to build k2.
// Its format is "major.minor", e.g., 10.1
static constexpr const char *kCudaVersion = "10.2";
// cuDNN version, e.g., 8.0.2
static constexpr const char *kCudnnVersion = "7.6.5";
// clang-format off
// Version of Python used to build k2 Python bindings.
static constexpr const char *kPythonVersion = "3.8";
// clang-format on
// CMake build type, e.g., Release or Debug.
static constexpr const char *kBuildType = "Release";
// The operating system that is used to build k2, e.g., Ubuntu 16.04 LTS
static constexpr const char *kOS = R"os(Ubuntu 20.04.5 LTS)os";
// e.g., 3.18.0
static constexpr const char *kCMakeVersion = "3.16.3";
// Version of the compiler, e.g., 5.4.0
static constexpr const char *kGCCVersion = "7.5.0";
// CUDA flags used to compile k2
static constexpr const char *kCMakeCudaFlags = R"cuda_flags( -DONNX_NAMESPACE=onnx_c2 -gencode arch=compute_75,code=sm_75 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=integer_sign_change,--diag_suppress=useless_using_declaration,--diag_suppress=set_but_not_used,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=implicit_return_from_non_void_function,--diag_suppress=unsigned_compare_with_zero,--diag_suppress=declared_but_not_referenced,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda)cuda_flags";
// CXX flags used to compile k2
static constexpr const char *kCMakeCxxFlags = R"cxx_flags( -D_GLIBCXX_USE_CXX11_ABI=0 -Wno-unused-variable -Wno-strict-overflow )cxx_flags";
// Which PyTorch version k2 is using, e.g., 1.6.0+cu101
static constexpr const char *kTorchVersion = "1.13.1+cu117";
// Which CUDA version PyTorch is using, e.g., 10.1
static constexpr const char *kTorchCudaVersion = "";
#ifndef K2_WITH_CUDA
/* #undef K2_WITH_CUDA */
#endif
#ifdef K2_WITH_CUDA
static constexpr bool kWithCuda = true;
#else
static constexpr bool kWithCuda = false;
#endif
// Indicate whether NVTX is enabled or not
#ifndef K2_ENABLE_NVTX
/* #undef K2_ENABLE_NVTX */
#endif
#ifdef K2_ENABLE_NVTX
static constexpr bool kEnableNvtx = true;
#else
static constexpr bool kEnableNvtx = false;
#endif
} // namespace k2
#endif // K2_CSRC_VERSION_H_
Scanning dependencies of target k2_log
Scanning dependencies of target kaldifeat_core
[ 1%] Building CXX object k2/csrc/CMakeFiles/k2_log.dir/log.cc.o
[ 2%] Linking CXX shared library ../../lib/libk2_log.so
[ 2%] Built target k2_log
Scanning dependencies of target fsa
[ 3%] Building CXX object k2/csrc/host/CMakeFiles/fsa.dir/arcsort.cc.o
[ 5%] Building CXX object k2/csrc/host/CMakeFiles/fsa.dir/connect.cc.o
[ 5%] Building CXX object k2/csrc/host/CMakeFiles/fsa.dir/aux_labels.cc.o
[ 6%] Building CXX object k2/csrc/host/CMakeFiles/fsa.dir/determinize.cc.o
[ 7%] Building CXX object k2/csrc/host/CMakeFiles/fsa.dir/fsa.cc.o
[ 7%] Building CXX object k2/csrc/host/CMakeFiles/fsa.dir/determinize_pruned.cc.o
[ 8%] Building CXX object k2/csrc/host/CMakeFiles/fsa.dir/fsa_equivalent.cc.o
[ 10%] Building CXX object k2/csrc/host/CMakeFiles/fsa.dir/fsa_renderer.cc.o
[ 11%] Building CXX object k2/csrc/host/CMakeFiles/fsa.dir/properties.cc.o
[ 10%] Building CXX object k2/csrc/host/CMakeFiles/fsa.dir/fsa_util.cc.o
[ 12%] Building CXX object k2/csrc/host/CMakeFiles/fsa.dir/intersect.cc.o
[ 13%] Building CXX object k2/csrc/host/CMakeFiles/fsa.dir/rmepsilon_pruned.cc.o
[ 14%] Building CXX object k2/csrc/host/CMakeFiles/fsa.dir/topsort.cc.o
[ 14%] Building CXX object k2/csrc/host/CMakeFiles/fsa.dir/util.cc.o
[ 15%] Building CXX object k2/csrc/host/CMakeFiles/fsa.dir/weights.cc.o
[ 16%] Linking CXX shared library ../../../lib/libk2fsa.so
[ 16%] Built target fsa
Scanning dependencies of target context
[ 16%] Building CXX object k2/csrc/CMakeFiles/context.dir/algorithms.cc.o
[ 18%] Building CXX object k2/csrc/CMakeFiles/context.dir/array_of_ragged.cc.o
[ 18%] Building CXX object k2/csrc/CMakeFiles/context.dir/array_ops.cc.o
[ 20%] Building CXX object k2/csrc/CMakeFiles/context.dir/context.cc.o
[ 21%] Building CXX object k2/csrc/CMakeFiles/context.dir/connect.cc.o
[ 22%] Building CXX object k2/csrc/CMakeFiles/context.dir/fsa.cc.o
[ 22%] Building CXX object k2/csrc/CMakeFiles/context.dir/dtype.cc.o
[ 23%] Building CXX object k2/csrc/CMakeFiles/context.dir/fsa_utils.cc.o
[ 24%] Building CXX object k2/csrc/CMakeFiles/context.dir/fsa_algo.cc.o
[ 25%] Building CXX object k2/csrc/CMakeFiles/context.dir/hash.cc.o
[ 25%] Building CXX object k2/csrc/CMakeFiles/context.dir/host_shim.cc.o
[ 26%] Building CXX object k2/csrc/CMakeFiles/context.dir/intersect.cc.o
[ 27%] Building CXX object k2/csrc/CMakeFiles/context.dir/intersect_dense.cc.o
[ 28%] Building CXX object k2/csrc/CMakeFiles/context.dir/intersect_dense_pruned.cc.o
[ 28%] Building CXX object _deps/kaldifeat-build/kaldifeat/csrc/CMakeFiles/kaldifeat_core.dir/feature-fbank.cc.o
[ 30%] Building CXX object _deps/kaldifeat-build/kaldifeat/csrc/CMakeFiles/kaldifeat_core.dir/feature-functions.cc.o
[ 31%] Building CXX object _deps/kaldifeat-build/kaldifeat/csrc/CMakeFiles/kaldifeat_core.dir/feature-mfcc.cc.o
[ 32%] Building CXX object _deps/kaldifeat-build/kaldifeat/csrc/CMakeFiles/kaldifeat_core.dir/feature-plp.cc.o
[ 33%] Building CXX object _deps/kaldifeat-build/kaldifeat/csrc/CMakeFiles/kaldifeat_core.dir/feature-spectrogram.cc.o
[ 33%] Building CXX object _deps/kaldifeat-build/kaldifeat/csrc/CMakeFiles/kaldifeat_core.dir/feature-window.cc.o
[ 34%] Building CXX object _deps/kaldifeat-build/kaldifeat/csrc/CMakeFiles/kaldifeat_core.dir/matrix-functions.cc.o
[ 35%] Building CXX object k2/csrc/CMakeFiles/context.dir/math.cc.o
[ 35%] Building CXX object k2/csrc/CMakeFiles/context.dir/moderngpu_allocator.cc.o
[ 36%] Building CXX object k2/csrc/CMakeFiles/context.dir/pinned_context.cc.o
[ 37%] Building CXX object k2/csrc/CMakeFiles/context.dir/ragged.cc.o
[ 38%] Building CXX object k2/csrc/CMakeFiles/context.dir/ragged_ops.cc.o
[ 40%] Building CXX object _deps/kaldifeat-build/kaldifeat/csrc/CMakeFiles/kaldifeat_core.dir/mel-computations.cc.o
[ 41%] Building CXX object _deps/kaldifeat-build/kaldifeat/csrc/CMakeFiles/kaldifeat_core.dir/online-feature.cc.o
[ 42%] Building CXX object k2/csrc/CMakeFiles/context.dir/ragged_utils.cc.o
[ 42%] Building CXX object k2/csrc/CMakeFiles/context.dir/rand.cc.o
[ 43%] Building CXX object k2/csrc/CMakeFiles/context.dir/reverse.cc.o
[ 44%] Building CXX object k2/csrc/CMakeFiles/context.dir/rm_epsilon.cc.o
[ 45%] Building CXX object k2/csrc/CMakeFiles/context.dir/rnnt_decode.cc.o
[ 46%] Building CXX object k2/csrc/CMakeFiles/context.dir/tensor.cc.o
[ 46%] Building CXX object k2/csrc/CMakeFiles/context.dir/tensor_ops.cc.o
[ 47%] Building CXX object k2/csrc/CMakeFiles/context.dir/thread_pool.cc.o
[ 48%] Building CXX object k2/csrc/CMakeFiles/context.dir/timer.cc.o
[ 50%] Building CXX object k2/csrc/CMakeFiles/context.dir/top_sort.cc.o
[ 51%] Building CXX object k2/csrc/CMakeFiles/context.dir/torch_util.cc.o
[ 51%] Building CXX object k2/csrc/CMakeFiles/context.dir/utils.cc.o
[ 52%] Building CXX object k2/csrc/CMakeFiles/context.dir/nbest.cc.o
[ 53%] Building CXX object k2/csrc/CMakeFiles/context.dir/pytorch_context.cc.o
[ 54%] Linking CXX shared library ../../../../lib/libkaldifeat_core.so
[ 54%] Built target kaldifeat_core
Scanning dependencies of target k2_fbank
[ 55%] Linking CXX shared library ../../lib/libk2context.so
[ 55%] Built target context
Scanning dependencies of target _k2
Scanning dependencies of target k2_torch
[ 55%] Building CXX object k2/torch/csrc/CMakeFiles/k2_fbank.dir/features.cc.o
[ 56%] Building CXX object k2/torch/csrc/CMakeFiles/k2_torch.dir/beam_search.cc.o
[ 56%] Building CXX object k2/torch/csrc/CMakeFiles/k2_torch.dir/decode.cc.o
[ 57%] Building CXX object k2/torch/csrc/CMakeFiles/k2_torch.dir/dense_fsa_vec.cc.o
[ 58%] Building CXX object k2/torch/csrc/CMakeFiles/k2_torch.dir/deserialization.cc.o
[ 60%] Building CXX object k2/torch/csrc/CMakeFiles/k2_torch.dir/fsa_algo.cc.o
[ 60%] Building CXX object k2/torch/csrc/CMakeFiles/k2_torch.dir/fsa_class.cc.o
[ 61%] Building CXX object k2/torch/csrc/CMakeFiles/k2_torch.dir/hypothesis.cc.o
[ 62%] Building CXX object k2/torch/csrc/CMakeFiles/k2_torch.dir/parse_options.cc.o
[ 63%] Building CXX object k2/torch/csrc/CMakeFiles/k2_torch.dir/nbest.cc.o
[ 64%] Building CXX object k2/torch/csrc/CMakeFiles/k2_torch.dir/symbol_table.cc.o
[ 64%] Building CXX object k2/torch/csrc/CMakeFiles/k2_torch.dir/utils.cc.o
[ 65%] Building CXX object k2/torch/csrc/CMakeFiles/k2_torch.dir/wave_reader.cc.o
[ 65%] Building CXX object k2/python/csrc/CMakeFiles/_k2.dir/k2.cc.o
[ 66%] Linking CXX shared library ../../../lib/libk2_fbank.so
[ 66%] Built target k2_fbank
[ 67%] Building CXX object k2/python/csrc/CMakeFiles/_k2.dir/torch.cc.o
[ 68%] Building CXX object k2/python/csrc/CMakeFiles/_k2.dir/version.cc.o
In file included from /media/7A76476176471D6F/VALL-E/k2/build/temp.linux-x86_64-3.8/k2/python/csrc/version.cc:26:0:
/media/7A76476176471D6F/VALL-E/k2/k2/csrc/version.h:70:2: error: invalid preprocessing directive #cmakedefine; did you mean #define?
#cmakedefine K2_WITH_CUDA
^~~~~~~~~~~
define
/media/7A76476176471D6F/VALL-E/k2/k2/csrc/version.h:81:2: error: invalid preprocessing directive #cmakedefine; did you mean #define?
#cmakedefine K2_ENABLE_NVTX
^~~~~~~~~~~
define
make[2]: *** [k2/python/csrc/CMakeFiles/_k2.dir/build.make:89: k2/python/csrc/CMakeFiles/_k2.dir/version.cc.o] Error 1
make[2]: *** Waiting for unfinished jobs....
[ 70%] Linking CXX shared library ../../../lib/libk2_torch.so
[ 70%] Built target k2_torch
Scanning dependencies of target online_decode
Scanning dependencies of target ctc_decode
Scanning dependencies of target hlg_decode
Scanning dependencies of target pruned_stateless_transducer
Scanning dependencies of target attention_rescore
Scanning dependencies of target rnnt_demo
Scanning dependencies of target ngram_lm_rescore
Scanning dependencies of target k2_torch_api
make[1]: *** [CMakeFiles/Makefile2:1273: k2/python/csrc/CMakeFiles/_k2.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
[ 71%] Building CXX object k2/torch/csrc/CMakeFiles/k2_torch_api.dir/torch_api.cc.o
[ 72%] Building CXX object k2/torch/bin/CMakeFiles/pruned_stateless_transducer.dir/pruned_stateless_transducer.cc.o
[ 72%] Building CXX object k2/torch/bin/CMakeFiles/ngram_lm_rescore.dir/ngram_lm_rescore.cc.o
[ 72%] Building CXX object k2/torch/bin/CMakeFiles/ctc_decode.dir/ctc_decode.cc.o
[ 73%] Building CXX object k2/torch/bin/CMakeFiles/attention_rescore.dir/attention_rescore.cc.o
[ 74%] Building CXX object k2/torch/bin/CMakeFiles/hlg_decode.dir/hlg_decode.cc.o
[ 75%] Building CXX object k2/torch/bin/CMakeFiles/online_decode.dir/online_decode.cc.o
[ 76%] Building CXX object k2/torch/bin/CMakeFiles/rnnt_demo.dir/rnnt_demo.cc.o
[ 76%] Linking CXX executable ../../../bin/pruned_stateless_transducer
[ 76%] Built target pruned_stateless_transducer
[ 77%] Linking CXX executable ../../../bin/hlg_decode
[ 78%] Linking CXX executable ../../../bin/ngram_lm_rescore
[ 80%] Linking CXX shared library ../../../lib/libk2_torch_api.so
[ 81%] Linking CXX executable ../../../bin/ctc_decode
[ 82%] Linking CXX executable ../../../bin/online_decode
[ 82%] Built target hlg_decode
[ 83%] Linking CXX executable ../../../bin/attention_rescore
[ 83%] Built target k2_torch_api
[ 83%] Built target ngram_lm_rescore
[ 83%] Built target ctc_decode
[ 83%] Built target online_decode
[ 83%] Built target attention_rescore
[ 84%] Linking CXX executable ../../../bin/rnnt_demo
[ 84%] Built target rnnt_demo
make: *** [Makefile:141: all] Error 2
Traceback (most recent call last):
File "setup.py", line 234, in <module>
setuptools.setup(
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/__init__.py", line 145, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python3.8/distutils/core.py", line 148, in setup
dist.run_commands()
File "/usr/lib/python3.8/distutils/dist.py", line 966, in run_commands
self.run_command(cmd)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/install.py", line 67, in run
self.do_egg_install()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/install.py", line 109, in do_egg_install
self.run_command('bdist_egg')
File "/usr/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/bdist_egg.py", line 172, in run
cmd = self.call_command('install_lib', warn_dir=0)
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/bdist_egg.py", line 158, in call_command
self.run_command(cmdname)
File "/usr/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/install_lib.py", line 23, in run
self.build()
File "/usr/lib/python3.8/distutils/command/install_lib.py", line 109, in build
self.run_command('build_ext')
File "/usr/lib/python3.8/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.8/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/setuptools/command/build_ext.py", line 84, in run
_build_ext.run(self)
File "/usr/lib/python3.8/distutils/command/build_ext.py", line 340, in run
self.build_extensions()
File "/usr/lib/python3.8/distutils/command/build_ext.py", line 449, in build_extensions
self._build_extensions_serial()
File "/usr/lib/python3.8/distutils/command/build_ext.py", line 474, in _build_extensions_serial
self.build_extension(ext)
File "setup.py", line 206, in build_extension
raise Exception("Failed to build k2")
Exception: Failed to build k2From your log
build command is:
cd build/temp.linux-x86_64-3.8
cmake -DK2_WITH_CUDA=OFF -DPYTHON_EXECUTABLE=/media/7A76476176471D6F/VALL-E/valle_env/bin/python -DK2_ENABLE_BENCHMARK=OFF -DK2_ENABLE_TESTS=OFF -DCMAKE_INSTALL_PREFIX=/media/7A76476176471D6F/VALL-E/k2/build/lib.linux-x86_64-3.8/k2 /media/7A76476176471D6F/VALL-E/k2
cat k2/csrc/version.h
make -j12 installDid you set the environment variable K2_CMAKE_ARGS?
Also, did you remove the build directory before you re-built k2?
kin0303
commented
1 year ago Did you set the environment variable
K2_CMAKE_ARGS?
Like this: export K2_CMAKE_ARGS="-DK2_BUILD_FOR_ALL_ARCHS=ON"?
Also, did you remove the
builddirectory before you re-built k2?
Yup, of course
csukuangfj
commented
1 year ago Did you change setup.py or did you change any code of k2?
csukuangfj
commented
1 year ago From the error log
cmake -DK2_WITH_CUDA=OFF -DPYTHON_EXECUTABLE=/media/7A76476176471D6F/VALL-E/valle_env/bin/python -DK2_ENABLE_BENCHMARK=OFF -DK2_ENABLE_TESTS=OFF -DCMAKE_INSTALL_PREFIX=/media/7A76476176471D6F/VALL-E/k2/build/lib.linux-x86_64-3.8/k2 /media/7A76476176471D6F/VALL-E/k2I don't understand why there is -DK2_WITH_CUDA=OFF in it.
kin0303
commented
1 year ago Did you change setup.py or did you change any code of k2?
Did you change setup.py or did you change any code of k2?
No, I don't change anything
kin0303
commented
1 year ago From the error log
cmake -DK2_WITH_CUDA=OFF -DPYTHON_EXECUTABLE=/media/7A76476176471D6F/VALL-E/valle_env/bin/python -DK2_ENABLE_BENCHMARK=OFF -DK2_ENABLE_TESTS=OFF -DCMAKE_INSTALL_PREFIX=/media/7A76476176471D6F/VALL-E/k2/build/lib.linux-x86_64-3.8/k2 /media/7A76476176471D6F/VALL-E/k2I don't understand why there is
-DK2_WITH_CUDA=OFFin it.
Aaahh, I follow this one https://github.com/lifeiteng/vall-e
csukuangfj
commented
1 year ago @kin0303
Could you please follow the official documentation https://k2-fsa.github.io/k2/installation/index.html
kin0303
commented
1 year ago Could you please follow the official documentation https://k2-fsa.github.io/k2/installation/index.html
Yup, of course
After I change into this: export K2_CMAKE_ARGS="-DK2_BUILD_FOR_ALL_ARCHS=ON", I got this error:
python setup.py install
Traceback (most recent call last):
File "setup.py", line 220, in <module>
f.write(f"__dev_version__ = '{get_package_version()}'\n")
File "/media/botika/7A76476176471D6F/Dhea/VALL-E/k2/get_version.py", line 75, in get_package_version
cuda_version = get_cuda_version()
File "/media/botika/7A76476176471D6F/Dhea/VALL-E/k2/get_version.py", line 45, in get_cuda_version
assert cuda_version in running_cuda_version, \
AssertionError: PyTorch is built with CUDA version: 11.7.
The current running CUDA version is: 10.2.89And now I'm doing pytorch installation
csukuangfj
commented
1 year ago AssertionError: PyTorch is built with CUDA version: 11.7.
Since your PyTorch is using cuda 11.7, please also install cudatoolkit 11.7
You can follow our documentation to install cudatoolkit 11.7
Or please install a version of pyorch that supports cuda 10.2
kin0303
commented
1 year ago AssertionError: PyTorch is built with CUDA version: 11.7.
Since your PyTorch is using cuda 11.7, please also install cudatoolkit 11.7
You can follow our documentation to install cudatoolkit 11.7
Or please install a version of pyorch that supports cuda 10.2
It's successful, right?
Using /media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages
Finished processing dependencies for k2==1.23.4.dev20230228+cuda10.2.torch1.12.0It's successful, right?
Please run
python3 -m k2.versionIf it succeeds, then congratulations!
kin0303
commented
1 year ago It's successful, right?
Please run
python3 -m k2.versionIf it succeeds, then congratulations!
Here's the result:
Collecting environment information...
k2 version: @K2_VERSION@
Build type: @CMAKE_BUILD_TYPE@
Git SHA1: @K2_GIT_SHA1@
Git date: @K2_GIT_DATE@
Cuda used to build k2: @CUDA_VERSION@
cuDNN used to build k2: @CUDNN_VERSION@
Python version used to build k2: @PYTHON_VERSION_MAJOR@.@PYTHON_VERSION_MINOR@
OS used to build k2: @K2_OS@
CMake version: @CMAKE_VERSION@
GCC version: @CMAKE_CXX_COMPILER_VERSION@
CMAKE_CUDA_FLAGS: @CMAKE_CUDA_FLAGS@
CMAKE_CXX_FLAGS: @CMAKE_CXX_FLAGS@
PyTorch version used to build k2: @TORCH_VERSION@
PyTorch is using Cuda: @TORCH_CUDA_VERSION@
NVTX enabled: True
With CUDA: True
Disable debug: True
Sync kernels : False
Disable checks: False
Max cpu memory allocate: 214748364800 bytes (or 200.0 GB)
k2 abort: False
__file__: /media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/k2-1.23.4.dev20230228+cuda10.2.torch1.12.0-py3.8-linux-x86_64.egg/k2/version/version.py
_k2.__file__: /media/7A76476176471D6F/VALL-E/valle_env/lib/python3.8/site-packages/k2-1.23.4.dev20230228+cuda10.2.torch1.12.0-py3.8-linux-x86_64.egg/_k2.cpython-38-x86_64-linux-gnu.soBy the way, how did you download the source code of k2?
Did you use git clone?
kin0303
commented
1 year ago By the way, how did you download the source code of k2? Did you use
git clone?
Yes, I use git clone. Is there any problem?
csukuangfj
commented
1 year ago Yes. There are issues with your output:
k2 version: @K2_VERSION@
Build type: @CMAKE_BUILD_TYPE@
Git SHA1: @K2_GIT_SHA1@
Git date: @K2_GIT_DATE@There should not exist @xxx@.
csukuangfj
commented
1 year ago Could you remove your build directory and re-install k2 again?
The expected output is given in our documentation. Please see https://k2-fsa.github.io/k2/installation/pip_pypi.html
kin0303
commented
1 year ago Could you remove your build directory and re-install k2 again?
Should it be uninstalled too? Via pip?
csukuangfj
commented
1 year ago Should it be uninstalled too? Via pip?
Yes, please use pip uninstall k2.
kin0303
commented
1 year ago Should it be uninstalled too? Via pip?
Yes, please use
pip uninstall k2.
The result is still the same
csukuangfj
commented
1 year ago @kin0303
Could you use https://k2-fsa.github.io/k2/installation/for_developers.html to install k2? It is helpful for debugging your issue. I have never seen such an output before.
kin0303
commented
1 year ago @kin0303
Could you use https://k2-fsa.github.io/k2/installation/for_developers.html to install k2? It is helpful for debugging your issue. I have never seen such an output before.
Okay, I'll try that
csukuangfj
commented
1 year ago Please remember to first uninstall k2 and delete the build directory before you continue.
Thanks!
kin0303
commented
1 year ago I think it's my bad, cause I don't read the requirement.txt before. Before that Im using python 3.8 and now looks like my installation is successful.
Collecting environment information...
k2 version: 1.23.4
Build type: Release
Git SHA1: 9acf87444c3997a21b715ea6c7fca8325dfa8eb8
Git date: Tue Feb 28 18:00:35 2023
Cuda used to build k2: 10.2
cuDNN used to build k2: 7.6.5
Python version used to build k2: 3.7
OS used to build k2: Ubuntu 20.04.5 LTS
CMake version: 3.16.3
GCC version: 7.5.0
CMAKE_CUDA_FLAGS: -lineinfo --expt-extended-lambda -use_fast_math -Xptxas=-w --expt-extended-lambda -gencode arch=compute_75,code=sm_75 -DONNX_NAMESPACE=onnx_c2 -gencode arch=compute_75,code=sm_75 -Xcudafe --diag_suppress=cc_clobber_ignored,--diag_suppress=integer_sign_change,--diag_suppress=useless_using_declaration,--diag_suppress=set_but_not_used,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=implicit_return_from_non_void_function,--diag_suppress=unsigned_compare_with_zero,--diag_suppress=declared_but_not_referenced,--diag_suppress=bad_friend_decl --expt-relaxed-constexpr --expt-extended-lambda -D_GLIBCXX_USE_CXX11_ABI=0 --compiler-options -Wall --compiler-options -Wno-strict-overflow --compiler-options -Wno-unknown-pragmas
CMAKE_CXX_FLAGS: -D_GLIBCXX_USE_CXX11_ABI=0 -Wno-unused-variable -Wno-strict-overflow
PyTorch version used to build k2: 1.12.0+cu102
PyTorch is using Cuda: 10.2
NVTX enabled: True
With CUDA: True
Disable debug: True
Sync kernels : False
Disable checks: False
Max cpu memory allocate: 214748364800 bytes (or 200.0 GB)
k2 abort: False
__file__: /media/botika/7A76476176471D6F/Dhea/VALL-E/valle-lagi_env/lib/python3.7/site-packages/k2-1.23.4.dev20230303+cuda10.2.torch1.12.0-py3.7-linux-x86_64.egg/k2/version/version.py
_k2.__file__: /media/botika/7A76476176471D6F/Dhea/VALL-E/valle-lagi_env/lib/python3.7/site-packages/k2-1.23.4.dev20230303+cuda10.2.torch1.12.0-py3.7-linux-x86_64.egg/_k2.cpython-37m-x86_64-linux-gnu.so
cuda version:
and run python setup.py install
shows:
why