Closed ark626 closed 3 years ago
Hi @ark626
Thanks for opening the issue and sharing the workaround.
I am open to update the dependency installation script to support aarch64
, however, CI system we use (CircleCI) does not seem to provide aarch64
environment so we cannot guarantee the successful build all the time. (Although if the issue happens only in dependency it should work)
Therefore I will keep this issue open as reference point for future audience who seek instruction for building torchaudio
in aarch64
.
Hi,
./third_party/tmp/lame-3.99.5/config.guess doesn't exist anymore but I am still getting build issues when trying to build on a tx2. What config.guess do I need to update?
Hi @Thomas-Mccabe
We have switched to cmake-based build so the the build intermediate files are in ls build/temp.linux-<arch>-<version>/third_party/sox/src/mad/config.guess
, however the directory is managed by CMake and manual changes applied there would be updated by CMake. We need to update the config.guess
files as a proper CMake build process. Particularly as PATCH_COMMAND
in the following section.
Let me see if I can quickly come up with the solution.
@Thomas-Mccabe
Can you try this patch and let me know if it works? https://github.com/pytorch/audio/pull/1484/commits/c42830b24c2c02ee294a8a9f4ed52b39f4ebd660
If this works, we can merge it to the master branch. https://github.com/pytorch/audio/pull/1484
Hi,
I've copied the config.guess that ark626 linked and used
sudo BUILD_SOX=1 python3 setup.py install
But there seems to be an issue with building sox. I am running ubuntu 18.04 and already have torch 1.8 installed from https://forums.developer.nvidia.com/t/pytorch-for-jetson-version-1-8-0-now-available/72048
I have attached a snippet of the error.
Okay, looks like codecs are now built.
Regarding the error, in my experience, this happens when there are too many parallel jobs and the machine runs out of memory.
Can you set CMAKE_BUILD_PARALLEL_LEVEL
to something smaller than what nproc
reports?
c++: internal compiler error: Killed (program cc1plus)
Please submit a full bug report,
with preprocessed source if appropriate.
See <file:///usr/share/doc/gcc-7/README.Bugs> for instructions.
just wanted to share that I've built torchaudio==0.8.0 successfully on my Jetson AVG xavier (jetpack 4.4). Take a look at gist.
```
python setup.py install
-- Building version 0.8.0a0+099d788
running install
running bdist_egg
running egg_info
creating torchaudio.egg-info
writing torchaudio.egg-info/PKG-INFO
writing dependency_links to torchaudio.egg-info/dependency_links.txt
writing requirements to torchaudio.egg-info/requires.txt
writing top-level names to torchaudio.egg-info/top_level.txt
writing manifest file 'torchaudio.egg-info/SOURCES.txt'
reading manifest file 'torchaudio.egg-info/SOURCES.txt'
writing manifest file 'torchaudio.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-aarch64/egg
running install_lib
running build_py
creating build
creating build/lib.linux-aarch64-3.6
creating build/lib.linux-aarch64-3.6/torchaudio
copying torchaudio/version.py -> build/lib.linux-aarch64-3.6/torchaudio
copying torchaudio/transforms.py -> build/lib.linux-aarch64-3.6/torchaudio
copying torchaudio/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio
copying torchaudio/kaldi_io.py -> build/lib.linux-aarch64-3.6/torchaudio
creating build/lib.linux-aarch64-3.6/torchaudio/models
copying torchaudio/models/conv_tasnet.py -> build/lib.linux-aarch64-3.6/torchaudio/models
copying torchaudio/models/wavernn.py -> build/lib.linux-aarch64-3.6/torchaudio/models
copying torchaudio/models/wav2letter.py -> build/lib.linux-aarch64-3.6/torchaudio/models
copying torchaudio/models/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/models
creating build/lib.linux-aarch64-3.6/torchaudio/compliance
copying torchaudio/compliance/kaldi.py -> build/lib.linux-aarch64-3.6/torchaudio/compliance
copying torchaudio/compliance/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/compliance
creating build/lib.linux-aarch64-3.6/torchaudio/sox_effects
copying torchaudio/sox_effects/sox_effects.py -> build/lib.linux-aarch64-3.6/torchaudio/sox_effects
copying torchaudio/sox_effects/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/sox_effects
creating build/lib.linux-aarch64-3.6/torchaudio/extension
copying torchaudio/extension/extension.py -> build/lib.linux-aarch64-3.6/torchaudio/extension
copying torchaudio/extension/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/extension
creating build/lib.linux-aarch64-3.6/torchaudio/functional
copying torchaudio/functional/functional.py -> build/lib.linux-aarch64-3.6/torchaudio/functional
copying torchaudio/functional/filtering.py -> build/lib.linux-aarch64-3.6/torchaudio/functional
copying torchaudio/functional/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/functional
creating build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/yesno.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/librispeech.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/utils.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/libritts.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/ljspeech.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/speechcommands.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/vctk.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/commonvoice.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/cmuarctic.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/gtzan.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/tedlium.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
creating build/lib.linux-aarch64-3.6/torchaudio/utils
copying torchaudio/utils/sox_utils.py -> build/lib.linux-aarch64-3.6/torchaudio/utils
copying torchaudio/utils/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/utils
creating build/lib.linux-aarch64-3.6/torchaudio/_internal
copying torchaudio/_internal/misc_ops.py -> build/lib.linux-aarch64-3.6/torchaudio/_internal
copying torchaudio/_internal/module_utils.py -> build/lib.linux-aarch64-3.6/torchaudio/_internal
copying torchaudio/_internal/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/_internal
copying torchaudio/_internal/fft.py -> build/lib.linux-aarch64-3.6/torchaudio/_internal
creating build/lib.linux-aarch64-3.6/torchaudio/backend
copying torchaudio/backend/soundfile_backend.py -> build/lib.linux-aarch64-3.6/torchaudio/backend
copying torchaudio/backend/common.py -> build/lib.linux-aarch64-3.6/torchaudio/backend
copying torchaudio/backend/utils.py -> build/lib.linux-aarch64-3.6/torchaudio/backend
copying torchaudio/backend/sox_backend.py -> build/lib.linux-aarch64-3.6/torchaudio/backend
copying torchaudio/backend/no_backend.py -> build/lib.linux-aarch64-3.6/torchaudio/backend
copying torchaudio/backend/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/backend
copying torchaudio/backend/sox_io_backend.py -> build/lib.linux-aarch64-3.6/torchaudio/backend
copying torchaudio/backend/_soundfile_backend.py -> build/lib.linux-aarch64-3.6/torchaudio/backend
running build_ext
-- The C compiler identification is GNU 7.5.0
-- The CXX compiler identification is GNU 7.5.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - not found
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE
-- Found CUDA: /usr/local/cuda-10.2 (found version "10.2")
-- Caffe2: CUDA detected: 10.2
-- Caffe2: CUDA nvcc is: /usr/local/cuda-10.2/bin/nvcc
-- Caffe2: CUDA toolkit directory: /usr/local/cuda-10.2
-- Caffe2: Header version is: 10.2
-- Found CUDNN: /usr/lib/aarch64-linux-gnu/libcudnn.so
-- Found cuDNN: v8.0.0 (include: /usr/include, library: /usr/lib/aarch64-linux-gnu/libcudnn.so)
CMake Warning at /home/discort/projects/.env/lib/python3.6/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:198 (message):
Failed to compute shorthash for libnvrtc.so
Call Stack (most recent call first):
/home/discort/projects/.env/lib/python3.6/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:88 (include)
/home/discort/projects/.env/lib/python3.6/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)
CMakeLists.txt:55 (find_package)
-- Autodetected CUDA architecture(s): 7.2
-- Added CUDA NVCC flags for: -gencode;arch=compute_72,code=sm_72
-- Found Torch: /home/discort/projects/.env/lib/python3.6/site-packages/torch/lib/libtorch.so
get_version.sh: 37: get_version.sh: Bad substitution
get_version.sh: 45: get_version.sh: [[: not found
get_version.sh: The version number "5.5" specified in src/.version is not in MAJOR.MINOR format.
get_version.sh: Stopping the construction of full version number from git history.
-- Configuring done
-- Generating done
-- Build files have been written to: /home/discort/projects/audio/build/temp.linux-aarch64-3.6
[1/19] /usr/bin/c++ -I../../third_party/kaldi/src -I../../third_party/kaldi/submodule/src -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda-10.2/include -Wall -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility=hidden -O3 -DNDEBUG -fPIC -D_GLIBCXX_USE_CXX11_ABI=1 -std=gnu++14 -MD -MT third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/base/kaldi-error.cc.o -MF third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/base/kaldi-error.cc.o.d -o third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/base/kaldi-error.cc.o -c ../../third_party/kaldi/submodule/src/base/kaldi-error.cc
[2/19] /usr/bin/c++ -I../../third_party/kaldi/src -I../../third_party/kaldi/submodule/src -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda-10.2/include -Wall -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility=hidden -O3 -DNDEBUG -fPIC -D_GLIBCXX_USE_CXX11_ABI=1 -std=gnu++14 -MD -MT third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/base/kaldi-math.cc.o -MF third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/base/kaldi-math.cc.o.d -o third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/base/kaldi-math.cc.o -c ../../third_party/kaldi/submodule/src/base/kaldi-math.cc
[3/19] /usr/bin/c++ -I../../third_party/kaldi/src -I../../third_party/kaldi/submodule/src -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda-10.2/include -Wall -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility=hidden -O3 -DNDEBUG -fPIC -D_GLIBCXX_USE_CXX11_ABI=1 -std=gnu++14 -MD -MT third_party/kaldi/CMakeFiles/kaldi.dir/src/matrix/kaldi-matrix.cc.o -MF third_party/kaldi/CMakeFiles/kaldi.dir/src/matrix/kaldi-matrix.cc.o.d -o third_party/kaldi/CMakeFiles/kaldi.dir/src/matrix/kaldi-matrix.cc.o -c ../../third_party/kaldi/src/matrix/kaldi-matrix.cc
[4/19] /usr/bin/c++ -I../../third_party/kaldi/src -I../../third_party/kaldi/submodule/src -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda-10.2/include -Wall -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility=hidden -O3 -DNDEBUG -fPIC -D_GLIBCXX_USE_CXX11_ABI=1 -std=gnu++14 -MD -MT third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/feat/resample.cc.o -MF third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/feat/resample.cc.o.d -o third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/feat/resample.cc.o -c ../../third_party/kaldi/submodule/src/feat/resample.cc
[5/19] /usr/bin/c++ -I../../third_party/kaldi/src -I../../third_party/kaldi/submodule/src -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda-10.2/include -Wall -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility=hidden -O3 -DNDEBUG -fPIC -D_GLIBCXX_USE_CXX11_ABI=1 -std=gnu++14 -MD -MT third_party/kaldi/CMakeFiles/kaldi.dir/src/matrix/kaldi-vector.cc.o -MF third_party/kaldi/CMakeFiles/kaldi.dir/src/matrix/kaldi-vector.cc.o.d -o third_party/kaldi/CMakeFiles/kaldi.dir/src/matrix/kaldi-vector.cc.o -c ../../third_party/kaldi/src/matrix/kaldi-vector.cc
[6/19] /usr/bin/c++ -I../../third_party/kaldi/src -I../../third_party/kaldi/submodule/src -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda-10.2/include -Wall -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility=hidden -O3 -DNDEBUG -fPIC -D_GLIBCXX_USE_CXX11_ABI=1 -std=gnu++14 -MD -MT third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/feat/feature-functions.cc.o -MF third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/feat/feature-functions.cc.o.d -o third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/feat/feature-functions.cc.o -c ../../third_party/kaldi/submodule/src/feat/feature-functions.cc
[7/19] /usr/bin/c++ -DTORCH_API_INCLUDE_EXTENSION_H -D_torchaudio_EXPORTS -I../../ -I/usr/include/python3.6m -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda-10.2/include -I../../third_party/kaldi/src -I../../third_party/kaldi/submodule/src -Wall -D_GLIBCXX_USE_CXX11_ABI=1 -O3 -DNDEBUG -fPIC -D_GLIBCXX_USE_CXX11_ABI=1 -std=gnu++14 -MD -MT torchaudio/csrc/CMakeFiles/_torchaudio.dir/sox/legacy.cpp.o -MF torchaudio/csrc/CMakeFiles/_torchaudio.dir/sox/legacy.cpp.o.d -o torchaudio/csrc/CMakeFiles/_torchaudio.dir/sox/legacy.cpp.o -c ../../torchaudio/csrc/sox/legacy.cpp
[8/19] /usr/bin/c++ -I../../third_party/kaldi/src -I../../third_party/kaldi/submodule/src -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda-10.2/include -Wall -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility=hidden -O3 -DNDEBUG -fPIC -D_GLIBCXX_USE_CXX11_ABI=1 -std=gnu++14 -MD -MT third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/feat/pitch-functions.cc.o -MF third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/feat/pitch-functions.cc.o.d -o third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/feat/pitch-functions.cc.o -c ../../third_party/kaldi/submodule/src/feat/pitch-functions.cc
../../third_party/kaldi/submodule/src/feat/pitch-functions.cc: In member function ‘void kaldi::OnlinePitchFeatureImpl::UpdateRemainder(const kaldi::VectorBase
@discort
Note that the libsox
installed from apt at the moment is 14.4.2+git20190427-2
, which is something we do not support as it has an issue with in-memory decoding and causes un-deterministic behavior if you use file-like object for loading data.
@discort
If you have a extra time, can you help us and try #1484 ? I believe this will make it work with Jetson but I do not have the hardware, so I cannot test it by myself.
@mthrok
I'm happy to help with this issue.
Please let me know if I made correct steps to reproduce this issue: (the build command taken from https://github.com/pytorch/audio/blob/master/packaging/torchaudio/build.sh)
git clone --recursive https://github.com/pytorch/audio/ torchaudio && cd torchaudio
BUILD_TRANSDUCER=1 BUILD_SOX=1 python setup.py install --single-version-externally-managed --record=record.txt
on master c4a17027be9060e97b7ab056a9fb00679038bf64: Environment:
Python 3.6.9
Package: nvidia-jetpack
Version: 4.4.1-b50
Architecture: arm64
```
BUILD_TRANSDUCER=1 BUILD_SOX=1 python setup.py install --single-version-externally-managed --record=record.txt
-- Building version 0.9.0a0+c4a1702
running install
running build
running build_py
creating build
creating build/lib.linux-aarch64-3.6
creating build/lib.linux-aarch64-3.6/torchaudio
copying torchaudio/version.py -> build/lib.linux-aarch64-3.6/torchaudio
copying torchaudio/transforms.py -> build/lib.linux-aarch64-3.6/torchaudio
copying torchaudio/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio
copying torchaudio/kaldi_io.py -> build/lib.linux-aarch64-3.6/torchaudio
creating build/lib.linux-aarch64-3.6/torchaudio/models
copying torchaudio/models/deepspeech.py -> build/lib.linux-aarch64-3.6/torchaudio/models
copying torchaudio/models/conv_tasnet.py -> build/lib.linux-aarch64-3.6/torchaudio/models
copying torchaudio/models/wavernn.py -> build/lib.linux-aarch64-3.6/torchaudio/models
copying torchaudio/models/wav2letter.py -> build/lib.linux-aarch64-3.6/torchaudio/models
copying torchaudio/models/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/models
creating build/lib.linux-aarch64-3.6/torchaudio/prototype
copying torchaudio/prototype/rnnt_loss.py -> build/lib.linux-aarch64-3.6/torchaudio/prototype
copying torchaudio/prototype/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/prototype
creating build/lib.linux-aarch64-3.6/torchaudio/compliance
copying torchaudio/compliance/kaldi.py -> build/lib.linux-aarch64-3.6/torchaudio/compliance
copying torchaudio/compliance/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/compliance
creating build/lib.linux-aarch64-3.6/torchaudio/sox_effects
copying torchaudio/sox_effects/sox_effects.py -> build/lib.linux-aarch64-3.6/torchaudio/sox_effects
copying torchaudio/sox_effects/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/sox_effects
creating build/lib.linux-aarch64-3.6/torchaudio/extension
copying torchaudio/extension/extension.py -> build/lib.linux-aarch64-3.6/torchaudio/extension
copying torchaudio/extension/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/extension
creating build/lib.linux-aarch64-3.6/torchaudio/functional
copying torchaudio/functional/functional.py -> build/lib.linux-aarch64-3.6/torchaudio/functional
copying torchaudio/functional/filtering.py -> build/lib.linux-aarch64-3.6/torchaudio/functional
copying torchaudio/functional/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/functional
creating build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/yesno.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/librispeech.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/utils.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/libritts.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/ljspeech.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/speechcommands.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/vctk.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/commonvoice.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/cmuarctic.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/gtzan.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
copying torchaudio/datasets/tedlium.py -> build/lib.linux-aarch64-3.6/torchaudio/datasets
creating build/lib.linux-aarch64-3.6/torchaudio/utils
copying torchaudio/utils/sox_utils.py -> build/lib.linux-aarch64-3.6/torchaudio/utils
copying torchaudio/utils/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/utils
creating build/lib.linux-aarch64-3.6/torchaudio/_internal
copying torchaudio/_internal/module_utils.py -> build/lib.linux-aarch64-3.6/torchaudio/_internal
copying torchaudio/_internal/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/_internal
copying torchaudio/_internal/fft.py -> build/lib.linux-aarch64-3.6/torchaudio/_internal
creating build/lib.linux-aarch64-3.6/torchaudio/backend
copying torchaudio/backend/soundfile_backend.py -> build/lib.linux-aarch64-3.6/torchaudio/backend
copying torchaudio/backend/common.py -> build/lib.linux-aarch64-3.6/torchaudio/backend
copying torchaudio/backend/utils.py -> build/lib.linux-aarch64-3.6/torchaudio/backend
copying torchaudio/backend/no_backend.py -> build/lib.linux-aarch64-3.6/torchaudio/backend
copying torchaudio/backend/__init__.py -> build/lib.linux-aarch64-3.6/torchaudio/backend
copying torchaudio/backend/sox_io_backend.py -> build/lib.linux-aarch64-3.6/torchaudio/backend
running build_ext
-- The C compiler identification is GNU 7.5.0
-- The CXX compiler identification is GNU 7.5.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- The CUDA compiler identification is NVIDIA 10.2.89
-- Check for working CUDA compiler: /usr/local/cuda-10.2/bin/nvcc
-- Check for working CUDA compiler: /usr/local/cuda-10.2/bin/nvcc -- works
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - not found
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE
-- Found CUDA: /usr/local/cuda-10.2 (found version "10.2")
-- Caffe2: CUDA detected: 10.2
-- Caffe2: CUDA nvcc is: /usr/local/cuda-10.2/bin/nvcc
-- Caffe2: CUDA toolkit directory: /usr/local/cuda-10.2
-- Caffe2: Header version is: 10.2
-- Found CUDNN: /usr/lib/aarch64-linux-gnu/libcudnn.so
-- Found cuDNN: v8.0.0 (include: /usr/include, library: /usr/lib/aarch64-linux-gnu/libcudnn.so)
CMake Warning at /home/discort/projects/.env/lib/python3.6/site-packages/torch/share/cmake/Caffe2/public/cuda.cmake:198 (message):
Failed to compute shorthash for libnvrtc.so
Call Stack (most recent call first):
/home/discort/projects/.env/lib/python3.6/site-packages/torch/share/cmake/Caffe2/Caffe2Config.cmake:88 (include)
/home/discort/projects/.env/lib/python3.6/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:68 (find_package)
CMakeLists.txt:68 (find_package)
-- Autodetected CUDA architecture(s): 7.2
-- Added CUDA NVCC flags for: -gencode;arch=compute_72,code=sm_72
-- Found Torch: /home/discort/projects/.env/lib/python3.6/site-packages/torch/lib/libtorch.so
get_version.sh: 37: get_version.sh: Bad substitution
get_version.sh: 45: get_version.sh: [[: not found
get_version.sh: The version number "5.5" specified in src/.version is not in MAJOR.MINOR format.
get_version.sh: Stopping the construction of full version number from git history.
-- Configuring done
-- Generating done
-- Build files have been written to: /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6
[1/103] cd /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame-build && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/tmp && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame-stamp && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/third_party/sox/archives && /usr/bin/cmake -E touch /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame-stamp/lame-mkdir
[2/103] cd /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/mad && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/mad-build && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/tmp && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/mad-stamp && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/third_party/sox/archives && /usr/bin/cmake -E touch /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/mad-stamp/mad-mkdir
[3/103] cd /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/ogg && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/ogg-build && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/tmp && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/ogg-stamp && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/third_party/sox/archives && /usr/bin/cmake -E touch /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/ogg-stamp/ogg-mkdir
[4/103] cd /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/amr && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/amr-build && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/tmp && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/amr-stamp && /usr/bin/cmake -E make_directory /home/discort/projects/torchaudio/third_party/sox/archives && /usr/bin/cmake -E touch /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/amr-stamp/amr-mkdir
[5/103] cd /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src && /usr/bin/cmake -P /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame-stamp/lame-download-Release.cmake && /usr/bin/cmake -E touch /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame-stamp/lame-download
-- lame download command succeeded. See also /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame-stamp/lame-download-*.log
[6/103] cd /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox && /usr/bin/cmake -E echo_append && /usr/bin/cmake -E touch /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame-stamp/lame-update
[7/103] cd /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox && /usr/bin/cmake -E echo_append && /usr/bin/cmake -E touch /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame-stamp/lame-patch
[8/103] cd /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src && /usr/bin/cmake -P /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/ogg-stamp/ogg-download-Release.cmake && /usr/bin/cmake -E touch /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/ogg-stamp/ogg-download
-- ogg download command succeeded. See also /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/ogg-stamp/ogg-download-*.log
[9/103] /usr/bin/c++ -I../../third_party/kaldi/src -I../../third_party/kaldi/submodule/src -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda-10.2/include -Wall -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility=hidden -O3 -DNDEBUG -fPIC -D_GLIBCXX_USE_CXX11_ABI=1 -std=gnu++14 -MD -MT third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/base/kaldi-math.cc.o -MF third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/base/kaldi-math.cc.o.d -o third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/base/kaldi-math.cc.o -c ../../third_party/kaldi/submodule/src/base/kaldi-math.cc
[10/103] cd /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox && /usr/bin/cmake -E echo_append && /usr/bin/cmake -E touch /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/ogg-stamp/ogg-update
[11/103] cd /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox && /usr/bin/cmake -E echo_append && /usr/bin/cmake -E touch /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/ogg-stamp/ogg-patch
[12/103] /usr/bin/c++ -I../../third_party/kaldi/src -I../../third_party/kaldi/submodule/src -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda-10.2/include -Wall -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility=hidden -O3 -DNDEBUG -fPIC -D_GLIBCXX_USE_CXX11_ABI=1 -std=gnu++14 -MD -MT third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/base/kaldi-error.cc.o -MF third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/base/kaldi-error.cc.o.d -o third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/base/kaldi-error.cc.o -c ../../third_party/kaldi/submodule/src/base/kaldi-error.cc
[13/103] cd /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src && /usr/bin/cmake -P /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/mad-stamp/mad-download-Release.cmake && /usr/bin/cmake -E touch /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/mad-stamp/mad-download
-- mad download command succeeded. See also /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/mad-stamp/mad-download-*.log
[14/103] cd /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame-build && /usr/bin/cmake -P /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame-stamp/lame-configure-Release.cmake && /usr/bin/cmake -E touch /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame-stamp/lame-configure
FAILED: third_party/sox/src/lame-stamp/lame-configure
cd /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame-build && /usr/bin/cmake -P /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame-stamp/lame-configure-Release.cmake && /usr/bin/cmake -E touch /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame-stamp/lame-configure
CMake Error at /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame-stamp/lame-configure-Release.cmake:16 (message):
Command failed: 1
'/usr/bin/cmake' '-E' 'env' 'PKG_CONFIG_PATH=/home/discort/projects/torchaudio/third_party/sox/../install/lib/pkgconfig' 'LDFLAGS=-L/home/discort/projects/torchaudio/third_party/sox/../install/lib ' 'CFLAGS=-I/home/discort/projects/torchaudio/third_party/sox/../install/include -fvisibility=hidden ' '/home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame/configure' '--quiet' '--disable-shared' '--enable-static' '--prefix=/home/discort/projects/torchaudio/third_party/sox/../install' '--with-pic' '--disable-dependency-tracking' '--disable-debug' '--disable-examples' '--disable-doc' '--enable-nasm'
See also
/home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/lame-stamp/lame-configure-*.log
[15/103] cd /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/mad && patch < /home/discort/projects/torchaudio/third_party/sox/patch/libmad.patch && /usr/bin/cmake -E touch /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/mad-stamp/mad-patch
patching file configure
[16/103] cd /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox && /usr/bin/cmake -E echo_append && /usr/bin/cmake -E touch /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/mad-stamp/mad-update
[17/103] cd /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src && /usr/bin/cmake -P /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/amr-stamp/amr-download-Release.cmake && /usr/bin/cmake -E touch /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/amr-stamp/amr-download
-- amr download command succeeded. See also /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/amr-stamp/amr-download-*.log
[18/103] cd /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/ogg-build && /usr/bin/cmake -P /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/ogg-stamp/ogg-configure-Release.cmake && /usr/bin/cmake -E touch /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/ogg-stamp/ogg-configure
-- ogg configure command succeeded. See also /home/discort/projects/torchaudio/build/temp.linux-aarch64-3.6/third_party/sox/src/ogg-stamp/ogg-configure-*.log
[19/103] /usr/bin/c++ -I../../third_party/kaldi/src -I../../third_party/kaldi/submodule/src -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda-10.2/include -Wall -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility=hidden -O3 -DNDEBUG -fPIC -D_GLIBCXX_USE_CXX11_ABI=1 -std=gnu++14 -MD -MT third_party/kaldi/CMakeFiles/kaldi.dir/src/matrix/kaldi-matrix.cc.o -MF third_party/kaldi/CMakeFiles/kaldi.dir/src/matrix/kaldi-matrix.cc.o.d -o third_party/kaldi/CMakeFiles/kaldi.dir/src/matrix/kaldi-matrix.cc.o -c ../../third_party/kaldi/src/matrix/kaldi-matrix.cc
[20/103] /usr/bin/c++ -I../../third_party/kaldi/src -I../../third_party/kaldi/submodule/src -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda-10.2/include -Wall -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility=hidden -O3 -DNDEBUG -fPIC -D_GLIBCXX_USE_CXX11_ABI=1 -std=gnu++14 -MD -MT third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/feat/feature-functions.cc.o -MF third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/feat/feature-functions.cc.o.d -o third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/feat/feature-functions.cc.o -c ../../third_party/kaldi/submodule/src/feat/feature-functions.cc
[21/103] /usr/bin/c++ -I../../third_party/kaldi/src -I../../third_party/kaldi/submodule/src -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda-10.2/include -Wall -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility=hidden -O3 -DNDEBUG -fPIC -D_GLIBCXX_USE_CXX11_ABI=1 -std=gnu++14 -MD -MT third_party/kaldi/CMakeFiles/kaldi.dir/src/matrix/kaldi-vector.cc.o -MF third_party/kaldi/CMakeFiles/kaldi.dir/src/matrix/kaldi-vector.cc.o.d -o third_party/kaldi/CMakeFiles/kaldi.dir/src/matrix/kaldi-vector.cc.o -c ../../third_party/kaldi/src/matrix/kaldi-vector.cc
[22/103] /usr/bin/c++ -I../../third_party/kaldi/src -I../../third_party/kaldi/submodule/src -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include -isystem /home/discort/projects/.env/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -isystem /usr/local/cuda-10.2/include -Wall -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility=hidden -O3 -DNDEBUG -fPIC -D_GLIBCXX_USE_CXX11_ABI=1 -std=gnu++14 -MD -MT third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/feat/pitch-functions.cc.o -MF third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/feat/pitch-functions.cc.o.d -o third_party/kaldi/CMakeFiles/kaldi.dir/submodule/src/feat/pitch-functions.cc.o -c ../../third_party/kaldi/submodule/src/feat/pitch-functions.cc
../../third_party/kaldi/submodule/src/feat/pitch-functions.cc: In member function ‘void kaldi::OnlinePitchFeatureImpl::UpdateRemainder(const kaldi::VectorBase
I merged #1484 and now torchaudio should build fine with BUILD_SOX=1 python setup.py develop|install
on Jetson.
Closing this issue as there was multiple of build process change since the issue was opened.
If anyone encounter a build issue on Jetson or any other system, please open a new issue.
🐛 Bug
For the Jetson Series there is already Torch available but Torchaudio isnt.
To Reproduce
Try install from source to an Jetson Device. Steps to reproduce the behavior:
Workaround
This crash is a result of the libraries config.guess that doesnt know the aarch architecture. This can be bypassed by replacing midinstall the config.guess with a more current one like this https://raw.githubusercontent.com/ropensci/git2r/master/tools/config.guess
Replace the ones in those folders => /tmp/torchaudio-deps/lame-3.99.5/config.guess /tmp/torchaudio-deps/libmad-0.15.1b/config.guess
Also Edit the Script sudo packaging/build_from_source.sh to not override those changes again.
Now it should install.
Expected behavior
Normal installation of the required dependencies.
Environment