pytorch / pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration
https://pytorch.org
Other
84.01k stars 22.65k forks source link

subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--target', 'install', '--config', 'Release', '--', '-j', '64']' returned non-zero exit status 1. #49722

Closed yonggui-yan closed 3 years ago

yonggui-yan commented 3 years ago

🐛 Bug

To Reproduce

Steps to reproduce the behavior: following the step of installing from source. After "python setup.py install", I always encounter the following problem:

ninja: build stopped: subcommand failed. Traceback (most recent call last): File "setup.py", line 773, in build_deps() File "setup.py", line 320, in build_deps cmake=cmake) File "....../pytorch/tools/build_pytorch_libs.py", line 58, in build_caffe2 cmake.build(my_env) File "...../pytorch/tools/setup_helpers/cmake.py", line 346, in build self.run(build_args, my_env) File ".....pytorch/tools/setup_helpers/cmake.py", line 141, in run check_call(command, cwd=self.build_dir, env=env) File "...../miniconda3/lib/python3.6/subprocess.py", line 311, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--target', 'install', '--config', 'Release', '--', '-j', '64']' returned non-zero exit status 1.

Expected behavior

install successfully.

Finially, I hope get torch.distributed can work with cuda-aware mpi. And the cuda-aware openmpi has already been installed.

Environment

PyTorch version: N/A Is debug build: N/A CUDA used to build PyTorch: N/A ROCM used to build PyTorch: N/A

OS: Ubuntu 20.04.1 LTS (x86_64) GCC version: (Ubuntu 9.3.0-17ubuntu1~20.04) 9.3.0 Clang version: Could not collect CMake version: version 3.18.2

Python version: 3.6 (64-bit runtime) Is CUDA available: N/A CUDA runtime version: 10.1.243 GPU models and configuration: GPU 0: Quadro RTX 5000 GPU 1: Quadro RTX 5000

Nvidia driver version: 450.80.02 cuDNN version: Could not collect HIP runtime version: N/A MIOpen runtime version: N/A

Versions of relevant libraries: [pip3] numpy==1.19.2 [conda] blas 1.0 mkl
[conda] magma-cuda110 2.5.2 1 pytorch [conda] mkl 2020.2 256
[conda] mkl-include 2020.2 256
[conda] mkl-service 2.3.0 py36he8ac12f_0
[conda] mkl_fft 1.2.0 py36h23d657b_0
[conda] mkl_random 1.1.1 py36h0573a6f_0
[conda] numpy 1.19.2 py36h54aff64_0
[conda] numpy-base 1.19.2 py36hfa32c7d_0

Additional context

I also tried python 3.8, but same problem.

ninja: build stopped: subcommand failed.

subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--target', 'install', '--config', 'Release', '--', '-j', '64']' returned non-zero exit status 1.

cc @malfet @seemethere @walterddr

ngimel commented 3 years ago

Please provide full build logs.

yonggui-yan commented 3 years ago

Please provide full build logs.

I cannot find the logs file. I paste the output of install process in the following.

(base) yonggui@ubuntu-Precision-7920-Tower:~$ nvidia-smi Tue Dec 29 01:29:40 2020
+-----------------------------------------------------------------------------+ | NVIDIA-SMI 450.80.02 Driver Version: 450.80.02 CUDA Version: 11.0 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |===============================+======================+======================| | 0 Quadro RTX 5000 Off | 00000000:17:00.0 Off | Off | | 33% 29C P8 12W / 230W | 6MiB / 16125MiB | 0% Default | | | | N/A | +-------------------------------+----------------------+----------------------+ | 1 Quadro RTX 5000 Off | 00000000:A6:00.0 Off | Off | | 33% 29C P8 11W / 230W | 6MiB / 16125MiB | 0% Default | | | | N/A | +-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=============================================================================| | 0 N/A N/A 1585 G /usr/lib/xorg/Xorg 4MiB | | 1 N/A N/A 1585 G /usr/lib/xorg/Xorg 4MiB | +-----------------------------------------------------------------------------+ (base) yonggui@ubuntu-Precision-7920-Tower:~$ conda list

packages in environment at /home/yonggui/miniconda3:

#

Name Version Build Channel

_libgcc_mutex 0.1 main
blas 1.0 mkl
brotlipy 0.7.0 py36h27cfd23_1003
bzip2 1.0.8 h7b6447c_0
ca-certificates 2020.12.8 h06a4308_0
certifi 2020.12.5 py36h06a4308_0
cffi 1.14.4 py36h261ae71_0
chardet 4.0.0 py36h06a4308_1003
cmake 3.18.2 ha30ef3c_0
conda 4.9.2 py36h06a4308_0
conda-package-handling 1.7.2 py36h03888b9_0
cryptography 3.3.1 py36h3c74f83_0
dataclasses 0.7 py36_0
expat 2.2.10 he6710b0_2
future 0.18.2 py36_1
idna 2.9 py_1
intel-openmp 2020.2 254
krb5 1.18.2 h173b8e3_0
ld_impl_linux-64 2.33.1 h53a641e_7
libcurl 7.71.1 h20c2e04_1
libedit 3.1.20191231 h14c3975_1
libffi 3.3 he6710b0_1
libgcc-ng 9.1.0 hdf63c60_0
libssh2 1.9.0 h1ba5d50_1
libstdcxx-ng 9.1.0 hdf63c60_0
libuv 1.40.0 h7b6447c_0
lz4-c 1.9.2 heb0550a_3
magma-cuda110 2.5.2 1 pytorch mkl 2020.2 256
mkl-include 2020.2 256
mkl-service 2.3.0 py36he8ac12f_0
mkl_fft 1.2.0 py36h23d657b_0
mkl_random 1.1.1 py36h0573a6f_0
ncurses 6.2 he6710b0_1
ninja 1.10.2 py36hff7bd54_0
numpy 1.19.2 py36h54aff64_0
numpy-base 1.19.2 py36hfa32c7d_0
openssl 1.1.1i h27cfd23_0
pip 20.3.3 py36h06a4308_0
pycosat 0.6.3 py36h27cfd23_0
pycparser 2.20 py_0
pyopenssl 20.0.1 pyhd3eb1b0_1
pysocks 1.7.1 py36h06a4308_0
python 3.6.12 hcff3b4d_2
pyyaml 5.3.1 py36h7b6447c_0
readline 8.0 h7b6447c_0
requests 2.25.1 pyhd3eb1b0_0
rhash 1.4.0 h1ba5d50_0
ruamel_yaml 0.15.87 py36h7b6447c_0
setuptools 51.0.0 py36h06a4308_2
six 1.15.0 py36h06a4308_0
sqlite 3.33.0 h62c20be_0
tk 8.6.10 hbc83047_0
tqdm 4.46.0 py_0
typing_extensions 3.7.4.3 py_0
urllib3 1.26.2 pyhd3eb1b0_0
wheel 0.36.2 pyhd3eb1b0_0
xz 5.2.5 h7b6447c_0
yaml 0.1.7 had09818_2
zlib 1.2.11 h7b6447c_3
zstd 1.4.5 h9ceee32_0
(base) yonggui@ubuntu-Precision-7920-Tower:~$ cd pytorch (base) yonggui@ubuntu-Precision-7920-Tower:~/pytorch$ export CMAKE_PREFIX_PATH=${CONDA_PREFIX:-"../miniconda3"} (base) yonggui@ubuntu-Precision-7920-Tower:~/pytorch$ python setup.py clean Building wheel torch-1.8.0a0 running clean (base) yonggui@ubuntu-Precision-7920-Tower:~/pytorch$ python setup.py install Building wheel torch-1.8.0a0 -- Building version 1.8.0a0 cmake -GNinja -DBUILD_PYTHON=True -DBUILD_TEST=True -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX=/home/yonggui/pytorch/torch -DCMAKE_PREFIX_PATH=/home/yonggui/miniconda3 -DNUMPY_INCLUDE_DIR=/home/yonggui/miniconda3/lib/python3.6/site-packages/numpy/core/include -DPYTHON_EXECUTABLE=/home/yonggui/miniconda3/bin/python -DPYTHON_INCLUDE_DIR=/home/yonggui/miniconda3/include/python3.6m -DPYTHON_LIBRARY=/home/yonggui/miniconda3/lib/libpython3.6m.so.1.0 -DTORCH_BUILD_VERSION=1.8.0a0 -DUSE_NUMPY=True /home/yonggui/pytorch -- The CXX compiler identification is GNU 9.3.0 -- The C compiler identification is GNU 9.3.0 -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /usr/bin/c++ - skipped -- Detecting CXX compile features -- Detecting CXX compile features - done -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /usr/bin/cc - skipped -- Detecting C compile features -- Detecting C compile features - done -- Not forcing any particular BLAS to be found -- Performing Test COMPILER_WORKS -- Performing Test COMPILER_WORKS - Success -- Performing Test SUPPORT_GLIBCXX_USE_C99 -- Performing Test SUPPORT_GLIBCXX_USE_C99 - Success -- Performing Test CAFFE2_EXCEPTION_PTR_SUPPORTED -- Performing Test CAFFE2_EXCEPTION_PTR_SUPPORTED - Success -- std::exception_ptr is supported. -- Performing Test CAFFE2_NEED_TO_TURN_OFF_DEPRECATION_WARNING -- Performing Test CAFFE2_NEED_TO_TURN_OFF_DEPRECATION_WARNING - Failed -- Turning off deprecation warning due to glog. -- Performing Test CAFFE2_COMPILER_SUPPORTS_AVX2_EXTENSIONS -- Performing Test CAFFE2_COMPILER_SUPPORTS_AVX2_EXTENSIONS - Success -- Current compiler supports avx2 extension. Will build perfkernels. -- Performing Test CAFFE2_COMPILER_SUPPORTS_AVX512_EXTENSIONS -- Performing Test CAFFE2_COMPILER_SUPPORTS_AVX512_EXTENSIONS - Success -- Current compiler supports avx512f extension. Will build fbgemm. -- Performing Test COMPILER_SUPPORTS_HIDDEN_VISIBILITY -- Performing Test COMPILER_SUPPORTS_HIDDEN_VISIBILITY - Success -- Performing Test COMPILER_SUPPORTS_HIDDEN_INLINE_VISIBILITY -- Performing Test COMPILER_SUPPORTS_HIDDEN_INLINE_VISIBILITY - Success -- Performing Test COMPILER_SUPPORTS_RDYNAMIC -- Performing Test COMPILER_SUPPORTS_RDYNAMIC - Success -- Building using own protobuf under third_party per request. -- Use custom protobuf build. -- -- 3.11.4.0 -- Looking for pthread.h -- Looking for pthread.h - found -- Performing Test CMAKE_HAVE_LIBC_PTHREAD -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed -- Check if compiler accepts -pthread -- Check if compiler accepts -pthread - yes -- Found Threads: TRUE
-- Performing Test protobuf_HAVE_BUILTIN_ATOMICS -- Performing Test protobuf_HAVE_BUILTIN_ATOMICS - Success -- Caffe2 protobuf include directory: $<BUILD_INTERFACE:/home/yonggui/pytorch/third_party/protobuf/src>$ -- Trying to find preferred BLAS backend of choice: MKL -- MKL_THREADING = OMP -- Looking for sys/types.h -- Looking for sys/types.h - found -- Looking for stdint.h -- Looking for stdint.h - found -- Looking for stddef.h -- Looking for stddef.h - found -- Check size of void -- Check size of void - done CMake Warning (dev) at /home/yonggui/miniconda3/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:273 (message): The package name passed to find_package_handle_standard_args (OpenMP_C) does not match the name of the calling package (OpenMP). This can lead to problems in calling code that expects find_package result variables (e.g., _FOUND) to follow a certain pattern. Call Stack (most recent call first): cmake/Modules/FindOpenMP.cmake:565 (find_package_handle_standard_args) cmake/Modules/FindMKL.cmake:213 (FIND_PACKAGE) cmake/Modules/FindMKL.cmake:307 (CHECK_ALL_LIBRARIES) cmake/Dependencies.cmake:140 (find_package) CMakeLists.txt:533 (include) This warning is for project developers. Use -Wno-dev to suppress it.

CMake Warning (dev) at /home/yonggui/miniconda3/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:273 (message): The package name passed to find_package_handle_standard_args (OpenMP_CXX) does not match the name of the calling package (OpenMP). This can lead to problems in calling code that expects find_package result variables (e.g., _FOUND) to follow a certain pattern. Call Stack (most recent call first): cmake/Modules/FindOpenMP.cmake:565 (find_package_handle_standard_args) cmake/Modules/FindMKL.cmake:213 (FIND_PACKAGE) cmake/Modules/FindMKL.cmake:307 (CHECK_ALL_LIBRARIES) cmake/Dependencies.cmake:140 (find_package) CMakeLists.txt:533 (include) This warning is for project developers. Use -Wno-dev to suppress it.

-- Looking for cblas_sgemm -- Looking for cblas_sgemm - found -- MKL libraries: /home/yonggui/miniconda3/lib/libmkl_intel_lp64.so;/home/yonggui/miniconda3/lib/libmkl_gnu_thread.so;/home/yonggui/miniconda3/lib/libmkl_core.so;-fopenmp;/usr/lib/x86_64-linux-gnu/libpthread.so;/usr/lib/x86_64-linux-gnu/libm.so;/usr/lib/x86_64-linux-gnu/libdl.so -- MKL include directory: /home/yonggui/miniconda3/include -- MKL OpenMP type: GNU -- MKL OpenMP library: -fopenmp -- The ASM compiler identification is GNU -- Found assembler: /usr/bin/cc -- Brace yourself, we are building NNPACK -- Performing Test NNPACK_ARCH_IS_X86_32 -- Performing Test NNPACK_ARCH_IS_X86_32 - Failed -- Found PythonInterp: /home/yonggui/miniconda3/bin/python (found version "3.6.12") -- NNPACK backend is x86-64 -- Failed to find LLVM FileCheck -- Found Git: /usr/bin/git (found version "2.25.1") -- git Version: v1.4.0-505be96a -- Version: 1.4.0 -- Performing Test HAVE_CXX_FLAG_STD_CXX11 -- Performing Test HAVE_CXX_FLAG_STD_CXX11 - Success -- Performing Test HAVE_CXX_FLAG_WALL -- Performing Test HAVE_CXX_FLAG_WALL - Success -- Performing Test HAVE_CXX_FLAG_WEXTRA -- Performing Test HAVE_CXX_FLAG_WEXTRA - Success -- Performing Test HAVE_CXX_FLAG_WSHADOW -- Performing Test HAVE_CXX_FLAG_WSHADOW - Success -- Performing Test HAVE_CXX_FLAG_WERROR -- Performing Test HAVE_CXX_FLAG_WERROR - Success -- Performing Test HAVE_CXX_FLAG_PEDANTIC -- Performing Test HAVE_CXX_FLAG_PEDANTIC - Success -- Performing Test HAVE_CXX_FLAG_PEDANTIC_ERRORS -- Performing Test HAVE_CXX_FLAG_PEDANTIC_ERRORS - Success -- Performing Test HAVE_CXX_FLAG_WSHORTEN_64_TO_32 -- Performing Test HAVE_CXX_FLAG_WSHORTEN_64_TO_32 - Failed -- Performing Test HAVE_CXX_FLAG_WFLOAT_EQUAL -- Performing Test HAVE_CXX_FLAG_WFLOAT_EQUAL - Success -- Performing Test HAVE_CXX_FLAG_FSTRICT_ALIASING -- Performing Test HAVE_CXX_FLAG_FSTRICT_ALIASING - Success -- Performing Test HAVE_CXX_FLAG_WNO_DEPRECATED_DECLARATIONS -- Performing Test HAVE_CXX_FLAG_WNO_DEPRECATED_DECLARATIONS - Success -- Performing Test HAVE_CXX_FLAG_WSTRICT_ALIASING -- Performing Test HAVE_CXX_FLAG_WSTRICT_ALIASING - Success -- Performing Test HAVE_CXX_FLAG_WD654 -- Performing Test HAVE_CXX_FLAG_WD654 - Failed -- Performing Test HAVE_CXX_FLAG_WTHREAD_SAFETY -- Performing Test HAVE_CXX_FLAG_WTHREAD_SAFETY - Failed -- Performing Test HAVE_CXX_FLAG_COVERAGE -- Performing Test HAVE_CXX_FLAG_COVERAGE - Success -- Performing Test HAVE_STD_REGEX -- Performing Test HAVE_STD_REGEX -- Performing Test HAVE_STD_REGEX -- success -- Performing Test HAVE_GNU_POSIX_REGEX -- Performing Test HAVE_GNU_POSIX_REGEX -- Performing Test HAVE_GNU_POSIX_REGEX -- failed to compile -- Performing Test HAVE_POSIX_REGEX -- Performing Test HAVE_POSIX_REGEX -- Performing Test HAVE_POSIX_REGEX -- success -- Performing Test HAVE_STEADY_CLOCK -- Performing Test HAVE_STEADY_CLOCK -- Performing Test HAVE_STEADY_CLOCK -- success -- Performing Test COMPILER_SUPPORTS_AVX512 -- Performing Test COMPILER_SUPPORTS_AVX512 - Success CMake Warning (dev) at /home/yonggui/miniconda3/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:273 (message): The package name passed to find_package_handle_standard_args (OpenMP_C) does not match the name of the calling package (OpenMP). This can lead to problems in calling code that expects find_package result variables (e.g., _FOUND) to follow a certain pattern. Call Stack (most recent call first): cmake/Modules/FindOpenMP.cmake:565 (find_package_handle_standard_args) third_party/fbgemm/CMakeLists.txt:59 (find_package) This warning is for project developers. Use -Wno-dev to suppress it.

-- Found OpenMP_C: -fopenmp (found version "4.5") CMake Warning (dev) at /home/yonggui/miniconda3/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:273 (message): The package name passed to find_package_handle_standard_args (OpenMP_CXX) does not match the name of the calling package (OpenMP). This can lead to problems in calling code that expects find_package result variables (e.g., _FOUND) to follow a certain pattern. Call Stack (most recent call first): cmake/Modules/FindOpenMP.cmake:565 (find_package_handle_standard_args) third_party/fbgemm/CMakeLists.txt:59 (find_package) This warning is for project developers. Use -Wno-dev to suppress it.

-- Found OpenMP_CXX: -fopenmp (found version "4.5") -- Found OpenMP: TRUE (found version "4.5")
CMake Warning at third_party/fbgemm/CMakeLists.txt:61 (message): OpenMP found! OpenMP_C_INCLUDE_DIRS =

CMake Warning at third_party/fbgemm/CMakeLists.txt:136 (message):

CMake Warning at third_party/fbgemm/CMakeLists.txt:137 (message): CMAKE_BUILD_TYPE = Release

CMake Warning at third_party/fbgemm/CMakeLists.txt:138 (message): CMAKE_CXX_FLAGS_DEBUG is -g

CMake Warning at third_party/fbgemm/CMakeLists.txt:139 (message): CMAKE_CXX_FLAGS_RELEASE is -O3 -DNDEBUG

CMake Warning at third_party/fbgemm/CMakeLists.txt:140 (message):

-- Performing Test CxxFlagfno_threadsafe_statics -- Performing Test CxxFlagfno_threadsafe_statics - Success -- Performing Test CxxFlagfno_semantic_interposition -- Performing Test CxxFlagfno_semantic_interposition - Success -- Performing Test CxxFlagfmerge_all_constants -- Performing Test CxxFlagfmerge_all_constants - Success AsmJit Summary ASMJIT_DIR=/home/yonggui/pytorch/third_party/fbgemm/third_party/asmjit ASMJIT_TEST=FALSE ASMJIT_TARGET_TYPE=STATIC ASMJIT_DEPS=pthread;rt ASMJIT_LIBS=asmjit;pthread;rt ASMJIT_CFLAGS=-DASMJIT_STATIC ASMJIT_PRIVATE_CFLAGS=-Wall;-Wextra;-fno-math-errno;-fno-threadsafe-statics;-fno-semantic-interposition;-DASMJIT_STATIC ASMJIT_PRIVATE_CFLAGS_DBG= ASMJIT_PRIVATE_CFLAGS_REL=-O2;-fmerge-all-constants -- Could NOT find Numa (missing: Numa_INCLUDE_DIR Numa_LIBRARIES) CMake Warning at cmake/Dependencies.cmake:781 (message): Not compiling with NUMA. Suppress this warning with -DUSE_NUMA=OFF Call Stack (most recent call first): CMakeLists.txt:533 (include)

-- Using third party subdirectory Eigen. Python 3.6.12 :: Anaconda, Inc. -- Found PythonInterp: /home/yonggui/miniconda3/bin/python (found suitable version "3.6.12", minimum required is "3.0") -- Found PythonLibs: /home/yonggui/miniconda3/lib/libpython3.6m.so.1.0 (found suitable version "3.6.12", minimum required is "3.0") -- Could NOT find pybind11 (missing: pybind11_DIR) -- Could NOT find pybind11 (missing: pybind11_INCLUDE_DIR) -- Using third_party/pybind11. -- pybind11 include dirs: /home/yonggui/pytorch/cmake/../third_party/pybind11/include -- Found MPI_C: /usr/local/lib/libmpi.so (found version "3.1") -- Found MPI_CXX: /usr/local/lib/libmpi.so (found version "3.1") -- Found MPI: TRUE (found version "3.1")
-- MPI support found -- MPI compile flags: -pthread -- MPI include path: /usr/local/include -- MPI LINK flags path: -Wl,-rpath -Wl,/usr/local/lib -Wl,--enable-new-dtags -pthread -- MPI libraries: /usr/local/lib/libmpi.so -- Found OpenMPI with CUDA support built. CMake Warning (dev) at /home/yonggui/miniconda3/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:273 (message): The package name passed to find_package_handle_standard_args (OpenMP_C) does not match the name of the calling package (OpenMP). This can lead to problems in calling code that expects find_package result variables (e.g., _FOUND) to follow a certain pattern. Call Stack (most recent call first): cmake/Modules/FindOpenMP.cmake:565 (find_package_handle_standard_args) cmake/Dependencies.cmake:1098 (find_package) CMakeLists.txt:533 (include) This warning is for project developers. Use -Wno-dev to suppress it.

CMake Warning (dev) at /home/yonggui/miniconda3/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:273 (message): The package name passed to find_package_handle_standard_args (OpenMP_CXX) does not match the name of the calling package (OpenMP). This can lead to problems in calling code that expects find_package result variables (e.g., _FOUND) to follow a certain pattern. Call Stack (most recent call first): cmake/Modules/FindOpenMP.cmake:565 (find_package_handle_standard_args) cmake/Dependencies.cmake:1098 (find_package) CMakeLists.txt:533 (include) This warning is for project developers. Use -Wno-dev to suppress it.

-- Adding OpenMP CXX_FLAGS: -fopenmp -- Will link against OpenMP libraries: /usr/lib/gcc/x86_64-linux-gnu/9/libgomp.so;/usr/lib/x86_64-linux-gnu/libpthread.so -- Found CUDA: /usr (found version "10.1") -- Caffe2: CUDA detected: 10.1 -- Caffe2: CUDA nvcc is: /usr/bin/nvcc -- Caffe2: CUDA toolkit directory: /usr -- Caffe2: Header version is: 10.1 -- Could NOT find CUDNN (missing: CUDNN_LIBRARY_PATH CUDNN_INCLUDE_PATH) CMake Warning at cmake/public/cuda.cmake:109 (message): Caffe2: Cannot find cuDNN library. Turning the option off Call Stack (most recent call first): cmake/Dependencies.cmake:1148 (include) CMakeLists.txt:533 (include)

-- Autodetected CUDA architecture(s): 7.5 7.5 -- Added CUDA NVCC flags for: -gencode;arch=compute_75,code=sm_75 -- Autodetected CUDA architecture(s): 7.5 7.5 CMake Warning at cmake/External/nccl.cmake:66 (message): Objcopy version is too old to support NCCL library slimming Call Stack (most recent call first): cmake/Dependencies.cmake:1271 (include) CMakeLists.txt:533 (include)

-- Could NOT find CUB (missing: CUB_INCLUDE_DIR) CMake Warning (dev) at third_party/gloo/CMakeLists.txt:21 (option): Policy CMP0077 is not set: option() honors normal variables. Run "cmake --help-policy CMP0077" for policy details. Use the cmake_policy command to set the policy and suppress this warning.

For compatibility with older versions of CMake, option is clearing the normal variable 'BUILD_BENCHMARK'. This warning is for project developers. Use -Wno-dev to suppress it.

-- Gloo build as SHARED library -- MPI include path: /usr/local/include -- MPI libraries: /usr/local/lib/libmpi.so -- Found CUDA: /usr (found suitable version "10.1", minimum required is "7.0") -- CUDA detected: 10.1 CMake Warning (dev) at /home/yonggui/miniconda3/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:273 (message): The package name passed to find_package_handle_standard_args (NCCL) does not match the name of the calling package (nccl). This can lead to problems in calling code that expects find_package result variables (e.g., _FOUND) to follow a certain pattern. Call Stack (most recent call first): third_party/gloo/cmake/Modules/Findnccl.cmake:45 (find_package_handle_standard_args) third_party/gloo/cmake/Dependencies.cmake:128 (find_package) third_party/gloo/CMakeLists.txt:102 (include) This warning is for project developers. Use -Wno-dev to suppress it.

-- Could NOT find NCCL (missing: NCCL_INCLUDE_DIR NCCL_LIBRARY) CMake Warning at third_party/gloo/cmake/Dependencies.cmake:133 (message): Not compiling with NCCL support. Suppress this warning with -DUSE_NCCL=OFF. Call Stack (most recent call first): third_party/gloo/CMakeLists.txt:102 (include)

-- Found CUDA: /usr (found version "10.1") -- Performing Test UV_LINT_W4 -- Performing Test UV_LINT_W4 - Failed -- Performing Test UV_LINT_WALL -- Performing Test UV_LINT_WALL - Success -- Performing Test UV_LINT_NO_UNUSED_PARAMETER -- Performing Test UV_LINT_NO_UNUSED_PARAMETER - Success -- Performing Test UV_LINT_STRICT_PROTOTYPES -- Performing Test UV_LINT_STRICT_PROTOTYPES - Success -- Performing Test UV_LINT_EXTRA -- Performing Test UV_LINT_EXTRA - Success -- Found uv: 1.38.1 (found version "1.38.1") CMake Warning at cmake/Dependencies.cmake:1385 (message): Metal is only used in ios builds. Call Stack (most recent call first): CMakeLists.txt:533 (include)

Generated: /home/yonggui/pytorch/build/third_party/onnx/onnx/onnx_onnx_torch-ml.proto Generated: /home/yonggui/pytorch/build/third_party/onnx/onnx/onnx-operators_onnx_torch-ml.proto Generated: /home/yonggui/pytorch/build/third_party/onnx/onnx/onnx-data_onnx_torch.proto -- -- **** Summary **** -- CMake version : 3.18.2 -- CMake command : /home/yonggui/miniconda3/bin/cmake -- System : Linux -- C++ compiler : /usr/bin/c++ -- C++ compiler version : 9.3.0 -- CXX flags : -Wno-deprecated -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -Wnon-virtual-dtor -- Build type : Release -- Compile definitions : TH_BLAS_MKL;ONNX_ML=1;ONNXIFI_ENABLE_EXT=1 -- CMAKE_PREFIX_PATH : /home/yonggui/miniconda3;/usr -- CMAKE_INSTALL_PREFIX : /home/yonggui/pytorch/torch -- CMAKE_MODULE_PATH : /home/yonggui/pytorch/cmake/Modules;/home/yonggui/pytorch/cmake/public/../Modules_CUDA_fix -- -- ONNX version : 1.8.0 -- ONNX NAMESPACE : onnx_torch -- ONNX_BUILD_TESTS : OFF -- ONNX_BUILD_BENCHMARKS : OFF -- ONNX_USE_LITE_PROTO : OFF -- ONNXIFI_DUMMY_BACKEND : OFF -- ONNXIFI_ENABLE_EXT : OFF -- -- Protobuf compiler : -- Protobuf includes : -- Protobuf libraries : -- BUILD_ONNX_PYTHON : OFF -- -- **** Summary **** -- CMake version : 3.18.2 -- CMake command : /home/yonggui/miniconda3/bin/cmake -- System : Linux -- C++ compiler : /usr/bin/c++ -- C++ compiler version : 9.3.0 -- CXX flags : -Wno-deprecated -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -Wnon-virtual-dtor -- Build type : Release -- Compile definitions : TH_BLAS_MKL;ONNX_ML=1;ONNXIFI_ENABLE_EXT=1 -- CMAKE_PREFIX_PATH : /home/yonggui/miniconda3;/usr -- CMAKE_INSTALL_PREFIX : /home/yonggui/pytorch/torch -- CMAKE_MODULE_PATH : /home/yonggui/pytorch/cmake/Modules;/home/yonggui/pytorch/cmake/public/../Modules_CUDA_fix -- -- ONNX version : 1.4.1 -- ONNX NAMESPACE : onnx_torch -- ONNX_BUILD_TESTS : OFF -- ONNX_BUILD_BENCHMARKS : OFF -- ONNX_USE_LITE_PROTO : OFF -- ONNXIFI_DUMMY_BACKEND : OFF -- -- Protobuf compiler : -- Protobuf includes : -- Protobuf libraries : -- BUILD_ONNX_PYTHON : OFF -- Found CUDA with FP16 support, compiling with torch.cuda.HalfTensor -- Adding -DNDEBUG to compile flags -- Checking prototype magma_get_sgeqrf_nb for MAGMA_V2 -- Checking prototype magma_get_sgeqrf_nb for MAGMA_V2 - True -- Compiling with MAGMA support -- MAGMA INCLUDE DIRECTORIES: /home/yonggui/miniconda3/include -- MAGMA LIBRARIES: /home/yonggui/miniconda3/lib/libmagma.a -- MAGMA V2 check: 1 -- Could not find hardware support for NEON on this machine. -- No OMAP3 processor on this machine. -- No OMAP4 processor on this machine. -- Looking for cpuid.h -- Looking for cpuid.h - found -- Performing Test HAVE_GCC_GET_CPUID -- Performing Test HAVE_GCC_GET_CPUID - Success -- Performing Test NO_GCC_EBX_FPIC_BUG -- Performing Test NO_GCC_EBX_FPIC_BUG - Success -- -- Performing Test C_VSX_FOUND -- Performing Test C_VSX_FOUND - Failed -- Performing Test CXX_VSX_FOUND -- Performing Test CXX_VSX_FOUND - Failed -- -- Performing Test C_HAS_AVX_1 -- Performing Test C_HAS_AVX_1 - Failed -- Performing Test C_HAS_AVX_2 -- Performing Test C_HAS_AVX_2 - Success -- Performing Test C_HAS_AVX2_1 -- Performing Test C_HAS_AVX2_1 - Failed -- Performing Test C_HAS_AVX2_2 -- Performing Test C_HAS_AVX2_2 - Success -- Performing Test CXX_HAS_AVX_1 -- Performing Test CXX_HAS_AVX_1 - Failed -- Performing Test CXX_HAS_AVX_2 -- Performing Test CXX_HAS_AVX_2 - Success -- Performing Test CXX_HAS_AVX2_1 -- Performing Test CXX_HAS_AVX2_1 - Failed -- Performing Test CXX_HAS_AVX2_2 -- Performing Test CXX_HAS_AVX2_2 - Success -- AVX compiler support found -- AVX2 compiler support found -- Performing Test BLAS_F2C_DOUBLE_WORKS -- Performing Test BLAS_F2C_DOUBLE_WORKS - Failed -- Performing Test BLAS_F2C_FLOAT_WORKS -- Performing Test BLAS_F2C_FLOAT_WORKS - Success -- Performing Test BLAS_USE_CBLAS_DOT -- Performing Test BLAS_USE_CBLAS_DOT - Success -- Found a library with BLAS API (mkl). Full path: (/home/yonggui/miniconda3/lib/libmkl_intel_lp64.so;/home/yonggui/miniconda3/lib/libmkl_gnu_thread.so;/home/yonggui/miniconda3/lib/libmkl_core.so;-fopenmp;/usr/lib/x86_64-linux-gnu/libpthread.so;/usr/lib/x86_64-linux-gnu/libm.so;/usr/lib/x86_64-linux-gnu/libdl.so) -- Found a library with LAPACK API (mkl). -- USE_CUDNN is set to 0. Compiling without cuDNN support disabling ROCM because NOT USE_ROCM is set -- MIOpen not found. Compiling without MIOpen support -- MKLDNN_CPU_RUNTIME = OMP -- Intel MKL-DNN compat: set DNNL_ENABLE_CONCURRENT_EXEC to MKLDNN_ENABLE_CONCURRENT_EXEC with value ON -- Intel MKL-DNN compat: set DNNL_BUILD_EXAMPLES to MKLDNN_BUILD_EXAMPLES with value FALSE -- Intel MKL-DNN compat: set DNNL_BUILD_TESTS to MKLDNN_BUILD_TESTS with value FALSE -- Intel MKL-DNN compat: set DNNL_LIBRARY_TYPE to MKLDNN_LIBRARY_TYPE with value STATIC -- Intel MKL-DNN compat: set DNNL_ARCH_OPT_FLAGS to MKLDNN_ARCH_OPT_FLAGS with value -msse4 -- Intel MKL-DNN compat: set DNNL_CPU_RUNTIME to MKLDNN_CPU_RUNTIME with value OMP CMake Warning (dev) at /home/yonggui/miniconda3/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:273 (message): The package name passed to find_package_handle_standard_args (OpenMP_C) does not match the name of the calling package (OpenMP). This can lead to problems in calling code that expects find_package result variables (e.g., _FOUND) to follow a certain pattern. Call Stack (most recent call first): cmake/Modules/FindOpenMP.cmake:565 (find_package_handle_standard_args) third_party/ideep/mkl-dnn/cmake/OpenMP.cmake:61 (find_package) third_party/ideep/mkl-dnn/CMakeLists.txt:118 (include) This warning is for project developers. Use -Wno-dev to suppress it.

-- Found OpenMP_C: -fopenmp (found version "4.5") CMake Warning (dev) at /home/yonggui/miniconda3/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:273 (message): The package name passed to find_package_handle_standard_args (OpenMP_CXX) does not match the name of the calling package (OpenMP). This can lead to problems in calling code that expects find_package result variables (e.g., _FOUND) to follow a certain pattern. Call Stack (most recent call first): cmake/Modules/FindOpenMP.cmake:565 (find_package_handle_standard_args) third_party/ideep/mkl-dnn/cmake/OpenMP.cmake:61 (find_package) third_party/ideep/mkl-dnn/CMakeLists.txt:118 (include) This warning is for project developers. Use -Wno-dev to suppress it.

-- Found OpenMP_CXX: -fopenmp (found version "4.5") -- GPU support is disabled -- Primitive cache is enabled -- Found MKL-DNN: TRUE -- Looking for clock_gettime in rt -- Looking for clock_gettime in rt - found -- Looking for mmap -- Looking for mmap - found -- Looking for shm_open -- Looking for shm_open - found -- Looking for shm_unlink -- Looking for shm_unlink - found -- Looking for malloc_usable_size -- Looking for malloc_usable_size - found -- Performing Test C_HAS_THREAD -- Performing Test C_HAS_THREAD - Success -- Version: 7.0.3 -- Build type: Release -- CXX_STANDARD: 14 -- Performing Test has_std_14_flag -- Performing Test has_std_14_flag - Success -- Performing Test has_std_1y_flag -- Performing Test has_std_1y_flag - Success -- Performing Test SUPPORTS_USER_DEFINED_LITERALS -- Performing Test SUPPORTS_USER_DEFINED_LITERALS - Success -- Performing Test FMT_HAS_VARIANT -- Performing Test FMT_HAS_VARIANT - Success -- Required features: cxx_variadic_templates -- Looking for strtod_l -- Looking for strtod_l - not found -- GCC 9.3.0: Adding gcc and gcc_s libs to link line -- Performing Test HAS_WERROR_FORMAT -- Performing Test HAS_WERROR_FORMAT - Success -- Performing Test HAS_WERROR_CAST_FUNCTION_TYPE -- Performing Test HAS_WERROR_CAST_FUNCTION_TYPE - Success -- Looking for backtrace -- Looking for backtrace - found -- backtrace facility detected in default set of libraries -- Found Backtrace: /usr/include
-- don't use NUMA -- Performing Test COMPILER_SUPPORTS_NO_AVX256_SPLIT -- Performing Test COMPILER_SUPPORTS_NO_AVX256_SPLIT - Success -- Using ATen parallel backend: OMP CMake Warning (dev) at aten/src/ATen/CMakeLists.txt:75: Syntax Warning in cmake code at column 56

Argument not separated from preceding token by whitespace. This warning is for project developers. Use -Wno-dev to suppress it.

CMake Deprecation Warning at third_party/sleef/CMakeLists.txt:91 (cmake_policy): The OLD behavior for policy CMP0066 will be removed from a future version of CMake.

The cmake-policies(7) manual explains that the OLD behaviors of all policies are deprecated and that a policy should be set to OLD only under specific short-term circumstances. Projects should be ported to the NEW behavior and not rely on setting a policy to OLD.

-- Found OpenSSL: /home/yonggui/miniconda3/lib/libcrypto.so (found version "1.1.1i")
-- Check size of long double -- Check size of long double - done -- Performing Test COMPILER_SUPPORTS_LONG_DOUBLE -- Performing Test COMPILER_SUPPORTS_LONG_DOUBLE - Success -- Performing Test COMPILER_SUPPORTS_FLOAT128 -- Performing Test COMPILER_SUPPORTS_FLOAT128 - Success -- Performing Test COMPILER_SUPPORTS_SSE2 -- Performing Test COMPILER_SUPPORTS_SSE2 - Success -- Performing Test COMPILER_SUPPORTS_SSE4 -- Performing Test COMPILER_SUPPORTS_SSE4 - Success -- Performing Test COMPILER_SUPPORTS_AVX -- Performing Test COMPILER_SUPPORTS_AVX - Success -- Performing Test COMPILER_SUPPORTS_FMA4 -- Performing Test COMPILER_SUPPORTS_FMA4 - Success -- Performing Test COMPILER_SUPPORTS_AVX2 -- Performing Test COMPILER_SUPPORTS_AVX2 - Success -- Performing Test COMPILER_SUPPORTS_AVX512F -- Performing Test COMPILER_SUPPORTS_AVX512F - Success -- Performing Test COMPILER_SUPPORTS_OPENMP -- Performing Test COMPILER_SUPPORTS_OPENMP - Success -- Performing Test COMPILER_SUPPORTS_WEAK_ALIASES -- Performing Test COMPILER_SUPPORTS_WEAK_ALIASES - Success -- Performing Test COMPILER_SUPPORTS_BUILTIN_MATH -- Performing Test COMPILER_SUPPORTS_BUILTIN_MATH - Success -- Performing Test COMPILER_SUPPORTS_SYS_GETRANDOM -- Performing Test COMPILER_SUPPORTS_SYS_GETRANDOM - Success -- Configuring build for SLEEF-v3.6.0 Target system: Linux-5.4.0-53-generic Target processor: x86_64 Host system: Linux-5.4.0-53-generic Host processor: x86_64 Detected C compiler: GNU @ /usr/bin/cc CMake: 3.18.2 Make program: /home/yonggui/miniconda3/bin/ninja -- Using option -Wall -Wno-unused -Wno-attributes -Wno-unused-result -Wno-psabi -ffp-contract=off -fno-math-errno -fno-trapping-math to compile libsleef -- Building shared libs : OFF -- Building static test bins: OFF -- MPFR : LIB_MPFR-NOTFOUND -- GMP : LIBGMP-NOTFOUND -- RT : /usr/lib/x86_64-linux-gnu/librt.so -- FFTW3 : LIBFFTW3-NOTFOUND -- OPENSSL : 1.1.1i -- SDE : SDE_COMMAND-NOTFOUND -- RUNNING_ON_TRAVIS : -- COMPILER_SUPPORTS_OPENMP : 1 AT_INSTALL_INCLUDE_DIR include/ATen/core core header install: /home/yonggui/pytorch/build/aten/src/ATen/core/TensorBody.h -- Include NCCL operators -- Excluding FakeLowP operators -- Including IDEEP operators -- Excluding image processing operators due to no opencv -- Excluding video processing operators due to no opencv -- Include Observer library -- /usr/bin/c++ /home/yonggui/pytorch/torch/abi-check.cpp -o /home/yonggui/pytorch/build/abi-check -- Determined _GLIBCXX_USE_CXX11_ABI=1 -- MPI_INCLUDE_PATH: /usr/local/include -- MPI_LIBRARIES: /usr/local/lib/libmpi.so -- MPIEXEC: /usr/local/bin/mpiexec -- Autodetected CUDA architecture(s): 7.5 7.5 CMake Warning (dev) at /home/yonggui/miniconda3/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:273 (message): The package name passed to find_package_handle_standard_args (OpenMP_C) does not match the name of the calling package (OpenMP). This can lead to problems in calling code that expects find_package result variables (e.g., _FOUND) to follow a certain pattern. Call Stack (most recent call first): cmake/Modules/FindOpenMP.cmake:565 (find_package_handle_standard_args) caffe2/CMakeLists.txt:934 (find_package) This warning is for project developers. Use -Wno-dev to suppress it.

CMake Warning (dev) at /home/yonggui/miniconda3/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:273 (message): The package name passed to find_package_handle_standard_args (OpenMP_CXX) does not match the name of the calling package (OpenMP). This can lead to problems in calling code that expects find_package result variables (e.g., _FOUND) to follow a certain pattern. Call Stack (most recent call first): cmake/Modules/FindOpenMP.cmake:565 (find_package_handle_standard_args) caffe2/CMakeLists.txt:934 (find_package) This warning is for project developers. Use -Wno-dev to suppress it.

-- pytorch is compiling with OpenMP. OpenMP CXX_FLAGS: -fopenmp. OpenMP libraries: /usr/lib/gcc/x86_64-linux-gnu/9/libgomp.so;/usr/lib/x86_64-linux-gnu/libpthread.so. -- Caffe2 is compiling with OpenMP. OpenMP CXX_FLAGS: -fopenmp. OpenMP libraries: /usr/lib/gcc/x86_64-linux-gnu/9/libgomp.so;/usr/lib/x86_64-linux-gnu/libpthread.so. -- Using lib/python3.6/site-packages as python relative installation path CMake Warning at CMakeLists.txt:827 (message): Generated cmake files are only fully tested if one builds with system glog, gflags, and protobuf. Other settings may generate files that are not well tested.

-- -- **** Summary **** -- General: -- CMake version : 3.18.2 -- CMake command : /home/yonggui/miniconda3/bin/cmake -- System : Linux -- C++ compiler : /usr/bin/c++ -- C++ compiler id : GNU -- C++ compiler version : 9.3.0 -- CXX flags : -Wno-deprecated -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-variable -Wno-unused-function -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Werror=cast-function-type -Wno-stringop-overflow -- Build type : Release -- Compile definitions : TH_BLAS_MKL;ONNX_ML=1;ONNXIFI_ENABLE_EXT=1;ONNX_NAMESPACE=onnx_torch;MAGMA_V2;IDEEP_USE_MKL;HAVE_MMAP=1;_FILE_OFFSET_BITS=64;HAVE_SHM_OPEN=1;HAVE_SHM_UNLINK=1;HAVE_MALLOC_USABLE_SIZE=1;USE_EXTERNAL_MZCRC;MINIZ_DISABLE_ZIP_READER_CRC32_CHECKS -- CMAKE_PREFIX_PATH : /home/yonggui/miniconda3;/usr -- CMAKE_INSTALL_PREFIX : /home/yonggui/pytorch/torch -- -- TORCH_VERSION : 1.8.0 -- CAFFE2_VERSION : 1.8.0 -- BUILD_CAFFE2 : ON -- BUILD_CAFFE2_OPS : ON -- BUILD_CAFFE2_MOBILE : OFF -- BUILD_STATIC_RUNTIME_BENCHMARK: OFF -- BUILD_TENSOREXPR_BENCHMARK: OFF -- BUILD_BINARY : OFF -- BUILD_CUSTOM_PROTOBUF : ON -- Link local protobuf : ON -- BUILD_DOCS : OFF -- BUILD_PYTHON : True -- Python version : 3.6.12 -- Python executable : /home/yonggui/miniconda3/bin/python -- Pythonlibs version : 3.6.12 -- Python library : /home/yonggui/miniconda3/lib/libpython3.6m.so.1.0 -- Python includes : /home/yonggui/miniconda3/include/python3.6m -- Python site-packages: lib/python3.6/site-packages -- BUILD_SHARED_LIBS : ON -- CAFFE2_USE_MSVC_STATIC_RUNTIME : OFF -- BUILD_TEST : True -- BUILD_JNI : OFF -- BUILD_MOBILE_AUTOGRAD : OFF -- INTERN_BUILD_MOBILE : -- USE_BLAS : 1 -- BLAS : mkl -- USE_LAPACK : 1 -- LAPACK : mkl -- USE_ASAN : OFF -- USE_CPP_CODE_COVERAGE : OFF -- USE_CUDA : ON -- CUDA static link : OFF -- USE_CUDNN : OFF -- CUDA version : 10.1 -- CUDA root directory : /usr -- CUDA library : /usr/lib/x86_64-linux-gnu/libcuda.so -- cudart library : /usr/lib/x86_64-linux-gnu/libcudart.so -- cublas library : /usr/lib/x86_64-linux-gnu/libcublas.so -- cufft library : /usr/lib/x86_64-linux-gnu/libcufft.so -- curand library : /usr/lib/x86_64-linux-gnu/libcurand.so -- nvrtc : /usr/lib/x86_64-linux-gnu/libnvrtc.so -- CUDA include path : /usr/include -- NVCC executable : /usr/bin/nvcc -- NVCC flags : -Xfatbin;-compress-all;-DONNX_NAMESPACE=onnx_torch;-gencode;arch=compute_75,code=sm_75;-Xcudafe;--diag_suppress=cc_clobber_ignored,--diag_suppress=integer_sign_change,--diag_suppress=useless_using_declaration,--diag_suppress=set_but_not_used,--diag_suppress=field_without_dll_interface,--diag_suppress=base_class_has_different_dll_interface,--diag_suppress=dll_interface_conflict_none_assumed,--diag_suppress=dll_interface_conflict_dllexport_assumed,--diag_suppress=implicit_return_from_non_void_function,--diag_suppress=unsigned_compare_with_zero,--diag_suppress=declared_but_not_referenced,--diag_suppress=bad_friend_decl;-std=c++14;-Xcompiler;-fPIC;--expt-relaxed-constexpr;--expt-extended-lambda;-Wno-deprecated-gpu-targets;--expt-extended-lambda;-Xcompiler;-fPIC;-DCUDA_HAS_FP16=1;-DCUDA_NO_HALF_OPERATORS;-DCUDA_NO_HALF_CONVERSIONS;-DCUDA_NO_BFLOAT16_CONVERSIONS;-DCUDA_NO_HALF2_OPERATORS -- CUDA host compiler : /usr/bin/cc -- NVCC --device-c : OFF -- USE_TENSORRT : OFF -- USE_ROCM : OFF -- USE_EIGEN_FOR_BLAS : -- USE_FBGEMM : ON -- USE_FAKELOWP : OFF -- USE_KINETO : OFF -- USE_FFMPEG : OFF -- USE_GFLAGS : OFF -- USE_GLOG : OFF -- USE_LEVELDB : OFF -- USE_LITE_PROTO : OFF -- USE_LMDB : OFF -- USE_METAL : OFF -- USE_PYTORCH_METAL : OFF -- USE_FFTW : OFF -- USE_MKL : ON -- USE_MKLDNN : ON -- USE_MKLDNN_CBLAS : OFF -- USE_NCCL : ON -- USE_SYSTEM_NCCL : OFF -- USE_NNPACK : ON -- USE_NUMPY : ON -- USE_OBSERVERS : ON -- USE_OPENCL : OFF -- USE_OPENCV : OFF -- USE_OPENMP : ON -- USE_TBB : OFF -- USE_VULKAN : OFF -- USE_PROF : OFF -- USE_QNNPACK : ON -- USE_PYTORCH_QNNPACK : ON -- USE_REDIS : OFF -- USE_ROCKSDB : OFF -- USE_ZMQ : OFF -- USE_DISTRIBUTED : ON -- USE_MPI : ON -- USE_GLOO : ON -- USE_TENSORPIPE : ON -- Public Dependencies : Threads::Threads;caffe2::mkl;caffe2::mkldnn -- Private Dependencies : pthreadpool;cpuinfo;qnnpack;pytorch_qnnpack;nnpack;XNNPACK;fbgemm;fp16;/usr/local/lib/libmpi.so;gloo;tensorpipe;aten_op_header_gen;foxi_loader;rt;fmt::fmt-header-only;gcc_s;gcc;dl -- Configuring done CMake Warning at caffe2/CMakeLists.txt:659 (add_library): Cannot generate a safe runtime search path for target torch_cpu because files in some directories may conflict with libraries in implicit directories:

runtime library [libgomp.so.1] in /usr/lib/gcc/x86_64-linux-gnu/9 may be hidden by files in:
  /home/yonggui/miniconda3/lib

Some of these libraries may not be found correctly.

CMake Warning at cmake/Modules_CUDA_fix/upstream/FindCUDA.cmake:1854 (add_library): Cannot generate a safe runtime search path for target caffe2_detectron_ops_gpu because files in some directories may conflict with libraries in implicit directories:

runtime library [libgomp.so.1] in /usr/lib/gcc/x86_64-linux-gnu/9 may be hidden by files in:
  /home/yonggui/miniconda3/lib

Some of these libraries may not be found correctly. Call Stack (most recent call first): modules/detectron/CMakeLists.txt:13 (CUDA_ADD_LIBRARY)

-- Generating done -- Build files have been written to: /home/yonggui/pytorch/build cmake --build . --target install --config Release -- -j 64 [24/5901] Building C object confu-deps/pthreadpool/CMakeFiles/pthreadpool.dir/src/memory.c.o In file included from ../third_party/pthreadpool/src/threadpool-object.h:30, from ../third_party/pthreadpool/src/memory.c:19: ../third_party/pthreadpool/include/pthreadpool.h:997:2: warning: ‘pthreadpool_function_1d_t’ is deprecated [-Wdeprecated-declarations] 997 | pthreadpool_function_1d_t function, | ^~~~~~~~~ ../third_party/pthreadpool/include/pthreadpool.h:1003:2: warning: ‘pthreadpool_function_1d_tiled_t’ is deprecated [-Wdeprecated-declarations] 1003 | pthreadpool_function_1d_tiled_t function, | ^~~~~~~ ../third_party/pthreadpool/include/pthreadpool.h:1010:2: warning: ‘pthreadpool_function_2d_t’ is deprecated [-Wdeprecated-declarations] 1010 | pthreadpool_function_2d_t function, | ^~~~~~~~~ ../third_party/pthreadpool/include/pthreadpool.h:1017:2: warning: ‘pthreadpool_function_2d_tiled_t’ is deprecated [-Wdeprecated-declarations] 1017 | pthreadpool_function_2d_tiled_t function, | ^~~~~~~ ../third_party/pthreadpool/include/pthreadpool.h:1026:2: warning: ‘pthreadpool_function_3d_tiled_t’ is deprecated [-Wdeprecated-declarations] 1026 | pthreadpool_function_3d_tiled_t function, | ^~~~~~~ ../third_party/pthreadpool/include/pthreadpool.h:1037:2: warning: ‘pthreadpool_function_4d_tiled_t’ is deprecated [-Wdeprecated-declarations] 1037 | pthreadpool_function_4d_tiled_t function, | ^~~~~~~ [25/5901] Building C object confu-deps/pthreadpool/CMakeFiles/pthreadpool.dir/src/pthreads.c.o In file included from ../third_party/pthreadpool/src/pthreads.c:50: ../third_party/pthreadpool/include/pthreadpool.h:997:2: warning: ‘pthreadpool_function_1d_t’ is deprecated [-Wdeprecated-declarations] 997 | pthreadpool_function_1d_t function, | ^~~~~~~~~ ../third_party/pthreadpool/include/pthreadpool.h:1003:2: warning: ‘pthreadpool_function_1d_tiled_t’ is deprecated [-Wdeprecated-declarations] 1003 | pthreadpool_function_1d_tiled_t function, | ^~~~~~~ ../third_party/pthreadpool/include/pthreadpool.h:1010:2: warning: ‘pthreadpool_function_2d_t’ is deprecated [-Wdeprecated-declarations] 1010 | pthreadpool_function_2d_t function, | ^~~~~~~~~ ../third_party/pthreadpool/include/pthreadpool.h:1017:2: warning: ‘pthreadpool_function_2d_tiled_t’ is deprecated [-Wdeprecated-declarations] 1017 | pthreadpool_function_2d_tiled_t function, | ^~~~~~~ ../third_party/pthreadpool/include/pthreadpool.h:1026:2: warning: ‘pthreadpool_function_3d_tiled_t’ is deprecated [-Wdeprecated-declarations] 1026 | pthreadpool_function_3d_tiled_t function, | ^~~~~~~ ../third_party/pthreadpool/include/pthreadpool.h:1037:2: warning: ‘pthreadpool_function_4d_tiled_t’ is deprecated [-Wdeprecated-declarations] 1037 | pthreadpool_function_4d_tiled_t function, | ^~~~~~~ [43/5901] Building CXX object third_party/protobuf/cmake/CMakeFiles/libprotobuf-lite.dir//src/google/protobuf/message_lite.cc.o In file included from /usr/include/string.h:495, from ../third_party/protobuf/src/google/protobuf/stubs/port.h:39, from ../third_party/protobuf/src/google/protobuf/stubs/common.h:46, from ../third_party/protobuf/src/google/protobuf/message_lite.h:45, from ../third_party/protobuf/src/google/protobuf/message_lite.cc:36: In function ‘void memcpy(void, const void, size_t)’, inlined from ‘google::protobuf::uint8 google::protobuf::io::EpsCopyOutputStream::WriteRaw(const void, int, google::protobuf::uint8)’ at ../third_party/protobuf/src/google/protobuf/io/coded_stream.h:699:16, inlined from ‘bool google::protobuf::MessageLite::SerializePartialToZeroCopyStream(google::protobuf::io::ZeroCopyOutputStream) const’ at ../third_party/protobuf/src/google/protobuf/implicit_weak_message.h:87:28: /usr/include/x86_64-linux-gnu/bits/string_fortified.h:34:33: warning: ‘void _builtinmemcpy_chk(void, const void, long unsigned int, long unsigned int)’ specified size between 18446744071562067968 and 18446744073709551615 exceeds maximum object size 9223372036854775807 [-Wstringop-overflow=] 34 | return builtin___memcpy_chk (dest, src, len, bos0 (dest)); | ~~~~~^~~~~~~~~ [105/5901] Performing build step for 'nccl_external' FAILED: nccl_external-prefix/src/nccl_external-stamp/nccl_external-build nccl/lib/libnccl_static.a cd /home/yonggui/pytorch/third_party/nccl/nccl && env CCACHE_DISABLE=1 SCCACHE_DISABLE=1 make CXX=/usr/bin/c++ CUDA_HOME=/usr NVCC=/usr/bin/nvcc NVCC_GENCODE=-gencode=arch=compute_75,code=sm_75 BUILDDIR=/home/yonggui/pytorch/build/nccl VERBOSE=0 -j && /home/yonggui/miniconda3/bin/cmake -E touch /home/yonggui/pytorch/build/nccl_external-prefix/src/nccl_external-stamp/nccl_external-build make -C src build BUILDDIR=/home/yonggui/pytorch/build/nccl make[1]: Entering directory '/home/yonggui/pytorch/third_party/nccl/nccl/src' Grabbing include/nccl_net.h > /home/yonggui/pytorch/build/nccl/include/nccl_net.h Generating nccl.h.in > /home/yonggui/pytorch/build/nccl/include/nccl.h Compiling init.cc > /home/yonggui/pytorch/build/nccl/obj/init.o Generating nccl.pc.in > /home/yonggui/pytorch/build/nccl/lib/pkgconfig/nccl.pc Compiling channel.cc > /home/yonggui/pytorch/build/nccl/obj/channel.o Compiling bootstrap.cc > /home/yonggui/pytorch/build/nccl/obj/bootstrap.o Compiling transport.cc > /home/yonggui/pytorch/build/nccl/obj/transport.o Compiling enqueue.cc > /home/yonggui/pytorch/build/nccl/obj/enqueue.o Compiling group.cc > /home/yonggui/pytorch/build/nccl/obj/group.o Compiling debug.cc > /home/yonggui/pytorch/build/nccl/obj/debug.o Compiling proxy.cc > /home/yonggui/pytorch/build/nccl/obj/proxy.o Compiling misc/nvmlwrap.cc > /home/yonggui/pytorch/build/nccl/obj/misc/nvmlwrap.o Compiling misc/ibvwrap.cc > /home/yonggui/pytorch/build/nccl/obj/misc/ibvwrap.o Compiling misc/utils.cc > /home/yonggui/pytorch/build/nccl/obj/misc/utils.o Compiling misc/argcheck.cc > /home/yonggui/pytorch/build/nccl/obj/misc/argcheck.o Compiling transport/p2p.cc > /home/yonggui/pytorch/build/nccl/obj/transport/p2p.o Compiling transport/shm.cc > /home/yonggui/pytorch/build/nccl/obj/transport/shm.o Compiling transport/net.cc > /home/yonggui/pytorch/build/nccl/obj/transport/net.o Compiling transport/net_socket.cc > /home/yonggui/pytorch/build/nccl/obj/transport/net_socket.o Compiling transport/net_ib.cc > /home/yonggui/pytorch/build/nccl/obj/transport/net_ib.o Compiling transport/coll_net.cc > /home/yonggui/pytorch/build/nccl/obj/transport/coll_net.o Compiling collectives/sendrecv.cc > /home/yonggui/pytorch/build/nccl/obj/collectives/sendrecv.o Compiling collectives/all_reduce.cc > /home/yonggui/pytorch/build/nccl/obj/collectives/all_reduce.o Compiling collectives/all_gather.cc > /home/yonggui/pytorch/build/nccl/obj/collectives/all_gather.o Compiling collectives/broadcast.cc > /home/yonggui/pytorch/build/nccl/obj/collectives/broadcast.o Compiling collectives/reduce.cc > /home/yonggui/pytorch/build/nccl/obj/collectives/reduce.o Compiling collectives/reduce_scatter.cc > /home/yonggui/pytorch/build/nccl/obj/collectives/reduce_scatter.o Compiling graph/topo.cc > /home/yonggui/pytorch/build/nccl/obj/graph/topo.o Compiling graph/paths.cc > /home/yonggui/pytorch/build/nccl/obj/graph/paths.o Compiling graph/search.cc > /home/yonggui/pytorch/build/nccl/obj/graph/search.o Compiling graph/connect.cc > /home/yonggui/pytorch/build/nccl/obj/graph/connect.o Compiling graph/rings.cc > /home/yonggui/pytorch/build/nccl/obj/graph/rings.o In file included from bootstrap.cc:12: include/socket.h: In function ‘ncclResult_t connectAddress(int, socketAddress)’: include/socket.h:41:19: warning: ‘<’ directive writing 1 byte into a region of size between 0 and 1024 [-Wformat-overflow=] 41 | sprintf(buf, "%s<%s>", host, service); | ^ In file included from /usr/include/stdio.h:867, from include/debug.h:12, from include/core.h:53, from bootstrap.cc:8: /usr/include/x86_64-linux-gnu/bits/stdio2.h:36:34: note: ‘builtin___sprintf_chk’ output between 3 and 1058 bytes into a destination of size 1024 36 | return builtin_sprintf_chk (s, USE_FORTIFY_LEVEL - 1, | ~~~~~~^~~~~~~~ 37 | bos (s), fmt, va_arg_pack ()); | ~~~~~~~~~ Compiling graph/trees.cc > /home/yonggui/pytorch/build/nccl/obj/graph/trees.o In file included from transport/net_socket.cc:9: include/socket.h: In function ‘ncclResult_t connectAddress(int, socketAddress)’: include/socket.h:41:19: warning: ‘<’ directive writing 1 byte into a region of size between 0 and 1024 [-Wformat-overflow=] 41 | sprintf(buf, "%s<%s>", host, service); | ^ In file included from bootstrap.cc:12: include/socket.h: In function ‘int findInterfaceMatchSubnet(char, socketAddress, socketAddress*, int, int)’: include/socket.h:41:19: warning: ‘<’ directive writing 1 byte into a region of size between 0 and 1024 [-Wformat-overflow=] 41 | sprintf(buf, "%s<%s>", host, service); | ^ In file included from /usr/include/stdio.h:867, from include/debug.h:12, from include/core.h:53, from bootstrap.cc:8: /usr/include/x86_64-linux-gnu/bits/stdio2.h:36:34: note: ‘_builtinsprintf_chk’ output between 3 and 1058 bytes into a destination of size 1024 36 | return builtin___sprintf_chk (s, USE_FORTIFY_LEVEL - 1, | ~~~~~~^~~~~~~~ 37 | bos (s), fmt, va_arg_pack ()); | ~~~~~~~~~ In file included from /usr/include/stdio.h:867, from include/graph.h:15, from include/transport.h:11, from include/comm.h:10, from transport/net_socket.cc:7: /usr/include/x86_64-linux-gnu/bits/stdio2.h:36:34: note: ‘builtin_sprintf_chk’ output between 3 and 1058 bytes into a destination of size 1024 36 | return builtin_sprintf_chk (s, USE_FORTIFY_LEVEL - 1, | ~~~~~~^~~~~~~~ 37 | bos (s), fmt, va_arg_pack ()); | ~~~~~~~~~ In file included from transport/net_socket.cc:9: include/socket.h: In function ‘ncclResult_t ncclSocketInit(ncclDebugLogger_t)’: include/socket.h:41:19: warning: ‘<’ directive writing 1 byte into a region of size between 0 and 1024 [-Wformat-overflow=] 41 | sprintf(buf, "%s<%s>", host, service); | ^ In file included from /usr/include/stdio.h:867, from include/graph.h:15, from include/transport.h:11, from include/comm.h:10, from transport/net_socket.cc:7: /usr/include/x86_64-linux-gnu/bits/stdio2.h:36:34: note: ‘_builtinsprintf_chk’ output between 3 and 1058 bytes into a destination of size 1024 36 | return builtin___sprintf_chk (s, USE_FORTIFY_LEVEL - 1, | ~~~~~~^~~~~~~~ 37 | bos (s), fmt, va_arg_pack ()); | ~~~~~~~~~ In file included from transport/net_socket.cc:9: include/socket.h:41:19: warning: ‘<’ directive writing 1 byte into a region of size between 0 and 1024 [-Wformat-overflow=] 41 | sprintf(buf, "%s<%s>", host, service); | ^ In file included from /usr/include/stdio.h:867, from include/graph.h:15, from include/transport.h:11, from include/comm.h:10, from transport/net_socket.cc:7: /usr/include/x86_64-linux-gnu/bits/stdio2.h:36:34: note: ‘_builtinsprintf_chk’ output between 3 and 1058 bytes into a destination of size 1024 36 | return builtin___sprintf_chk (s, USE_FORTIFY_LEVEL - 1, | ~~~~~~^~~~~~~~ 37 | bos (s), fmt, va_arg_pack ()); | ~~~~~~~~~ transport/net_socket.cc:58:67: warning: ‘%s’ directive output may be truncated writing up to 1023 bytes into a region of size between 762 and 1018 [-Wformat-truncation=] 58 | snprintf(line+strlen(line), 1023-strlen(line), " [%d]%s:%s", i, names+i*MAX_IF_NAME_SIZE, | ~~~~~~~~~~~~^~~~~~~~~ 59 | socketToString(&addrs[i].sa, addrline)); | ~~~~~~~~~~~
In file included from /usr/include/stdio.h:867, from include/graph.h:15, from include/transport.h:11, from include/comm.h:10, from transport/net_socket.cc:7: /usr/include/x86_64-linux-gnu/bits/stdio2.h:67:35: note: ‘
builtin_snprintf_chk’ output between 6 and 1285 bytes into a destination of size 1023 67 | return builtin_snprintf_chk (s, n, USE_FORTIFY_LEVEL - 1, | ~~~~~^~~~~~~~~~~ 68 | bos (s), fmt, va_arg_pack ()); | ~~~~~~~~~ In file included from bootstrap.cc:12: include/socket.h: In function ‘ncclResult_t bootstrapNetInit()’: include/socket.h:41:19: warning: ‘<’ directive writing 1 byte into a region of size between 0 and 1024 [-Wformat-overflow=] 41 | sprintf(buf, "%s<%s>", host, service); | ^ In file included from /usr/include/stdio.h:867, from include/debug.h:12, from include/core.h:53, from bootstrap.cc:8: /usr/include/x86_64-linux-gnu/bits/stdio2.h:36:34: note: ‘builtin___sprintf_chk’ output between 3 and 1058 bytes into a destination of size 1024 36 | return builtin_sprintf_chk (s, USE_FORTIFY_LEVEL - 1, | ~~~~~~^~~~~~~~ 37 | bos (s), fmt, va_arg_pack ()); | ~~~~~~~~~ bootstrap.cc:39:67: warning: ‘%s’ directive output may be truncated writing up to 1023 bytes into a region of size between 1017 and 1018 [-Wformat-truncation=] 39 | snprintf(line+strlen(line), 1023-strlen(line), " [%d]%s:%s", i, bootstrapNetIfNames+i*MAX_IF_NAME_SIZE, | ~~~~~~~~~~~~^~~~~~~~~~~ 40 | socketToString(&bootstrapNetIfAddrs[i].sa, addrline)); | ~~~~~~~~~~~~~ In file included from /usr/include/stdio.h:867, from include/debug.h:12, from include/core.h:53, from bootstrap.cc:8: /usr/include/x86_64-linux-gnu/bits/stdio2.h:67:35: note: ‘builtin_snprintf_chk’ output 6 or more bytes (assuming 1030) into a destination of size 1023 67 | return builtin_snprintf_chk (s, n, USE_FORTIFY_LEVEL - 1, | ~~~~~^~~~~~~~~~~ 68 | bos (s), fmt, va_arg_pack ()); | ~~~~~~~~~ graph/rings.cc: In function ‘ncclResult_t ncclBuildRings(int, int, int, int, int, int)’: graph/rings.cc:35:39: warning: ‘ : ’ directive writing 3 bytes into a region of size between 1 and 17 [-Wformat-overflow=] 35 | sprintf(prefix, "Channel %02d/%02d : ", r, nrings); | ^~~ In file included from /usr/include/stdio.h:867, from include/debug.h:12, from include/core.h:53, from graph/rings.cc:7: /usr/include/x86_64-linux-gnu/bits/stdio2.h:36:34: note: ‘builtin___sprintf_chk’ output between 17 and 33 bytes into a destination of size 30 36 | return builtin_sprintf_chk (s, USE_FORTIFY_LEVEL - 1, | ~~~~~~^~~~~~~~ 37 | bos (s), fmt, va_arg_pack ()); | ~~~~~~~~~ graph/rings.cc:35:39: warning: ‘ : ’ directive writing 3 bytes into a region of size between 1 and 17 [-Wformat-overflow=] 35 | sprintf(prefix, "Channel %02d/%02d : ", r, nrings); | ^~~ In file included from /usr/include/stdio.h:867, from include/debug.h:12, from include/core.h:53, from graph/rings.cc:7: /usr/include/x86_64-linux-gnu/bits/stdio2.h:36:34: note: ‘_builtinsprintf_chk’ output between 17 and 33 bytes into a destination of size 30 36 | return builtin___sprintf_chk (s, USE_FORTIFY_LEVEL - 1, | ~~~~~~^~~~~~~~ 37 | bos (s), fmt, __va_arg_pack ()); | ~~~~~~~~~ In file included from /usr/include/string.h:495, from /usr/include/c++/9/cstring:42, from /usr/include/cuda_fp16.hpp:65, from /usr/include/cuda_fp16.h:3020, from /home/yonggui/pytorch/build/nccl/include/nccl.h:11, from transport/net_ib.cc:7: In function ‘char strncpy(char, const char, size_t)’, inlined from ‘int findInterfaces(const char, char, socketAddress, int, int, int)’ at include/socket.h:113:14: /usr/include/x86_64-linux-gnu/bits/string_fortified.h:106:34: warning: ‘char builtin_strncpy(char, const char, long unsigned int)’ specified bound 16 equals destination size [-Wstringop-truncation] 106 | return _builtinstrncpy_chk (dest, src, len, bos (dest)); | ~~~~~~^~~~~~~~ /usr/include/x86_64-linux-gnu/bits/string_fortified.h:106:34: warning: ‘char* builtin_strncpy(char, const char, long unsigned int)’ specified bound 16 equals destination size [-Wstringop-truncation] In file included from transport/net_ib.cc:9: include/socket.h: In function ‘ncclResult_t ncclIbInit(ncclDebugLogger_t)’: include/socket.h:41:19: warning: ‘<’ directive writing 1 byte into a region of size between 0 and 1024 [-Wformat-overflow=] 41 | sprintf(buf, "%s<%s>", host, service); | ^ In file included from /usr/include/stdio.h:867, from include/debug.h:12, from include/core.h:53, from transport/net_ib.cc:8: /usr/include/x86_64-linux-gnu/bits/stdio2.h:36:34: note: ‘builtin___sprintf_chk’ output between 3 and 1058 bytes into a destination of size 1024 36 | return builtin_sprintf_chk (s, USE_FORTIFY_LEVEL - 1, | ~~~~~~^~~~~~~~ 37 | bos (s), fmt, va_arg_pack ()); | ~~~~~~~~~ In file included from transport/net_ib.cc:9: include/socket.h:41:19: warning: ‘<’ directive writing 1 byte into a region of size between 0 and 1024 [-Wformat-overflow=] 41 | sprintf(buf, "%s<%s>", host, service); | ^ In file included from /usr/include/stdio.h:867, from include/debug.h:12, from include/core.h:53, from transport/net_ib.cc:8: /usr/include/x86_64-linux-gnu/bits/stdio2.h:36:34: note: ‘_builtinsprintf_chk’ output between 3 and 1058 bytes into a destination of size 1024 36 | return builtin___sprintf_chk (s, USE_FORTIFY_LEVEL - 1, | ~~~~~~^~~~~~~~ 37 | bos (s), fmt, va_arg_pack ()); | ~~~~~~~~~ In file included from /usr/include/string.h:495, from /usr/include/c++/9/cstring:42, from /usr/include/cuda_fp16.hpp:65, from /usr/include/cuda_fp16.h:3020, from /home/yonggui/pytorch/build/nccl/include/nccl.h:11, from transport/net_ib.cc:7: In function ‘char strncpy(char, const char, size_t)’, inlined from ‘int findInterfaceMatchSubnet(char, socketAddress, socketAddress, int, int)’ at include/socket.h:194:12, inlined from ‘int findInterfaces(char, socketAddress, int, int)’ at include/socket.h:311:40, inlined from ‘ncclResult_t ncclIbInit(ncclDebugLogger_t)’ at transport/net_ib.cc:124:25: /usr/include/x86_64-linux-gnu/bits/string_fortified.h:106:34: warning: ‘char __builtin_strncpy(char, const char*, long unsigned int)’ specified bound 16 equals destination size [-Wstringop-truncation] 106 | return builtin_strncpy_chk (dest, src, len, bos (dest)); | ~~~~~~^~~~~~~~ In file included from transport/net_ib.cc:9: include/socket.h: In function ‘ncclResult_t connectAddress(int, socketAddress)’: include/socket.h:41:19: warning: ‘<’ directive writing 1 byte into a region of size between 0 and 1024 [-Wformat-overflow=] 41 | sprintf(buf, "%s<%s>", host, service); | ^ In file included from /usr/include/stdio.h:867, from include/debug.h:12, from include/core.h:53, from transport/net_ib.cc:8: /usr/include/x86_64-linux-gnu/bits/stdio2.h:36:34: note: ‘builtin___sprintf_chk’ output between 3 and 1058 bytes into a destination of size 1024 36 | return builtin_sprintf_chk (s, USE_FORTIFY_LEVEL - 1, | ~~~~~~^~~~~~~~ 37 | bos (s), fmt, va_arg_pack ()); | ~~~~~~~~~ In file included from /usr/include/string.h:495, from /usr/include/c++/9/cstring:42, from /usr/include/cuda_fp16.hpp:65, from /usr/include/cuda_fp16.h:3020, from /home/yonggui/pytorch/build/nccl/include/nccl.h:11, from init.cc:7: In function ‘char strncpy(char, const char, size_t)’, inlined from ‘void setEnvFile(const char)’ at include/param.h:37:12: /usr/include/x86_64-linux-gnu/bits/string_fortified.h:106:34: warning: ‘char __builtin_strncpy(char, const char*, long unsigned int)’ specified bound 1024 equals destination size [-Wstringop-truncation] 106 | return builtin_strncpy_chk (dest, src, len, bos (dest)); | ~~~~~~^~~~~~~~ Compiling graph/tuning.cc > /home/yonggui/pytorch/build/nccl/obj/graph/tuning.o Compiling graph/xml.cc > /home/yonggui/pytorch/build/nccl/obj/graph/xml.o make[2]: Entering directory '/home/yonggui/pytorch/third_party/nccl/nccl/src/collectives/device' Generating rules > /home/yonggui/pytorch/build/nccl/obj/collectives/device/Makefile.rules In file included from /usr/include/cuda_runtime.h:83, from : /usr/include/crt/host_config.h:138:2: error: #error -- unsupported GNU version! gcc versions later than 8 are not supported! 138 | #error -- unsupported GNU version! gcc versions later than 8 are not supported! | ^~~~~ In file included from /usr/include/cuda_runtime.h:83, from : /usr/include/crt/host_config.h:138:2: error: #error -- unsupported GNU version! gcc versions later than 8 are not supported! 138 | #error -- unsupported GNU version! gcc versions later than 8 are not supported! | ^~~~~ In file included from /usr/include/cuda_runtime.h:83, from : /usr/include/crt/host_config.h:138:2: error: #error -- unsupported GNU version! gcc versions later than 8 are not supported! 138 | #error -- unsupported GNU version! gcc versions later than 8 are not supported! | ^~~~~ In file included from /usr/include/cuda_runtime.h:83, from : /usr/include/crt/host_config.h:138:2: error: #error -- unsupported GNU version! gcc versions later than 8 are not supported! 138 | #error -- unsupported GNU version! gcc versions later than 8 are not supported! | ^~~~~ In file included from /usr/include/cuda_runtime.h:83, from : /usr/include/crt/host_config.h:138:2: error: #error -- unsupported GNU version! gcc versions later than 8 are not supported! 138 | #error -- unsupported GNU version! gcc versions later than 8 are not supported! | ^~~~~ In file included from /usr/include/cuda_runtime.h:83, from : /usr/include/crt/host_config.h:138:2: error: #error -- unsupported GNU version! gcc versions later than 8 are not supported! 138 | #error -- unsupported GNU version! gcc versions later than 8 are not supported! | ^~~~~ In file included from /usr/include/cuda_runtime.h:83, from : /usr/include/crt/host_config.h:138:2: error: #error -- unsupported GNU version! gcc versions later than 8 are not supported! 138 | #error -- unsupported GNU version! gcc versions later than 8 are not supported! | ^~~~~ make[2]: [Makefile:53: /home/yonggui/pytorch/build/nccl/obj/collectives/device/sendrecv.dep] Error 1 make[2]: Waiting for unfinished jobs.... make[2]: [Makefile:53: /home/yonggui/pytorch/build/nccl/obj/collectives/device/all_gather.dep] Error 1 make[2]: [Makefile:53: /home/yonggui/pytorch/build/nccl/obj/collectives/device/all_reduce.dep] Error 1 make[2]: [Makefile:53: /home/yonggui/pytorch/build/nccl/obj/collectives/device/broadcast.dep] Error 1 make[2]: [Makefile:53: /home/yonggui/pytorch/build/nccl/obj/collectives/device/reduce.dep] Error 1 make[2]: [Makefile:53: /home/yonggui/pytorch/build/nccl/obj/collectives/device/functions.dep] Error 1 make[2]: [Makefile:53: /home/yonggui/pytorch/build/nccl/obj/collectives/device/reduce_scatter.dep] Error 1 make[2]: Leaving directory '/home/yonggui/pytorch/third_party/nccl/nccl/src/collectives/device' make[1]: [Makefile:50: /home/yonggui/pytorch/build/nccl/obj/collectives/device/colldevice.a] Error 2 make[1]: Waiting for unfinished jobs.... In file included from /usr/include/string.h:495, from /usr/include/c++/9/cstring:42, from /usr/include/cuda_fp16.hpp:65, from /usr/include/cuda_fp16.h:3020, from /home/yonggui/pytorch/build/nccl/include/nccl.h:11, from include/core.h:15, from graph/xml.cc:12: In function ‘char strncpy(char, const char, size_t)’, inlined from ‘ncclResult_t xmlSetAttr(ncclXmlNode, const char, const char)’ at graph/xml.h:131:10, inlined from ‘ncclResult_t ncclTopoGetXmlFromSys(ncclXmlNode, ncclXml)’ at graph/xml.cc:530:17: /usr/include/x86_64-linux-gnu/bits/string_fortified.h:106:34: warning: ‘char __builtin_strncpy(char, const char*, long unsigned int)’ specified bound 256 equals destination size [-Wstringop-truncation] 106 | return builtin___strncpy_chk (dest, src, len, bos (dest)); | ~~~~~~^~~~~~~~ make[1]: Leaving directory '/home/yonggui/pytorch/third_party/nccl/nccl/src' make: ** [Makefile:25: src.build] Error 2 [124/5901] Building CXX object third_party/protobuf/cmake/CMakeFiles/libprotobuf.dir/__/src/google/protobuf/message_lite.cc.o In file included from /usr/include/string.h:495, from ../third_party/protobuf/src/google/protobuf/stubs/port.h:39, from ../third_party/protobuf/src/google/protobuf/stubs/common.h:46, from ../third_party/protobuf/src/google/protobuf/message_lite.h:45, from ../third_party/protobuf/src/google/protobuf/message_lite.cc:36: In function ‘void memcpy(void, const void, size_t)’, inlined from ‘google::protobuf::uint8 google::protobuf::io::EpsCopyOutputStream::WriteRaw(const void, int, google::protobuf::uint8)’ at ../third_party/protobuf/src/google/protobuf/io/coded_stream.h:699:16, inlined from ‘bool google::protobuf::MessageLite::SerializePartialToZeroCopyStream(google::protobuf::io::ZeroCopyOutputStream) const’ at ../third_party/protobuf/src/google/protobuf/implicit_weak_message.h:87:28: /usr/include/x86_64-linux-gnu/bits/string_fortified.h:34:33: warning: ‘void __builtin___memcpy_chk(void, const void*, long unsigned int, long unsigned int)’ specified size between 18446744071562067968 and 18446744073709551615 exceeds maximum object size 9223372036854775807 [-Wstringop-overflow=] 34 | return builtin___memcpy_chk (dest, src, len, bos0 (dest)); | ~~~~~^~~~~~~~~ [168/5901] Building CXX object third_party/protobuf/cmake/CMakeFiles/libprotobuf.dir/__/src/google/protobuf/descriptor.cc.o ninja: build stopped: subcommand failed. Traceback (most recent call last): File "setup.py", line 773, in build_deps() File "setup.py", line 320, in build_deps cmake=cmake) File "/home/yonggui/pytorch/tools/build_pytorch_libs.py", line 58, in build_caffe2 cmake.build(my_env) File "/home/yonggui/pytorch/tools/setup_helpers/cmake.py", line 346, in build self.run(build_args, my_env) File "/home/yonggui/pytorch/tools/setup_helpers/cmake.py", line 141, in run check_call(command, cwd=self.build_dir, env=env) File "/home/yonggui/miniconda3/lib/python3.6/subprocess.py", line 311, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--target', 'install', '--config', 'Release', '--', '-j', '64']' returned non-zero exit status 1. (base) yonggui@ubuntu-Precision-7920-Tower:~/pytorch$

ngimel commented 3 years ago

Your nvcc version (used for build) is 10.1 and gcc version is 9.3. nvcc does not support it, it has nothing to do with pytorch.

yonggui-yan commented 3 years ago

Your nvcc version (used for build) is 10.1 and gcc version is 9.3. nvcc does not support it, it has nothing to do with pytorch.

Thanks. Could you tell me how to set so that I can build pytorch with gcc instead of nvcc?

shenyanqing1105 commented 2 years ago

Your nvcc version (used for build) is 10.1 and gcc version is 9.3. nvcc does not support it, it has nothing to do with pytorch.

Thanks. Could you tell me how to set so that I can build pytorch with gcc instead of nvcc?

Hi, I have encountered the same problem and I want to confirm that have you solved this problem?