search

facebookincubator / gloo

Collective communications library with various primitives for multi-machine training.
Other
1.23k stars 303 forks source link

Getting undefined template error when compiling with clang5 for caffe2 #113

Closed xkszltl closed 6 years ago

xkszltl commented 6 years ago

Getting undefined template error when compiling with clang5 for caffe2.

Probably caused by a missing #include <array>

caffe2/third_party/gloo/gloo/common/linux.cc:102:25: error: implicit instantiation of undefined template 'std::__1::array<char, 256>'
  std::array<char, 256> buf;
                        ^
/usr/bin/../include/c++/v1/__tuple:223:64: note: template is declared here
template <class _Tp, size_t _Size> struct _LIBCPP_TEMPLATE_VIS array;
pietern commented 6 years ago

Thanks for the report! We don't test with clang 5 yet. Is it the default compiler on your distribution or did you specifically install it? If it is the default we should start running builds for it...

xkszltl commented 6 years ago

This is not a compiler-specific bug, but a simple mistake about missing header.

In this case it's built by myself. However clang 4 is shipped as llvm-toolset-7 in CentOS 7 and clang 5 is shipped to macOS by homebrew as default version currently. So it is pretty standard now.

I would definitely recommend testing with clang since it is very strict about C++ standard.

Thanks!

pietern commented 6 years ago

We test with clang 3.8 and 3.9 at the moment. Easy enough to expand this.

pietern commented 6 years ago

Ran a build with clang 5.0 and it doesn't reproduce (build log).

Which OS/distribution are you running?

I can blindly add the header of course, but it seems there is something else going on...

xkszltl commented 6 years ago

CentOS 7 with llvm toolchain built by ourselves.

Here's the build log under /tmp/scratch/caffe2/build:

-- The CXX compiler identification is Clang 5.0.1
-- The C compiler identification is Clang 5.0.1
-- Check for working CXX compiler: /usr/bin/clang++
-- Check for working CXX compiler: /usr/bin/clang++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Check for working C compiler: /usr/bin/clang
-- Check for working C compiler: /usr/bin/clang -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Performing Test CAFFE2_LONG_IS_INT32_OR_64
-- Performing Test CAFFE2_LONG_IS_INT32_OR_64 - Success
-- Does not need to define long separately.
-- Performing Test CAFFE2_NEED_TO_TURN_OFF_DEPRECATION_WARNING
-- Performing Test CAFFE2_NEED_TO_TURN_OFF_DEPRECATION_WARNING - Success
-- Performing Test CAFFE2_COMPILER_SUPPORTS_AVX2_EXTENSIONS
-- Performing Test CAFFE2_COMPILER_SUPPORTS_AVX2_EXTENSIONS - Success
-- Current compiler supports avx2 extention. Will build perfkernels.
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - not found
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE  
-- Found Protobuf: /usr/local/lib/libprotobuf.so;-lpthread (found version "3.5.1") 
-- Found Git: /usr/bin/git (found version "1.8.3.1") 
-- The BLAS backend of choice:OpenBLAS
-- Found OpenBLAS libraries: /usr/local/lib/libopenblas.so
-- Found OpenBLAS include: /usr/local/include
-- Could NOT find NNPACK (missing: NNPACK_INCLUDE_DIR NNPACK_LIBRARY PTHREADPOOL_LIBRARY CPUINFO_LIBRARY) 
-- Brace yourself, we are building NNPACK
-- Found PythonInterp: /usr/bin/python (found version "2.7.5") 
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/scratch/caffe2/build/six-download
[1/9] Creating directories for 'six'
[2/9] Performing download step (download, verify and extract) for 'six'
-- Downloading...
   dst='/tmp/scratch/caffe2/build/six-download/six-prefix/src/six-1.11.0.tar.gz'
   timeout='none'
-- Using src='https://pypi.python.org/packages/16/d8/bc6316cf98419719bd59c91742194c111b6f2e85abac88e496adefaf7afe/six-1.11.0.tar.gz'
-- [download 0% complete]
-- [download 9% complete]
-- [download 18% complete]
-- [download 28% complete]
-- [download 37% complete]
-- [download 46% complete]
-- [download 55% complete]
-- [download 64% complete]
-- [download 73% complete]
-- [download 83% complete]
-- [download 92% complete]
-- [download 100% complete]
-- verifying file...
       file='/tmp/scratch/caffe2/build/six-download/six-prefix/src/six-1.11.0.tar.gz'
-- Downloading... done
-- extracting...
     src='/tmp/scratch/caffe2/build/six-download/six-prefix/src/six-1.11.0.tar.gz'
     dst='/tmp/scratch/caffe2/build/confu-srcs/six'
-- extracting... [tar xfz]
-- extracting... [analysis]
-- extracting... [rename]
-- extracting... [clean up]
-- extracting... done
[3/9] No update step for 'six'
[4/9] No patch step for 'six'
[5/9] No configure step for 'six'
[6/9] No build step for 'six'
[7/9] No install step for 'six'
[8/9] No test step for 'six'
[9/9] Completed 'six'
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/scratch/caffe2/build/enum-download
[1/9] Creating directories for 'enum'
[2/9] Performing download step (download, verify and extract) for 'enum'
-- Downloading...
   dst='/tmp/scratch/caffe2/build/enum-download/enum-prefix/src/enum34-1.1.6.tar.gz'
   timeout='none'
-- Using src='https://pypi.python.org/packages/bf/3e/31d502c25302814a7c2f1d3959d2a3b3f78e509002ba91aea64993936876/enum34-1.1.6.tar.gz'
-- [download 5% complete]
-- [download 12% complete]
-- [download 19% complete]
-- [download 25% complete]
-- [download 32% complete]
-- [download 39% complete]
-- [download 46% complete]
-- [download 53% complete]
-- [download 59% complete]
-- [download 66% complete]
-- [download 73% complete]
-- [download 80% complete]
-- [download 87% complete]
-- [download 93% complete]
-- [download 100% complete]
-- verifying file...
       file='/tmp/scratch/caffe2/build/enum-download/enum-prefix/src/enum34-1.1.6.tar.gz'
-- Downloading... done
-- extracting...
     src='/tmp/scratch/caffe2/build/enum-download/enum-prefix/src/enum34-1.1.6.tar.gz'
     dst='/tmp/scratch/caffe2/build/confu-srcs/enum'
-- extracting... [tar xfz]
-- extracting... [analysis]
-- extracting... [rename]
-- extracting... [clean up]
-- extracting... done
[3/9] No patch step for 'enum'
[4/9] No update step for 'enum'
[5/9] No configure step for 'enum'
[6/9] No build step for 'enum'
[7/9] No install step for 'enum'
[8/9] No test step for 'enum'
[9/9] Completed 'enum'
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/scratch/caffe2/build/opcodes-download
[1/9] Creating directories for 'opcodes'
[2/9] Performing download step (download, verify and extract) for 'opcodes'
-- Downloading...
   dst='/tmp/scratch/caffe2/build/opcodes-download/opcodes-prefix/src/opcodes-0.3.13.tar.gz'
   timeout='none'
-- Using src='https://pypi.python.org/packages/e8/59/8c2e293c9c8d60f206fd5d0f6c8236a2e0a97832379ac319077441552c6a/opcodes-0.3.13.tar.gz'
-- [download 1% complete]
-- [download 2% complete]
-- [download 3% complete]
-- [download 5% complete]
-- [download 6% complete]
-- [download 7% complete]
-- [download 8% complete]
-- [download 10% complete]
-- [download 11% complete]
-- [download 12% complete]
-- [download 13% complete]
-- [download 15% complete]
-- [download 22% complete]
-- [download 30% complete]
-- [download 37% complete]
-- [download 45% complete]
-- [download 52% complete]
-- [download 60% complete]
-- [download 67% complete]
-- [download 75% complete]
-- [download 82% complete]
-- [download 90% complete]
-- [download 97% complete]
-- [download 100% complete]
-- verifying file...
       file='/tmp/scratch/caffe2/build/opcodes-download/opcodes-prefix/src/opcodes-0.3.13.tar.gz'
-- Downloading... done
-- extracting...
     src='/tmp/scratch/caffe2/build/opcodes-download/opcodes-prefix/src/opcodes-0.3.13.tar.gz'
     dst='/tmp/scratch/caffe2/build/confu-srcs/opcodes'
-- extracting... [tar xfz]
-- extracting... [analysis]
-- extracting... [rename]
-- extracting... [clean up]
-- extracting... done
[3/9] No update step for 'opcodes'
[4/9] No patch step for 'opcodes'
[5/9] No configure step for 'opcodes'
[6/9] No build step for 'opcodes'
[7/9] No install step for 'opcodes'
[8/9] No test step for 'opcodes'
[9/9] Completed 'opcodes'
-- Found PythonInterp: /usr/bin/python (found version "2.7.5") 
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/scratch/caffe2/build/peachpy-download
[1/9] Creating directories for 'peachpy'
[2/9] Performing download step (git clone) for 'peachpy'
Cloning into 'peachpy'...
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
fatal: early EOF
fatal: index-pack failed
Cloning into 'peachpy'...
-- Had to git clone more than once:
          2 times.
Already on 'master'
[3/9] Performing update step for 'peachpy'
Current branch master is up to date.
[4/9] Performing patch step for 'peachpy'
running generate
Generating x86-64 instruction classes from opcodes 0.3.13
[5/9] No configure step for 'peachpy'
[6/9] No build step for 'peachpy'
[7/9] No install step for 'peachpy'
[8/9] No test step for 'peachpy'
[9/9] Completed 'peachpy'
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/scratch/caffe2/build/fp16-download
[1/9] Creating directories for 'fp16'
[2/9] Performing download step (git clone) for 'fp16'
Cloning into 'fp16'...
Already on 'master'
[3/9] No patch step for 'fp16'
[4/9] Performing update step for 'fp16'
Current branch master is up to date.
[5/9] No configure step for 'fp16'
[6/9] No build step for 'fp16'
[7/9] No install step for 'fp16'
[8/9] No test step for 'fp16'
[9/9] Completed 'fp16'
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/scratch/caffe2/build/fxdiv-download
[1/9] Creating directories for 'fxdiv'
[2/9] Performing download step (git clone) for 'fxdiv'
Cloning into 'fxdiv'...
Already on 'master'
[3/9] No patch step for 'fxdiv'
[4/9] Performing update step for 'fxdiv'
Current branch master is up to date.
[5/9] No configure step for 'fxdiv'
[6/9] No build step for 'fxdiv'
[7/9] No install step for 'fxdiv'
[8/9] No test step for 'fxdiv'
[9/9] Completed 'fxdiv'
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/scratch/caffe2/build/psimd-download
[1/9] Creating directories for 'psimd'
[2/9] Performing download step (git clone) for 'psimd'
Cloning into 'psimd'...
Already on 'master'
[3/9] No patch step for 'psimd'
[4/9] Performing update step for 'psimd'
Current branch master is up to date.
[5/9] No configure step for 'psimd'
[6/9] No build step for 'psimd'
[7/9] No install step for 'psimd'
[8/9] No test step for 'psimd'
[9/9] Completed 'psimd'
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/scratch/caffe2/build/pthreadpool-download
[1/9] Creating directories for 'pthreadpool'
[2/9] Performing download step (git clone) for 'pthreadpool'
Cloning into 'pthreadpool'...
Already on 'master'
[3/9] No patch step for 'pthreadpool'
[4/9] Performing update step for 'pthreadpool'
Current branch master is up to date.
[5/9] No configure step for 'pthreadpool'
[6/9] No build step for 'pthreadpool'
[7/9] No install step for 'pthreadpool'
[8/9] No test step for 'pthreadpool'
[9/9] Completed 'pthreadpool'
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/scratch/caffe2/build/googletest-download
[1/9] Creating directories for 'googletest'
[2/9] Performing download step (download, verify and extract) for 'googletest'
-- Downloading...
   dst='/tmp/scratch/caffe2/build/googletest-download/googletest-prefix/src/release-1.8.0.zip'
   timeout='none'
-- Using src='https://github.com/google/googletest/archive/release-1.8.0.zip'
-- [download 0% complete]
-- [download 1% complete]
-- [download 2% complete]
-- [download 3% complete]
-- [download 4% complete]
-- [download 5% complete]
-- [download 6% complete]
-- [download 7% complete]
-- [download 8% complete]
-- [download 9% complete]
-- [download 10% complete]
-- [download 11% complete]
-- [download 12% complete]
-- [download 13% complete]
-- [download 14% complete]
-- [download 15% complete]
-- [download 16% complete]
-- [download 17% complete]
-- [download 18% complete]
-- [download 19% complete]
-- [download 20% complete]
-- [download 21% complete]
-- [download 22% complete]
-- [download 23% complete]
-- [download 24% complete]
-- [download 25% complete]
-- [download 26% complete]
-- [download 27% complete]
-- [download 28% complete]
-- [download 29% complete]
-- [download 30% complete]
-- [download 31% complete]
-- [download 32% complete]
-- [download 33% complete]
-- [download 34% complete]
-- [download 35% complete]
-- [download 36% complete]
-- [download 37% complete]
-- [download 38% complete]
-- [download 39% complete]
-- [download 40% complete]
-- [download 41% complete]
-- [download 42% complete]
-- [download 43% complete]
-- [download 44% complete]
-- [download 45% complete]
-- [download 46% complete]
-- [download 47% complete]
-- [download 48% complete]
-- [download 49% complete]
-- [download 50% complete]
-- [download 51% complete]
-- [download 52% complete]
-- [download 53% complete]
-- [download 54% complete]
-- [download 55% complete]
-- [download 56% complete]
-- [download 57% complete]
-- [download 58% complete]
-- [download 59% complete]
-- [download 60% complete]
-- [download 61% complete]
-- [download 62% complete]
-- [download 63% complete]
-- [download 64% complete]
-- [download 65% complete]
-- [download 66% complete]
-- [download 67% complete]
-- [download 68% complete]
-- [download 69% complete]
-- [download 70% complete]
-- [download 71% complete]
-- [download 72% complete]
-- [download 73% complete]
-- [download 74% complete]
-- [download 75% complete]
-- [download 76% complete]
-- [download 77% complete]
-- [download 78% complete]
-- [download 79% complete]
-- [download 80% complete]
-- [download 81% complete]
-- [download 82% complete]
-- [download 83% complete]
-- [download 84% complete]
-- [download 85% complete]
-- [download 86% complete]
-- [download 87% complete]
-- [download 88% complete]
-- [download 89% complete]
-- [download 90% complete]
-- [download 91% complete]
-- [download 92% complete]
-- [download 93% complete]
-- [download 94% complete]
-- [download 95% complete]
-- [download 96% complete]
-- [download 97% complete]
-- [download 98% complete]
-- [download 99% complete]
-- [download 100% complete]
-- verifying file...
       file='/tmp/scratch/caffe2/build/googletest-download/googletest-prefix/src/release-1.8.0.zip'
-- Downloading... done
-- extracting...
     src='/tmp/scratch/caffe2/build/googletest-download/googletest-prefix/src/release-1.8.0.zip'
     dst='/tmp/scratch/caffe2/build/confu-srcs/googletest'
-- extracting... [tar xfz]
-- extracting... [analysis]
-- extracting... [rename]
-- extracting... [clean up]
-- extracting... done
[3/9] No update step for 'googletest'
[4/9] No patch step for 'googletest'
[5/9] No configure step for 'googletest'
[6/9] No build step for 'googletest'
[7/9] No install step for 'googletest'
[8/9] No test step for 'googletest'
[9/9] Completed 'googletest'
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/scratch/caffe2/build/fxdiv-download
[1/6] Performing update step for 'fxdiv'
Current branch master is up to date.
[2/6] No configure step for 'fxdiv'
[3/6] No build step for 'fxdiv'
[4/6] No install step for 'fxdiv'
[5/6] No test step for 'fxdiv'
[6/6] Completed 'fxdiv'
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/scratch/caffe2/build/googletest-download
ninja: no work to do.
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/scratch/caffe2/build/googlebenchmark-download
[1/9] Creating directories for 'googlebenchmark'
[2/9] Performing download step (download, verify and extract) for 'googlebenchmark'
-- Downloading...
   dst='/tmp/scratch/caffe2/build/googlebenchmark-download/googlebenchmark-prefix/src/v1.2.0.zip'
   timeout='none'
-- Using src='https://github.com/google/benchmark/archive/v1.2.0.zip'
-- [download 0% complete]
-- [download 1% complete]
-- [download 2% complete]
-- [download 3% complete]
-- [download 4% complete]
-- [download 5% complete]
-- [download 6% complete]
-- [download 7% complete]
-- [download 8% complete]
-- [download 9% complete]
-- [download 10% complete]
-- [download 11% complete]
-- [download 12% complete]
-- [download 13% complete]
-- [download 14% complete]
-- [download 15% complete]
-- [download 16% complete]
-- [download 17% complete]
-- [download 18% complete]
-- [download 19% complete]
-- [download 20% complete]
-- [download 21% complete]
-- [download 22% complete]
-- [download 23% complete]
-- [download 24% complete]
-- [download 25% complete]
-- [download 26% complete]
-- [download 27% complete]
-- [download 28% complete]
-- [download 29% complete]
-- [download 30% complete]
-- [download 31% complete]
-- [download 32% complete]
-- [download 33% complete]
-- [download 34% complete]
-- [download 35% complete]
-- [download 36% complete]
-- [download 37% complete]
-- [download 38% complete]
-- [download 39% complete]
-- [download 40% complete]
-- [download 41% complete]
-- [download 42% complete]
-- [download 43% complete]
-- [download 44% complete]
-- [download 45% complete]
-- [download 46% complete]
-- [download 47% complete]
-- [download 48% complete]
-- [download 49% complete]
-- [download 50% complete]
-- [download 51% complete]
-- [download 52% complete]
-- [download 53% complete]
-- [download 54% complete]
-- [download 55% complete]
-- [download 56% complete]
-- [download 57% complete]
-- [download 58% complete]
-- [download 59% complete]
-- [download 60% complete]
-- [download 61% complete]
-- [download 62% complete]
-- [download 63% complete]
-- [download 64% complete]
-- [download 65% complete]
-- [download 66% complete]
-- [download 67% complete]
-- [download 68% complete]
-- [download 69% complete]
-- [download 70% complete]
-- [download 71% complete]
-- [download 72% complete]
-- [download 73% complete]
-- [download 74% complete]
-- [download 75% complete]
-- [download 76% complete]
-- [download 77% complete]
-- [download 78% complete]
-- [download 79% complete]
-- [download 80% complete]
-- [download 81% complete]
-- [download 82% complete]
-- [download 83% complete]
-- [download 84% complete]
-- [download 85% complete]
-- [download 86% complete]
-- [download 87% complete]
-- [download 88% complete]
-- [download 89% complete]
-- [download 90% complete]
-- [download 91% complete]
-- [download 92% complete]
-- [download 93% complete]
-- [download 94% complete]
-- [download 95% complete]
-- [download 96% complete]
-- [download 97% complete]
-- [download 98% complete]
-- [download 99% complete]
-- [download 100% complete]
-- verifying file...
       file='/tmp/scratch/caffe2/build/googlebenchmark-download/googlebenchmark-prefix/src/v1.2.0.zip'
-- Downloading... done
-- extracting...
     src='/tmp/scratch/caffe2/build/googlebenchmark-download/googlebenchmark-prefix/src/v1.2.0.zip'
     dst='/tmp/scratch/caffe2/build/confu-srcs/googlebenchmark'
-- extracting... [tar xfz]
-- extracting... [analysis]
-- extracting... [rename]
-- extracting... [clean up]
-- extracting... done
[3/9] No update step for 'googlebenchmark'
[4/9] No patch step for 'googlebenchmark'
[5/9] No configure step for 'googlebenchmark'
[6/9] No build step for 'googlebenchmark'
[7/9] No install step for 'googlebenchmark'
[8/9] No test step for 'googlebenchmark'
[9/9] Completed 'googlebenchmark'
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/scratch/caffe2/build/googletest-download
ninja: no work to do.
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/scratch/caffe2/build/googlebenchmark-download
ninja: no work to do.
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/scratch/caffe2/build/googletest-download
ninja: no work to do.
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/scratch/caffe2/build/googlebenchmark-download
ninja: no work to do.
-- Found gflags with new-style gflags target.
-- Found Glog: /usr/local/include  
-- Found glog    (include: /usr/local/include, library: /usr/local/lib/libglog.a)
-- Check if compiler accepts -pthread
-- Check if compiler accepts -pthread - yes
-- git Version: v0.0.0-dirty
-- Version: 0.0.0
-- Performing Test HAVE_CXX_FLAG_STD_CXX11
-- Performing Test HAVE_CXX_FLAG_STD_CXX11 - Success
-- Performing Test HAVE_CXX_FLAG_WALL
-- Performing Test HAVE_CXX_FLAG_WALL - Success
-- Performing Test HAVE_CXX_FLAG_WEXTRA
-- Performing Test HAVE_CXX_FLAG_WEXTRA - Success
-- Performing Test HAVE_CXX_FLAG_WSHADOW
-- Performing Test HAVE_CXX_FLAG_WSHADOW - Success
-- Performing Test HAVE_CXX_FLAG_WERROR
-- Performing Test HAVE_CXX_FLAG_WERROR - Success
-- Performing Test HAVE_CXX_FLAG_PEDANTIC
-- Performing Test HAVE_CXX_FLAG_PEDANTIC - Success
-- Performing Test HAVE_CXX_FLAG_PEDANTIC_ERRORS
-- Performing Test HAVE_CXX_FLAG_PEDANTIC_ERRORS - Success
-- Performing Test HAVE_CXX_FLAG_WSHORTEN_64_TO_32
-- Performing Test HAVE_CXX_FLAG_WSHORTEN_64_TO_32 - Success
-- Performing Test HAVE_CXX_FLAG_WFLOAT_EQUAL
-- Performing Test HAVE_CXX_FLAG_WFLOAT_EQUAL - Success
-- Performing Test HAVE_CXX_FLAG_FSTRICT_ALIASING
-- Performing Test HAVE_CXX_FLAG_FSTRICT_ALIASING - Success
-- Performing Test HAVE_CXX_FLAG_WZERO_AS_NULL_POINTER_CONSTANT
-- Performing Test HAVE_CXX_FLAG_WZERO_AS_NULL_POINTER_CONSTANT - Success
-- Performing Test HAVE_CXX_FLAG_WSTRICT_ALIASING
-- Performing Test HAVE_CXX_FLAG_WSTRICT_ALIASING - Success
-- Performing Test HAVE_CXX_FLAG_WD654
-- Performing Test HAVE_CXX_FLAG_WD654 - Failed
-- Performing Test HAVE_CXX_FLAG_WTHREAD_SAFETY
-- Performing Test HAVE_CXX_FLAG_WTHREAD_SAFETY - Success
-- Performing Test HAVE_THREAD_SAFETY_ATTRIBUTES
-- Performing Test HAVE_THREAD_SAFETY_ATTRIBUTES
-- Performing Test HAVE_THREAD_SAFETY_ATTRIBUTES -- failed to compile
-- Performing Test HAVE_CXX_FLAG_FLTO
-- Performing Test HAVE_CXX_FLAG_FLTO - Failed
-- Performing Test HAVE_CXX_FLAG_COVERAGE
-- Performing Test HAVE_CXX_FLAG_COVERAGE - Success
-- Performing Test HAVE_STD_REGEX
-- Performing Test HAVE_STD_REGEX
-- Performing Test HAVE_STD_REGEX -- success
-- Performing Test HAVE_GNU_POSIX_REGEX
-- Performing Test HAVE_GNU_POSIX_REGEX
-- Performing Test HAVE_GNU_POSIX_REGEX -- failed to compile
-- Performing Test HAVE_POSIX_REGEX
-- Performing Test HAVE_POSIX_REGEX
-- Performing Test HAVE_POSIX_REGEX -- success
-- Performing Test HAVE_STEADY_CLOCK
-- Performing Test HAVE_STEADY_CLOCK
-- Performing Test HAVE_STEADY_CLOCK -- success
-- Found LMDB: /usr/local/include  
-- Found lmdb    (include: /usr/local/include, library: /usr/local/lib/liblmdb.so)
-- Found LevelDB: /usr/local/include  
-- Found LevelDB (include: /usr/local/include, library: /usr/local/lib/libleveldb.so)
-- Found Snappy: /usr/include  
-- Found Snappy  (include: /usr/include, library: /usr/lib64/libsnappy.so)
-- Found RocksDB: /usr/include  
-- Found RocksDB  (include: /usr/include, library: /usr/lib64/librocksdb.so)
-- Found CUDA: /usr/local/cuda (found suitable exact version "9.1") 
-- OpenCV found (/usr/local/share/OpenCV)
CMake Warning at cmake/Dependencies.cmake:240 (find_package):
  By not providing "FindEigen3.cmake" in CMAKE_MODULE_PATH this project has
  asked CMake to find a package configuration file provided by "Eigen3", but
  CMake did not find one.

  Could not find a package configuration file provided by "Eigen3" with any
  of the following names:

    Eigen3Config.cmake
    eigen3-config.cmake

  Add the installation prefix of "Eigen3" to CMAKE_PREFIX_PATH or set
  "Eigen3_DIR" to a directory containing one of the above files.  If "Eigen3"
  provides a separate development package or SDK, be sure it has been
  installed.
Call Stack (most recent call first):
  CMakeLists.txt:81 (include)

-- Did not find system Eigen. Using third party subdirectory.
-- Found PythonInterp: /usr/bin/python (found suitable version "2.7.5", minimum required is "2.7") 
-- Found PythonLibs: /usr/lib64/libpython2.7.so (found suitable version "2.7.5", minimum required is "2.7") 
-- Found NumPy: /usr/lib64/python2.7/site-packages/numpy/core/include (found version "1.7.1") 
-- NumPy ver. 1.7.1 found (include: /usr/lib64/python2.7/site-packages/numpy/core/include)
-- Could NOT find pybind11 (missing: pybind11_INCLUDE_DIR) 
-- Found MPI_C: /usr/local/openmpi/lib/libmpi.so (found version "3.1") 
-- Found MPI_CXX: /usr/local/openmpi/lib/libmpi_cxx.so (found version "3.1") 
-- Found MPI: TRUE (found version "3.1")  
-- MPI support found
-- MPI compile flags: -pthread
-- MPI include path: /usr/local/openmpi/include
-- MPI LINK flags path: -Wl,-rpath -Wl,/usr/local/openmpi/lib -Wl,--enable-new-dtags -pthread
-- MPI libraries: /usr/local/openmpi/lib/libmpi_cxx.so/usr/local/openmpi/lib/libmpi.so
-- Found OpenMP_C: -fopenmp=libomp (found version "3.1") 
-- Found OpenMP_CXX: -fopenmp=libomp (found version "3.1") 
-- Found OpenMP: TRUE (found version "3.1")  
-- Adding -fopenmp=libomp
-- CUDA detected: 9.1
-- Added CUDA NVCC flags for: sm_30 sm_35 sm_50 sm_52 sm_60 sm_61 sm_70
-- Found libcuda: /usr/lib64/libcuda.so
-- Found libnvrtc: /usr/local/cuda/lib64/libnvrtc.so
-- Found CUDNN: /usr/local/cuda/include  
-- Found cuDNN: v7.0.5  (include: /usr/local/cuda/include, library: /usr/local/cuda/lib64/libcudnn.so)
-- Found NCCL: /usr/local/cuda/include  
-- Found NCCL (include: /usr/local/cuda/include, library: /lib/libnccl.so)
-- NCCL: /lib/libnccl.so
-- Could NOT find CUB (missing: CUB_INCLUDE_DIR) 
-- Could NOT find Gloo (missing: Gloo_INCLUDE_DIR Gloo_LIBRARY) 
-- MPI include path: /usr/local/openmpi/include
-- MPI libraries: /usr/local/openmpi/lib/libmpi_cxx.so/usr/local/openmpi/lib/libmpi.so
-- Found CUDA: /usr/local/cuda (found suitable version "9.1", minimum required is "7.0") 
-- CUDA detected: 9.1
-- Found libcuda: /usr/lib64/libcuda.so
-- Found libnvrtc: /usr/local/cuda/lib64/libnvrtc.so
-- Found nccl: /usr/local/cuda/include  
CMake Warning at cmake/Dependencies.cmake:472 (message):
  Metal is only used in ios builds.
Call Stack (most recent call first):
  CMakeLists.txt:81 (include)

-- Include NCCL operators
-- Including image processing operators
-- Excluding video processing operators due to no opencv
-- Excluding mkl operators as we are not using mkl
-- Include Observer library
-- Automatically generating missing __init__.py files.
-- 
-- ******** Summary ********
-- General:
--   CMake version         : 3.10.2
--   CMake command         : /usr/bin/cmake
--   Git version           : v0.8.1-1008-g3ef2ee6-dirty
--   System                : Linux
--   C++ compiler          : /usr/bin/clang++
--   C++ compiler version  : 5.0.1
--   Protobuf compiler     : /usr/local/bin/protoc
--   Protobuf include path : /usr/local/include
--   Protobuf libraries    : /usr/local/lib/libprotobuf.so;-lpthread
--   CXX flags             : -g -fopenmp=libomp -std=c++11 -O2 -fPIC -Wno-narrowing -Wno-invalid-partial-specialization
--   Build type            : Release
--   Compile definitions   : 
-- 
--   BUILD_BINARY          : ON
--   BUILD_DOCS            : OFF
--   BUILD_PYTHON          : ON
--     Python version      : 2.7.5
--     Python library      : /usr/lib64/libpython2.7.so
--   BUILD_SHARED_LIBS     : ON
--   BUILD_TEST            : ON
--   USE_ATEN              : OFF
--   USE_ASAN              : OFF
--   USE_CUDA              : ON
--     CUDA version        : 9.1
--     CuDNN version       : 7.0.5
--   USE_EIGEN_FOR_BLAS    : 
--   USE_FFMPEG            : OFF
--   USE_GFLAGS            : ON
--   USE_GLOG              : ON
--   USE_GLOO              : ON
--   USE_LEVELDB           : ON
--     LevelDB version     : 1.20
--     Snappy version      : 1.1.0
--   USE_LITE_PROTO        : OFF
--   USE_LMDB              : ON
--     LMDB version        : 0.9.21
--   USE_METAL             : OFF
--   USE_MKL               : 
--   USE_MOBILE_OPENGL     : OFF
--   USE_MPI               : ON
--   USE_NCCL              : ON
--   USE_NERVANA_GPU       : OFF
--   USE_NNPACK            : ON
--   USE_OBSERVERS         : ON
--   USE_OPENCV            : ON
--     OpenCV version      : 3.4.0
--   USE_OPENMP            : ON
--   USE_PROF              : OFF
--   USE_REDIS             : OFF
--   USE_ROCKSDB           : ON
--   USE_THREADS           : ON
--   USE_ZMQ               : OFF
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/scratch/caffe2/build
[1/728] /usr/bin/clang -Dnnpack_reference_layers_EXPORTS -I/usr/local/include -I../third_party/NNPACK/include -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fp16/include -g -std=gnu99 -O3 -DNDEBUG -fPIC -MD -MT confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/softmax-output.c.o -MF confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/softmax-output.c.o.d -o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/softmax-output.c.o   -c ../third_party/NNPACK/src/ref/softmax-output.c
[2/728] /usr/bin/clang -Dnnpack_reference_layers_EXPORTS -I/usr/local/include -I../third_party/NNPACK/include -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fp16/include -g -std=gnu99 -O3 -DNDEBUG -fPIC -MD -MT confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/convolution-input-gradient.c.o -MF confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/convolution-input-gradient.c.o.d -o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/convolution-input-gradient.c.o   -c ../third_party/NNPACK/src/ref/convolution-input-gradient.c
[3/728] /usr/bin/clang -Dnnpack_reference_layers_EXPORTS -I/usr/local/include -I../third_party/NNPACK/include -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fp16/include -g -std=gnu99 -O3 -DNDEBUG -fPIC -MD -MT confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/fully-connected-output.c.o -MF confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/fully-connected-output.c.o.d -o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/fully-connected-output.c.o   -c ../third_party/NNPACK/src/ref/fully-connected-output.c
[4/728] /usr/bin/clang -Dnnpack_reference_layers_EXPORTS -I/usr/local/include -I../third_party/NNPACK/include -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fp16/include -g -std=gnu99 -O3 -DNDEBUG -fPIC -MD -MT confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/max-pooling-output.c.o -MF confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/max-pooling-output.c.o.d -o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/max-pooling-output.c.o   -c ../third_party/NNPACK/src/ref/max-pooling-output.c
[5/728] /usr/bin/clang -Dnnpack_reference_layers_EXPORTS -I/usr/local/include -I../third_party/NNPACK/include -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fp16/include -g -std=gnu99 -O3 -DNDEBUG -fPIC -MD -MT confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/convolution-kernel.c.o -MF confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/convolution-kernel.c.o.d -o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/convolution-kernel.c.o   -c ../third_party/NNPACK/src/ref/convolution-kernel.c
[6/728] /usr/bin/clang -Dnnpack_reference_layers_EXPORTS -I/usr/local/include -I../third_party/NNPACK/include -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fp16/include -g -std=gnu99 -O3 -DNDEBUG -fPIC -MD -MT confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/convolution-output.c.o -MF confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/convolution-output.c.o.d -o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/convolution-output.c.o   -c ../third_party/NNPACK/src/ref/convolution-output.c
[7/728] /usr/bin/clang -Dnnpack_reference_layers_EXPORTS -I/usr/local/include -I../third_party/NNPACK/include -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fp16/include -g -std=gnu99 -O3 -DNDEBUG -fPIC -MD -MT confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/relu-input-gradient.c.o -MF confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/relu-input-gradient.c.o.d -o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/relu-input-gradient.c.o   -c ../third_party/NNPACK/src/ref/relu-input-gradient.c
[8/728] /usr/bin/clang -Dnnpack_reference_layers_EXPORTS -I/usr/local/include -I../third_party/NNPACK/include -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fp16/include -g -std=gnu99 -O3 -DNDEBUG -fPIC -MD -MT confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/relu-output.c.o -MF confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/relu-output.c.o.d -o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/relu-output.c.o   -c ../third_party/NNPACK/src/ref/relu-output.c
[9/728] /usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/buffer.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/buffer.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/buffer.cc.o -c ../third_party/gloo/gloo/transport/buffer.cc
[10/728] /usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/device.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/device.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/device.cc.o -c ../third_party/gloo/gloo/transport/device.cc
[11/728] /usr/bin/clang -D_GNU_SOURCE -I/usr/local/include -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -g -std=gnu99 -std=c99 -pthread -O3 -DNDEBUG -fPIC -MD -MT confu-deps/pthreadpool/CMakeFiles/pthreadpool.dir/src/threadpool-pthreads.c.o -MF confu-deps/pthreadpool/CMakeFiles/pthreadpool.dir/src/threadpool-pthreads.c.o.d -o confu-deps/pthreadpool/CMakeFiles/pthreadpool.dir/src/threadpool-pthreads.c.o   -c confu-srcs/pthreadpool/src/threadpool-pthreads.c
[12/728] : && /usr/bin/cmake -E remove lib/libpthreadpool.a && /usr/bin/ar qc lib/libpthreadpool.a  confu-deps/pthreadpool/CMakeFiles/pthreadpool.dir/src/threadpool-pthreads.c.o && /usr/bin/ranlib lib/libpthreadpool.a && :
[13/728] /usr/bin/clang++  -DHAVE_POSIX_REGEX -DHAVE_STD_REGEX -DHAVE_STEADY_CLOCK -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I../third_party/benchmark/src -I../third_party/benchmark/src/../include -g  -std=c++11  -Wall  -Wextra  -Wshadow  -pedantic  -pedantic-errors  -Wshorten-64-to-32  -Wfloat-equal  -fstrict-aliasing  -Wzero-as-null-pointer-constant  -Wstrict-aliasing  -Wthread-safety -O3 -DNDEBUG  -Werror -MD -MT third_party/benchmark/src/CMakeFiles/benchmark.dir/sleep.cc.o -MF third_party/benchmark/src/CMakeFiles/benchmark.dir/sleep.cc.o.d -o third_party/benchmark/src/CMakeFiles/benchmark.dir/sleep.cc.o -c ../third_party/benchmark/src/sleep.cc
[14/728] : && /usr/bin/clang -fPIC -g -std=gnu99 -O3 -DNDEBUG   -shared -Wl,-soname,libnnpack_reference_layers.so -o lib/libnnpack_reference_layers.so confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/convolution-output.c.o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/convolution-input-gradient.c.o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/convolution-kernel.c.o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/fully-connected-output.c.o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/max-pooling-output.c.o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/softmax-output.c.o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/relu-output.c.o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/relu-input-gradient.c.o  lib/libpthreadpool.a -lpthread && :
FAILED: lib/libnnpack_reference_layers.so 
: && /usr/bin/clang -fPIC -g -std=gnu99 -O3 -DNDEBUG   -shared -Wl,-soname,libnnpack_reference_layers.so -o lib/libnnpack_reference_layers.so confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/convolution-output.c.o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/convolution-input-gradient.c.o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/convolution-kernel.c.o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/fully-connected-output.c.o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/max-pooling-output.c.o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/softmax-output.c.o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/relu-output.c.o confu-deps/CMakeFiles/nnpack_reference_layers.dir/src/ref/relu-input-gradient.c.o  lib/libpthreadpool.a -lpthread && :
/usr/bin/ld: /opt/rh/devtoolset-6/root/usr/lib/gcc/x86_64-redhat-linux/6.3.1/crtbeginS.o: unrecognized relocation (0x2a) in section `.text'
/usr/bin/ld: final link failed: Bad value
clang-5.0: error: linker command failed with exit code 1 (use -v to see invocation)
[15/728] /usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/pair.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/pair.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/pair.cc.o -c ../third_party/gloo/gloo/transport/pair.cc
[16/728] /usr/bin/clang++  -DHAVE_POSIX_REGEX -DHAVE_STD_REGEX -DHAVE_STEADY_CLOCK -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I../third_party/benchmark/src -I../third_party/benchmark/src/../include -g  -std=c++11  -Wall  -Wextra  -Wshadow  -pedantic  -pedantic-errors  -Wshorten-64-to-32  -Wfloat-equal  -fstrict-aliasing  -Wzero-as-null-pointer-constant  -Wstrict-aliasing  -Wthread-safety -O3 -DNDEBUG  -Werror -MD -MT third_party/benchmark/src/CMakeFiles/benchmark.dir/commandlineflags.cc.o -MF third_party/benchmark/src/CMakeFiles/benchmark.dir/commandlineflags.cc.o.d -o third_party/benchmark/src/CMakeFiles/benchmark.dir/commandlineflags.cc.o -c ../third_party/benchmark/src/commandlineflags.cc
[17/728] /usr/bin/clang++  -DHAVE_POSIX_REGEX -DHAVE_STD_REGEX -DHAVE_STEADY_CLOCK -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I../third_party/benchmark/src -I../third_party/benchmark/src/../include -g  -std=c++11  -Wall  -Wextra  -Wshadow  -pedantic  -pedantic-errors  -Wshorten-64-to-32  -Wfloat-equal  -fstrict-aliasing  -Wzero-as-null-pointer-constant  -Wstrict-aliasing  -Wthread-safety -O3 -DNDEBUG  -Werror -MD -MT third_party/benchmark/src/CMakeFiles/benchmark.dir/counter.cc.o -MF third_party/benchmark/src/CMakeFiles/benchmark.dir/counter.cc.o.d -o third_party/benchmark/src/CMakeFiles/benchmark.dir/counter.cc.o -c ../third_party/benchmark/src/counter.cc
[18/728] /usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/address.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/address.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/address.cc.o -c ../third_party/gloo/gloo/transport/address.cc
[19/728] /usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/rendezvous/store.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/rendezvous/store.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/rendezvous/store.cc.o -c ../third_party/gloo/gloo/rendezvous/store.cc
[20/728] /usr/bin/clang++  -DHAVE_POSIX_REGEX -DHAVE_STD_REGEX -DHAVE_STEADY_CLOCK -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I../third_party/benchmark/src -I../third_party/benchmark/src/../include -g  -std=c++11  -Wall  -Wextra  -Wshadow  -pedantic  -pedantic-errors  -Wshorten-64-to-32  -Wfloat-equal  -fstrict-aliasing  -Wzero-as-null-pointer-constant  -Wstrict-aliasing  -Wthread-safety -O3 -DNDEBUG  -Werror -MD -MT third_party/benchmark/src/CMakeFiles/benchmark.dir/reporter.cc.o -MF third_party/benchmark/src/CMakeFiles/benchmark.dir/reporter.cc.o.d -o third_party/benchmark/src/CMakeFiles/benchmark.dir/reporter.cc.o -c ../third_party/benchmark/src/reporter.cc
[21/728] /usr/bin/clang++  -DHAVE_POSIX_REGEX -DHAVE_STD_REGEX -DHAVE_STEADY_CLOCK -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I../third_party/benchmark/src -I../third_party/benchmark/src/../include -g  -std=c++11  -Wall  -Wextra  -Wshadow  -pedantic  -pedantic-errors  -Wshorten-64-to-32  -Wfloat-equal  -fstrict-aliasing  -Wzero-as-null-pointer-constant  -Wstrict-aliasing  -Wthread-safety -O3 -DNDEBUG  -Werror -MD -MT third_party/benchmark/src/CMakeFiles/benchmark.dir/colorprint.cc.o -MF third_party/benchmark/src/CMakeFiles/benchmark.dir/colorprint.cc.o.d -o third_party/benchmark/src/CMakeFiles/benchmark.dir/colorprint.cc.o -c ../third_party/benchmark/src/colorprint.cc
[22/728] /usr/bin/clang++  -DHAVE_POSIX_REGEX -DHAVE_STD_REGEX -DHAVE_STEADY_CLOCK -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I../third_party/benchmark/src -I../third_party/benchmark/src/../include -g  -std=c++11  -Wall  -Wextra  -Wshadow  -pedantic  -pedantic-errors  -Wshorten-64-to-32  -Wfloat-equal  -fstrict-aliasing  -Wzero-as-null-pointer-constant  -Wstrict-aliasing  -Wthread-safety -O3 -DNDEBUG  -Werror -MD -MT third_party/benchmark/src/CMakeFiles/benchmark.dir/timers.cc.o -MF third_party/benchmark/src/CMakeFiles/benchmark.dir/timers.cc.o.d -o third_party/benchmark/src/CMakeFiles/benchmark.dir/timers.cc.o -c ../third_party/benchmark/src/timers.cc
[23/728] /usr/bin/clang++   -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/googletest/googletest -g -O3 -DNDEBUG   -g  -DGTEST_HAS_PTHREAD=1 -MD -MT third_party/googletest/googlemock/gtest/CMakeFiles/gtest_main.dir/src/gtest_main.cc.o -MF third_party/googletest/googlemock/gtest/CMakeFiles/gtest_main.dir/src/gtest_main.cc.o.d -o third_party/googletest/googlemock/gtest/CMakeFiles/gtest_main.dir/src/gtest_main.cc.o -c ../third_party/googletest/googletest/src/gtest_main.cc
[24/728] /usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/allreduce_local.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/allreduce_local.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/allreduce_local.cc.o -c ../third_party/gloo/gloo/allreduce_local.cc
[25/728] /usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/common/logging.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/common/logging.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/common/logging.cc.o -c ../third_party/gloo/gloo/common/logging.cc
[26/728] /usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/algorithm.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/algorithm.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/algorithm.cc.o -c ../third_party/gloo/gloo/algorithm.cc
[27/728] /usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/rendezvous/prefix_store.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/rendezvous/prefix_store.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/rendezvous/prefix_store.cc.o -c ../third_party/gloo/gloo/rendezvous/prefix_store.cc
[28/728] /usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/common/linux.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/common/linux.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/common/linux.cc.o -c ../third_party/gloo/gloo/common/linux.cc
FAILED: third_party/gloo/gloo/CMakeFiles/gloo.dir/common/linux.cc.o 
/usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/common/linux.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/common/linux.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/common/linux.cc.o -c ../third_party/gloo/gloo/common/linux.cc
../third_party/gloo/gloo/common/linux.cc:102:25: error: implicit instantiation of undefined template 'std::__1::array<char, 256>'
  std::array<char, 256> buf;
                        ^
/usr/bin/../include/c++/v1/__tuple:223:64: note: template is declared here
template <class _Tp, size_t _Size> struct _LIBCPP_TEMPLATE_VIS array;
                                                               ^
1 error generated.
[29/728] /usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/context.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/context.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/context.cc.o -c ../third_party/gloo/gloo/context.cc
[30/728] /usr/bin/clang++  -DHAVE_POSIX_REGEX -DHAVE_STD_REGEX -DHAVE_STEADY_CLOCK -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I../third_party/benchmark/src -I../third_party/benchmark/src/../include -g  -std=c++11  -Wall  -Wextra  -Wshadow  -pedantic  -pedantic-errors  -Wshorten-64-to-32  -Wfloat-equal  -fstrict-aliasing  -Wzero-as-null-pointer-constant  -Wstrict-aliasing  -Wthread-safety -O3 -DNDEBUG  -Werror -MD -MT third_party/benchmark/src/CMakeFiles/benchmark.dir/string_util.cc.o -MF third_party/benchmark/src/CMakeFiles/benchmark.dir/string_util.cc.o.d -o third_party/benchmark/src/CMakeFiles/benchmark.dir/string_util.cc.o -c ../third_party/benchmark/src/string_util.cc
[31/728] /usr/bin/clang++  -DHAVE_POSIX_REGEX -DHAVE_STD_REGEX -DHAVE_STEADY_CLOCK -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I../third_party/benchmark/src -I../third_party/benchmark/src/../include -g  -std=c++11  -Wall  -Wextra  -Wshadow  -pedantic  -pedantic-errors  -Wshorten-64-to-32  -Wfloat-equal  -fstrict-aliasing  -Wzero-as-null-pointer-constant  -Wstrict-aliasing  -Wthread-safety -O3 -DNDEBUG  -Werror -MD -MT third_party/benchmark/src/CMakeFiles/benchmark.dir/sysinfo.cc.o -MF third_party/benchmark/src/CMakeFiles/benchmark.dir/sysinfo.cc.o.d -o third_party/benchmark/src/CMakeFiles/benchmark.dir/sysinfo.cc.o -c ../third_party/benchmark/src/sysinfo.cc
[32/728] /usr/bin/clang++  -DHAVE_POSIX_REGEX -DHAVE_STD_REGEX -DHAVE_STEADY_CLOCK -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I../third_party/benchmark/src -I../third_party/benchmark/src/../include -g  -std=c++11  -Wall  -Wextra  -Wshadow  -pedantic  -pedantic-errors  -Wshorten-64-to-32  -Wfloat-equal  -fstrict-aliasing  -Wzero-as-null-pointer-constant  -Wstrict-aliasing  -Wthread-safety -O3 -DNDEBUG  -Werror -MD -MT third_party/benchmark/src/CMakeFiles/benchmark.dir/csv_reporter.cc.o -MF third_party/benchmark/src/CMakeFiles/benchmark.dir/csv_reporter.cc.o.d -o third_party/benchmark/src/CMakeFiles/benchmark.dir/csv_reporter.cc.o -c ../third_party/benchmark/src/csv_reporter.cc
[33/728] /usr/bin/clang++  -DHAVE_POSIX_REGEX -DHAVE_STD_REGEX -DHAVE_STEADY_CLOCK -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I../third_party/benchmark/src -I../third_party/benchmark/src/../include -g  -std=c++11  -Wall  -Wextra  -Wshadow  -pedantic  -pedantic-errors  -Wshorten-64-to-32  -Wfloat-equal  -fstrict-aliasing  -Wzero-as-null-pointer-constant  -Wstrict-aliasing  -Wthread-safety -O3 -DNDEBUG  -Werror -MD -MT third_party/benchmark/src/CMakeFiles/benchmark.dir/console_reporter.cc.o -MF third_party/benchmark/src/CMakeFiles/benchmark.dir/console_reporter.cc.o.d -o third_party/benchmark/src/CMakeFiles/benchmark.dir/console_reporter.cc.o -c ../third_party/benchmark/src/console_reporter.cc
[34/728] /usr/bin/clang++   -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googlemock/include -I../third_party/googletest/googlemock -I../third_party/googletest/googletest/include -I../third_party/googletest/googletest -g -O3 -DNDEBUG   -g  -DGTEST_HAS_PTHREAD=1 -MD -MT third_party/googletest/googlemock/CMakeFiles/gmock_main.dir/src/gmock_main.cc.o -MF third_party/googletest/googlemock/CMakeFiles/gmock_main.dir/src/gmock_main.cc.o.d -o third_party/googletest/googlemock/CMakeFiles/gmock_main.dir/src/gmock_main.cc.o -c ../third_party/googletest/googlemock/src/gmock_main.cc
[35/728] /usr/bin/clang++  -DHAVE_POSIX_REGEX -DHAVE_STD_REGEX -DHAVE_STEADY_CLOCK -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I../third_party/benchmark/src -I../third_party/benchmark/src/../include -g  -std=c++11  -Wall  -Wextra  -Wshadow  -pedantic  -pedantic-errors  -Wshorten-64-to-32  -Wfloat-equal  -fstrict-aliasing  -Wzero-as-null-pointer-constant  -Wstrict-aliasing  -Wthread-safety -O3 -DNDEBUG  -Werror -MD -MT third_party/benchmark/src/CMakeFiles/benchmark.dir/complexity.cc.o -MF third_party/benchmark/src/CMakeFiles/benchmark.dir/complexity.cc.o.d -o third_party/benchmark/src/CMakeFiles/benchmark.dir/complexity.cc.o -c ../third_party/benchmark/src/complexity.cc
[36/728] /usr/bin/clang++  -DHAVE_POSIX_REGEX -DHAVE_STD_REGEX -DHAVE_STEADY_CLOCK -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I../third_party/benchmark/src -I../third_party/benchmark/src/../include -g  -std=c++11  -Wall  -Wextra  -Wshadow  -pedantic  -pedantic-errors  -Wshorten-64-to-32  -Wfloat-equal  -fstrict-aliasing  -Wzero-as-null-pointer-constant  -Wstrict-aliasing  -Wthread-safety -O3 -DNDEBUG  -Werror -MD -MT third_party/benchmark/src/CMakeFiles/benchmark.dir/json_reporter.cc.o -MF third_party/benchmark/src/CMakeFiles/benchmark.dir/json_reporter.cc.o.d -o third_party/benchmark/src/CMakeFiles/benchmark.dir/json_reporter.cc.o -c ../third_party/benchmark/src/json_reporter.cc
[37/728] /usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/tcp/address.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/tcp/address.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/tcp/address.cc.o -c ../third_party/gloo/gloo/transport/tcp/address.cc
[38/728] /usr/bin/clang++  -DHAVE_POSIX_REGEX -DHAVE_STD_REGEX -DHAVE_STEADY_CLOCK -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I../third_party/benchmark/src -I../third_party/benchmark/src/../include -g  -std=c++11  -Wall  -Wextra  -Wshadow  -pedantic  -pedantic-errors  -Wshorten-64-to-32  -Wfloat-equal  -fstrict-aliasing  -Wzero-as-null-pointer-constant  -Wstrict-aliasing  -Wthread-safety -O3 -DNDEBUG  -Werror -MD -MT third_party/benchmark/src/CMakeFiles/benchmark.dir/statistics.cc.o -MF third_party/benchmark/src/CMakeFiles/benchmark.dir/statistics.cc.o.d -o third_party/benchmark/src/CMakeFiles/benchmark.dir/statistics.cc.o -c ../third_party/benchmark/src/statistics.cc
[39/728] /usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/tcp/buffer.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/tcp/buffer.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/transport/tcp/buffer.cc.o -c ../third_party/gloo/gloo/transport/tcp/buffer.cc
[40/728] /usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/rendezvous/file_store.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/rendezvous/file_store.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/rendezvous/file_store.cc.o -c ../third_party/gloo/gloo/rendezvous/file_store.cc
[41/728] /usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/mpi/context.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/mpi/context.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/mpi/context.cc.o -c ../third_party/gloo/gloo/mpi/context.cc
../third_party/gloo/gloo/mpi/context.cc:44:3: warning: '~MPIScope' has a non-throwing exception specification but can still throw [-Wexceptions]
  GLOO_ENFORCE_EQ(rv, MPI_SUCCESS);
  ^
../third_party/gloo/gloo/common/logging.h:151:3: note: expanded from macro 'GLOO_ENFORCE_EQ'
  GLOO_ENFORCE_THAT_IMPL(Equals((x), (y)), #x " == " #y, __VA_ARGS__)
  ^
../third_party/gloo/gloo/common/logging.h:138:7: note: expanded from macro 'GLOO_ENFORCE_THAT_IMPL'
      throw EnforceNotMet(                                  \
      ^
../third_party/gloo/gloo/mpi/context.cc:42:11: note: destructor has a implicit non-throwing exception specification
MPIScope::~MPIScope() {
          ^
1 warning generated.
[42/728] /usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/rendezvous/hash_store.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/rendezvous/hash_store.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/rendezvous/hash_store.cc.o -c ../third_party/gloo/gloo/rendezvous/hash_store.cc
[43/728] /usr/bin/clang++  -DGLOO_USE_MPI=1 -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I/usr/local/include/opencv -I../third_party/eigen -I/usr/include/python2.7 -I/usr/lib64/python2.7/site-packages/numpy/core/include -I../third_party/pybind11/include -isystem /usr/local/openmpi/include -isystem /usr/local/cuda/include -I../third_party/cub -I../third_party/gloo -Ithird_party/gloo -g -fopenmp=libomp -std=c++11 -fPIC -O3 -DNDEBUG -MD -MT third_party/gloo/gloo/CMakeFiles/gloo.dir/rendezvous/context.cc.o -MF third_party/gloo/gloo/CMakeFiles/gloo.dir/rendezvous/context.cc.o.d -o third_party/gloo/gloo/CMakeFiles/gloo.dir/rendezvous/context.cc.o -c ../third_party/gloo/gloo/rendezvous/context.cc
[44/728] /usr/bin/clang++  -DHAVE_POSIX_REGEX -DHAVE_STD_REGEX -DHAVE_STEADY_CLOCK -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I../third_party/benchmark/src -I../third_party/benchmark/src/../include -g  -std=c++11  -Wall  -Wextra  -Wshadow  -pedantic  -pedantic-errors  -Wshorten-64-to-32  -Wfloat-equal  -fstrict-aliasing  -Wzero-as-null-pointer-constant  -Wstrict-aliasing  -Wthread-safety -O3 -DNDEBUG  -Werror -MD -MT third_party/benchmark/src/CMakeFiles/benchmark.dir/benchmark.cc.o -MF third_party/benchmark/src/CMakeFiles/benchmark.dir/benchmark.cc.o.d -o third_party/benchmark/src/CMakeFiles/benchmark.dir/benchmark.cc.o -c ../third_party/benchmark/src/benchmark.cc
[45/728] /usr/bin/clang++   -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googlemock/include -I../third_party/googletest/googlemock -I../third_party/googletest/googletest/include -I../third_party/googletest/googletest -g -O3 -DNDEBUG   -g  -DGTEST_HAS_PTHREAD=1 -MD -MT third_party/googletest/googlemock/CMakeFiles/gmock_main.dir/src/gmock-all.cc.o -MF third_party/googletest/googlemock/CMakeFiles/gmock_main.dir/src/gmock-all.cc.o.d -o third_party/googletest/googlemock/CMakeFiles/gmock_main.dir/src/gmock-all.cc.o -c ../third_party/googletest/googlemock/src/gmock-all.cc
[46/728] /usr/bin/clang++   -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googlemock/include -I../third_party/googletest/googlemock -I../third_party/googletest/googletest/include -I../third_party/googletest/googletest -g -O3 -DNDEBUG   -g  -DGTEST_HAS_PTHREAD=1 -MD -MT third_party/googletest/googlemock/CMakeFiles/gmock.dir/src/gmock-all.cc.o -MF third_party/googletest/googlemock/CMakeFiles/gmock.dir/src/gmock-all.cc.o.d -o third_party/googletest/googlemock/CMakeFiles/gmock.dir/src/gmock-all.cc.o -c ../third_party/googletest/googlemock/src/gmock-all.cc
[47/728] cd /tmp/scratch/caffe2/build/confu-deps && PYTHONPATH=/tmp/scratch/caffe2/build/confu-srcs/six:/tmp/scratch/caffe2/build/confu-srcs/enum:/tmp/scratch/caffe2/build/confu-srcs/peachpy /usr/bin/python -m peachpy.x86_64 -mabi=sysv -g4 -mimage-format=elf -I/tmp/scratch/caffe2/third_party/NNPACK/src -I/tmp/scratch/caffe2/third_party/NNPACK/src/x86_64-fma -I/tmp/scratch/caffe2/build/confu-srcs/fp16/include -o /tmp/scratch/caffe2/build/confu-deps/src/x86_64-fma/2d-fourier-8x8.py.o /tmp/scratch/caffe2/third_party/NNPACK/src/x86_64-fma/2d-fourier-8x8.py
[48/728] /usr/bin/clang++  -DHAVE_POSIX_REGEX -DHAVE_STD_REGEX -DHAVE_STEADY_CLOCK -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/benchmark/include -I../third_party/benchmark/src -I../third_party/benchmark/src/../include -g  -std=c++11  -Wall  -Wextra  -Wshadow  -pedantic  -pedantic-errors  -Wshorten-64-to-32  -Wfloat-equal  -fstrict-aliasing  -Wzero-as-null-pointer-constant  -Wstrict-aliasing  -Wthread-safety -O3 -DNDEBUG  -Werror -MD -MT third_party/benchmark/src/CMakeFiles/benchmark.dir/benchmark_register.cc.o -MF third_party/benchmark/src/CMakeFiles/benchmark.dir/benchmark_register.cc.o.d -o third_party/benchmark/src/CMakeFiles/benchmark.dir/benchmark_register.cc.o -c ../third_party/benchmark/src/benchmark_register.cc
[49/728] /usr/bin/clang++   -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googlemock/include -I../third_party/googletest/googlemock -I../third_party/googletest/googletest/include -I../third_party/googletest/googletest -g -O3 -DNDEBUG   -g  -DGTEST_HAS_PTHREAD=1 -MD -MT third_party/googletest/googlemock/CMakeFiles/gmock.dir/__/googletest/src/gtest-all.cc.o -MF third_party/googletest/googlemock/CMakeFiles/gmock.dir/__/googletest/src/gtest-all.cc.o.d -o third_party/googletest/googlemock/CMakeFiles/gmock.dir/__/googletest/src/gtest-all.cc.o -c ../third_party/googletest/googletest/src/gtest-all.cc
[50/728] /usr/bin/clang++   -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googletest/include -I../third_party/googletest/googletest -g -O3 -DNDEBUG   -g  -DGTEST_HAS_PTHREAD=1 -MD -MT third_party/googletest/googlemock/gtest/CMakeFiles/gtest.dir/src/gtest-all.cc.o -MF third_party/googletest/googlemock/gtest/CMakeFiles/gtest.dir/src/gtest-all.cc.o.d -o third_party/googletest/googlemock/gtest/CMakeFiles/gtest.dir/src/gtest-all.cc.o -c ../third_party/googletest/googletest/src/gtest-all.cc
[51/728] /usr/bin/clang++   -I/usr/local/include -I../third_party/NNPACK/include -I../third_party/NNPACK/src -Iconfu-srcs/pthreadpool/include -Iconfu-srcs/fxdiv/include -Iconfu-srcs/psimd/include -Iconfu-srcs/fp16/include -I../third_party/googletest/googlemock/include -I../third_party/googletest/googlemock -I../third_party/googletest/googletest/include -I../third_party/googletest/googletest -g -O3 -DNDEBUG   -g  -DGTEST_HAS_PTHREAD=1 -MD -MT third_party/googletest/googlemock/CMakeFiles/gmock_main.dir/__/googletest/src/gtest-all.cc.o -MF third_party/googletest/googlemock/CMakeFiles/gmock_main.dir/__/googletest/src/gtest-all.cc.o.d -o third_party/googletest/googlemock/CMakeFiles/gmock_main.dir/__/googletest/src/gtest-all.cc.o -c ../third_party/googletest/googletest/src/gtest-all.cc
ninja: build stopped: subcommand failed.
Terminated
pietern commented 6 years ago

Thanks for the additional info.

I ran llvm 5.0.1 in CentOS 7 and couldn't repro. Then I ran the compilation command for linux.cc with -H and the include tree tells me that <array> is included by <tuple> which is included by <functional> which is included by <algorithm>. Sooo... this version of the standard library happens to include it while yours doesn't. I'll go ahead and add it to linux.cc and then we can close this.

xkszltl commented 6 years ago

Are you compiling against libstdc++? libstdc++ does have array included in tuple and that's why gcc compiles.

In my llvm build I set libc++ as default stdlib.

pietern commented 6 years ago

@xkszltl Nice catch, yeah. We don't test with libc++. It's good to keep includes correct anyway, so we don't rely on implied behavior. I haven't run into any incompatibilities yet and don't think we have to test both.

xkszltl commented 6 years ago

In my personal experience libc++ has less "implied" header and llvm toolchain is incomplete without it. It's quite surprising that there's no report about this issue on mac since clang&libc++ is the system default there.

Maybe it's a good idea to bind clang test with libc++ rather than libstdc++?

pietern commented 6 years ago

@xkszltl Thanks for the suggestion. This is a good idea and I can see if we can do this for Caffe2.