search

rioyokotalab / caffe2

Caffe2 is a lightweight, modular, and scalable deep learning framework.
https://caffe2.ai
Other
2 stars 0 forks source link

[Reedbush] error: identifier "__ldg" is undefined #9

Closed Hiroki11x closed 7 years ago

Hiroki11x commented 7 years ago 
CMAKE_INSTALL_PREFIX=/path-to-install cmake -DUSE_REDIS=ON ..
hoge/caffe2/caffe2/operators/resize_op.cu(63): error: identifier "__ldg" is undefined

1 error detected in the compilation of "/tmp/tmpxft_0000477b_00000000-20_resize_op.compute_20.cpp1.ii".
CMake Error at Caffe2_GPU_generated_resize_op.cu.o.cmake:260 (message):
  Error generating file
  hoge/caffe2/build/caffe2/CMakeFiles/Caffe2_GPU.dir/operators/./Caffe2_GPU_generated_resize_op.cu.o

make[2]: *** [caffe2/CMakeFiles/Caffe2_GPU.dir/operators/./Caffe2_GPU_generated_resize_op.cu.o] Error 1
make[2]: *** Waiting for unfinished jobs....
make[1]: *** [caffe2/CMakeFiles/Caffe2_GPU.dir/all] Error 2
make: *** [all] Error 2
Hiroki11x commented 7 years ago 
libCaffe2_CPU.so: undefined reference to `google::protobuf::io::CodedInputStream::BytesUntilTotalBytesLimit() const'
libCaffe2_CPU.so: undefined reference to `google::protobuf::io::CodedInputStream::ReadTagFallback(unsigned int)'
collect2: error: ld returned 1 exit status
make[2]: *** [caffe2/binaries/blob_test] Error 1
make[1]: *** [caffe2/CMakeFiles/blob_test.dir/all] Error 2
Linking CXX shared module python/caffe2_pybind11_state.so
[100%] Built target caffe2_pybind11_state
Linking CXX shared module python/caffe2_pybind11_state_gpu.so
[100%] Built target caffe2_pybind11_state_gpu
make: *** [all] Error 2
Hiroki11x commented 7 years ago 
$ CMAKE_INSTALL_PREFIX=/path-to/local cmake -DUSE_REDIS=ON ..
-- The CXX compiler identification is GNU 4.8.5
-- The C compiler identification is GNU 4.8.5
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Build type not set - defaulting to Release
-- Looking for include file pthread.h
-- Looking for include file pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - not found
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE  
-- Found PROTOBUF: /path-to/protobuf-3.3.0/lib/libprotobuf.so  
-- The BLAS backend of choice:Eigen
-- Could NOT find NNPACK (missing:  NNPACK_INCLUDE_DIR NNPACK_LIBRARY) 
-- Will try to build NNPACK from source. If anything fails, follow the NNPACK prerequisite installation steps.
CMake Warning at cmake/External/nnpack.cmake:154 (message):
  NNPACK is chosen to be installed, but confu and ninja that are needed by it
  are not installed.  As a result we won't build with NNPACK.
Call Stack (most recent call first):
  cmake/Dependencies.cmake:53 (include)
  CMakeLists.txt:73 (include)

CMake Warning at cmake/Dependencies.cmake:58 (message):
  Not compiling with NNPACK.  Suppress this warning with -DUSE_NNPACK=OFF
Call Stack (most recent call first):
  CMakeLists.txt:73 (include)

-- Found GFlags: /path-to/gflags-2.2.0/include  
-- Found gflags  (include: /path-to/gflags-2.2.0/include, library: /path-to/gflags-2.2.0/lib/libgflags.so)
-- Found system gflags install.
-- Found Glog: /path-to/glog-0.3.4/include  
-- Found glog    (include: /path-to/glog-0.3.4/include, library: /path-to/glog-0.3.4/lib/libglog.so)
-- Found system glog install.
-- Found PythonInterp: /path-to/pyenv/shims/python (found version "3.4.3") 
-- Could NOT find Benchmark (missing:  Benchmark_INCLUDE_DIR Benchmark_LIBRARY) 
-- Found Git: /usr/bin/git (found version "1.8.3.1") 
-- git Version: v0.0.0
-- Version: 0.0.0
-- Performing Test HAVE_CXX_FLAG_STD_CXX11
-- Performing Test HAVE_CXX_FLAG_STD_CXX11 - Success
-- Performing Test HAVE_CXX_FLAG_WALL
-- Performing Test HAVE_CXX_FLAG_WALL - Success
-- Performing Test HAVE_CXX_FLAG_WEXTRA
-- Performing Test HAVE_CXX_FLAG_WEXTRA - Success
-- Performing Test HAVE_CXX_FLAG_WSHADOW
-- Performing Test HAVE_CXX_FLAG_WSHADOW - Success
-- Performing Test HAVE_CXX_FLAG_WERROR
-- Performing Test HAVE_CXX_FLAG_WERROR - Success
-- Performing Test HAVE_CXX_FLAG_PEDANTIC
-- Performing Test HAVE_CXX_FLAG_PEDANTIC - Success
-- Performing Test HAVE_CXX_FLAG_PEDANTIC_ERRORS
-- Performing Test HAVE_CXX_FLAG_PEDANTIC_ERRORS - Success
-- Performing Test HAVE_CXX_FLAG_WSHORTEN_64_TO_32
-- Performing Test HAVE_CXX_FLAG_WSHORTEN_64_TO_32 - Failed
-- Performing Test HAVE_CXX_FLAG_WFLOAT_EQUAL
-- Performing Test HAVE_CXX_FLAG_WFLOAT_EQUAL - Success
-- Performing Test HAVE_CXX_FLAG_FSTRICT_ALIASING
-- Performing Test HAVE_CXX_FLAG_FSTRICT_ALIASING - Success
-- Performing Test HAVE_CXX_FLAG_WZERO_AS_NULL_POINTER_CONSTANT
-- Performing Test HAVE_CXX_FLAG_WZERO_AS_NULL_POINTER_CONSTANT - Success
-- Performing Test HAVE_CXX_FLAG_WSTRICT_ALIASING
-- Performing Test HAVE_CXX_FLAG_WSTRICT_ALIASING - Success
-- Performing Test HAVE_CXX_FLAG_WTHREAD_SAFETY
-- Performing Test HAVE_CXX_FLAG_WTHREAD_SAFETY - Failed
-- Performing Test HAVE_CXX_FLAG_COVERAGE
-- Performing Test HAVE_CXX_FLAG_COVERAGE - Success
-- Performing Test HAVE_STD_REGEX
-- Performing Test HAVE_STD_REGEX -- compiled but failed to run
-- Performing Test HAVE_GNU_POSIX_REGEX
-- Performing Test HAVE_GNU_POSIX_REGEX -- failed to compile
-- Performing Test HAVE_POSIX_REGEX
-- Performing Test HAVE_POSIX_REGEX -- success
-- Performing Test HAVE_STEADY_CLOCK
-- Performing Test HAVE_STEADY_CLOCK -- success
-- Performing Test BENCHMARK_HAS_CXX03_FLAG
-- Performing Test BENCHMARK_HAS_CXX03_FLAG - Success
-- Found LMDB: /path-to/lmdb-LMDB_0.9.18/include  
-- Found lmdb    (include: /path-to/lmdb-LMDB_0.9.18/include, library: /path-to/lmdb-LMDB_0.9.18/lib/liblmdb.so)
-- Could NOT find LevelDB (missing:  LevelDB_INCLUDE) 
-- Found Snappy: /path-to/snappy-1.1.4/include  
-- Found Snappy  (include: /path-to/snappy-1.1.4/include, library: /path-to/snappy-1.1.4/lib/libsnappy.so)
CMake Warning at cmake/Dependencies.cmake:127 (message):
  Not compiling with LevelDB.  Suppress this warning with -DUSE_LEVELDB=OFF
Call Stack (most recent call first):
  CMakeLists.txt:73 (include)

-- Could NOT find RocksDB (missing:  RocksDB_INCLUDE_DIR RocksDB_LIBRARIES) 
CMake Warning at cmake/Dependencies.cmake:139 (message):
  Not compiling with RocksDB.  Suppress this warning with -DUSE_ROCKSDB=OFF
Call Stack (most recent call first):
  CMakeLists.txt:73 (include)

-- Found Hiredis: /path-to/hiredis/include  
-- Found Hiredis  (include: /path-to/hiredis/include, library: /path-to/hiredis/lib/libhiredis.so)
-- Found CUDA: /path-to/acc/cuda/8.0.44 (found suitable exact version "8.0") 
-- OpenCV found (/path-to/acc/opencv/3.2.0/share/OpenCV)
-- Found PythonInterp: /path-to/pyenv/shims/python (found suitable version "3.4.3", minimum required is "2.7") 
-- Found PythonLibs: /usr/lib64/libpython2.7.so (found suitable version "2.7.5", minimum required is "2.7") 
-- Found NumPy: /path-to/pyenv/versions/3.4.3/lib/python3.4/site-packages/numpy/core/include (found version "1.13.1") 
-- NumPy ver. 1.13.1 found (include: /path-to/pyenv/versions/3.4.3/lib/python3.4/site-packages/numpy/core/include)
-- Could NOT find pybind11 (missing:  pybind11_INCLUDE_DIR) 
-- Found MPI_C: /path-to/intel/compilers_and_libraries_2017.2.174/linux/mpi/intel64/lib/libmpifort.so;/path-to/intel/compilers_and_libraries_2017.2.174/linux/mpi/intel64/lib/release_mt/libmpi.so;/path-to/intel/compilers_and_libraries_2017.2.174/linux/mpi/intel64/lib/libmpigi.a;/usr/lib64/libdl.so;/usr/lib64/librt.so;/usr/lib64/libpthread.so  
-- Found MPI_CXX: /path-to/intel/compilers_and_libraries_2017.2.174/linux/mpi/intel64/lib/libmpicxx.so;/path-to/intel/compilers_and_libraries_2017.2.174/linux/mpi/intel64/lib/libmpifort.so;/path-to/intel/compilers_and_libraries_2017.2.174/linux/mpi/intel64/lib/release_mt/libmpi.so;/path-to/intel/compilers_and_libraries_2017.2.174/linux/mpi/intel64/lib/libmpigi.a;/usr/lib64/libdl.so;/usr/lib64/librt.so;/usr/lib64/libpthread.so  
-- MPI support found
-- MPI compile flags: 
-- MPI include path: /path-to/intel/compilers_and_libraries_2017.2.174/linux/mpi/intel64/include
-- MPI LINK flags path: 
-- MPI libraries: /path-to/intel/compilers_and_libraries_2017.2.174/linux/mpi/intel64/lib/libmpicxx.so/path-to/intel/compilers_and_libraries_2017.2.174/linux/mpi/intel64/lib/libmpifort.so/path-to/intel/compilers_and_libraries_2017.2.174/linux/mpi/intel64/lib/release_mt/libmpi.so/path-to/intel/compilers_and_libraries_2017.2.174/linux/mpi/intel64/lib/libmpigi.a/usr/lib64/libdl.so/usr/lib64/librt.so/usr/lib64/libpthread.so
-- Try OpenMP C flag = [-fopenmp]
-- Performing Test OpenMP_FLAG_DETECTED
-- Performing Test OpenMP_FLAG_DETECTED - Success
-- Try OpenMP CXX flag = [-fopenmp]
-- Performing Test OpenMP_FLAG_DETECTED
-- Performing Test OpenMP_FLAG_DETECTED - Success
-- Found OpenMP: -fopenmp  
-- Adding -fopenmp
-- CUDA detected: 8.0
-- Automatic GPU detection failed. Building for all known architectures.
-- Added CUDA NVCC flags for: sm_20 sm_21 sm_30 sm_35 sm_50 sm_52 sm_60 sm_61
-- Found libcuda: /usr/lib64/libcuda.so
-- Found libnvrtc: /path-to/acc/cuda/8.0.44/lib64/libnvrtc.so
-- Found CUDNN: /path-to/acc/cuda/8.0.44/include  
-- Found cuDNN: v5.1.5  (include: /path-to/acc/cuda/8.0.44/include, library: /path-to/acc/cuda/8.0.44/lib64/libcudnn.so)
-- Found NCCL: /path-to/nccl-1.3.4-1/include  
-- Found NCCL    (include: /path-to/nccl-1.3.4-1/include, library: /path-to/nccl-1.3.4-1/lib/libnccl.so)
-- NCCL: /path-to/nccl-1.3.4-1/lib/libnccl.so
-- Could NOT find CUB (missing:  CUB_INCLUDE_DIR) 
-- Could NOT find Gloo (missing:  Gloo_INCLUDE_DIR Gloo_LIBRARY) 
-- Found hiredis: /path-to/hiredis/include/hiredis  
-- Found hiredis (include: /path-to/hiredis/include/hiredis, library: /path-to/hiredis/lib/libhiredis.so)
-- MPI include path: /path-to/intel/compilers_and_libraries_2017.2.174/linux/mpi/intel64/include
-- MPI libraries: /path-to/intel/compilers_and_libraries_2017.2.174/linux/mpi/intel64/lib/libmpicxx.so/path-to/intel/compilers_and_libraries_2017.2.174/linux/mpi/intel64/lib/libmpifort.so/path-to/intel/compilers_and_libraries_2017.2.174/linux/mpi/intel64/lib/release_mt/libmpi.so/path-to/intel/compilers_and_libraries_2017.2.174/linux/mpi/intel64/lib/libmpigi.a/usr/lib64/libdl.so/usr/lib64/librt.so/usr/lib64/libpthread.so
-- Found CUDA: /path-to/acc/cuda/8.0.44 (found suitable version "8.0", minimum required is "7.0") 
-- CUDA detected: 8.0
-- Found libcuda: /usr/lib64/libcuda.so
-- Found libnvrtc: /path-to/acc/cuda/8.0.44/lib64/libnvrtc.so
-- Performing Test CAFFE2_LONG_IS_INT32_OR_64
-- Performing Test CAFFE2_LONG_IS_INT32_OR_64 - Success
-- Does not need to define long separately.
-- Performing Test HAS_BUILTIN_CPU_SUPPORTS
-- Performing Test HAS_BUILTIN_CPU_SUPPORTS - Success
-- This compiler has builtin_cpu_supports feature.
-- Performing Test CAFFE2_NEED_TO_TURN_OFF_DEPRECATION_WARNING
-- Performing Test CAFFE2_NEED_TO_TURN_OFF_DEPRECATION_WARNING - Success
-- GCC 4.8.5: Adding gcc and gcc_s libs to link line
-- Include NCCL operators
-- Including image processing operators
-- Excluding video processing operators due to no opencv
-- Excluding mkl operators as we are not using mkl
-- Automatically generating missing __init__.py files.
-- 
-- ******** Summary ********
-- General:
--   Git version           : 
--   System                : Linux
--   C++ compiler          : /usr/bin/c++
--   C++ compiler version  : 4.8.5
--   Protobuf compiler     : /path-to/protobuf-3.3.0/bin/protoc
--   CXX flags             :  -fopenmp -std=c++11 -fPIC -Wno-narrowing
--   Build type            : Release
--   Compile definitions   : CAFFE2_USE_EIGEN_FOR_BLAS;CAFFE2_USE_GOOGLE_GLOG;CAFFE2_USE_GFLAGS;EIGEN_MPL2_ONLY
-- 
--   BUILD_SHARED_LIBS     : ON
--   BUILD_PYTHON          : ON
--     Python version      : 2.7.5
--     Python library      : /usr/lib64/libpython2.7.so
--   BUILD_TEST            : ON
--   USE_CUDA              : ON
--     CUDA version        : 8.0
--   USE_CNMEM             : OFF
--   USE_NERVANA_GPU       : OFF
--   USE_GLOG              : ON
--   USE_GFLAGS            : ON
--   USE_LMDB              : ON
--     LMDB version        : 0.9.18
--   USE_LEVELDB           : OFF
--   USE_OPENCV            : ON
--     OpenCV version      : 3.2.0
--   USE_FFMPEG            : 
--   USE_ZMQ               : OFF
--   USE_ROCKSDB           : OFF
--   USE_MPI               : ON
--   USE_NCCL              : ON
--   USE_NNPACK            : OFF
--   USE_OPENMP            : ON
--   USE_REDIS             : ON
--   USE_GLOO              : ON
-- Configuring done
-- Generating done
-- Build files have been written to: /path-to/dl/caffe2/build
Hiroki11x commented 7 years ago

https://github.com/gunrock/gunrock/issues/192

Hiroki11x commented 7 years ago 
/lustre/gi75/i75012/dl/caffe2/caffe2/operators/lp_pool_op.cu(24): warning: function "caffe2::<unnamed>::cuda_pow(T, T) [with T=double]" was declared but never referenced

/lustre/gi75/i75012/dl/caffe2/caffe2/operators/lp_pool_op.cu(33): warning: function "caffe2::<unnamed>::cuda_abs(T) [with T=double]" was declared but never referenced

/lustre/gi75/i75012/dl/caffe2/caffe2/operators/resize_op.cu(63): error: identifier "__ldg" is undefined

1 error detected in the compilation of "/tmp/tmpxft_00005b1f_00000000-20_resize_op.compute_20.cpp1.ii".
CMake Error at Caffe2_GPU_generated_resize_op.cu.o.cmake:260 (message):
  Error generating file
  /lustre/gi75/i75012/dl/caffe2/build/caffe2/CMakeFiles/Caffe2_GPU.dir/operators/./Caffe2_GPU_generated_resize_op.cu.o

make[2]: *** [caffe2/CMakeFiles/Caffe2_GPU.dir/operators/./Caffe2_GPU_generated_resize_op.cu.o] Error 1
make[2]: *** Waiting for unfinished jobs....
/lustre/gi75/i75012/dl/caffe2/caffe2/operators/lp_pool_op.cu(24): warning: function "caffe2::<unnamed>::cuda_pow(T, T) [with T=double]" was declared but never referenced

/lustre/gi75/i75012/dl/caffe2/caffe2/operators/lp_pool_op.cu(33): warning: function "caffe2::<unnamed>::cuda_abs(T) [with T=double]" was declared but never referenced

/lustre/gi75/i75012/dl/caffe2/caffe2/operators/lp_pool_op.cu(24): warning: function "caffe2::<unnamed>::cuda_pow(T, T) [with T=double]" was declared but never referenced

/lustre/gi75/i75012/dl/caffe2/caffe2/operators/lp_pool_op.cu(33): warning: function "caffe2::<unnamed>::cuda_abs(T) [with T=double]" was declared but never referenced

/lustre/gi75/i75012/dl/caffe2/caffe2/operators/lp_pool_op.cu(24): warning: function "caffe2::<unnamed>::cuda_pow(T, T) [with T=double]" was declared but never referenced

/lustre/gi75/i75012/dl/caffe2/caffe2/operators/lp_pool_op.cu(33): warning: function "caffe2::<unnamed>::cuda_abs(T) [with T=double]" was declared but never referenced

/lustre/gi75/i75012/dl/caffe2/caffe2/operators/lp_pool_op.cu(24): warning: function "caffe2::<unnamed>::cuda_pow(T, T) [with T=double]" was declared but never referenced

/lustre/gi75/i75012/dl/caffe2/caffe2/operators/lp_pool_op.cu(33): warning: function "caffe2::<unnamed>::cuda_abs(T) [with T=double]" was declared but never referenced

/lustre/gi75/i75012/dl/caffe2/caffe2/operators/lp_pool_op.cu(24): warning: function "caffe2::<unnamed>::cuda_pow(T, T) [with T=double]" was declared but never referenced

/lustre/gi75/i75012/dl/caffe2/caffe2/operators/lp_pool_op.cu(33): warning: function "caffe2::<unnamed>::cuda_abs(T) [with T=double]" was declared but never referenced

/lustre/gi75/i75012/dl/caffe2/caffe2/operators/lp_pool_op.cu(24): warning: function "caffe2::<unnamed>::cuda_pow(T, T) [with T=double]" was declared but never referenced

/lustre/gi75/i75012/dl/caffe2/caffe2/operators/lp_pool_op.cu(33): warning: function "caffe2::<unnamed>::cuda_abs(T) [with T=double]" was declared but never referenced

make[1]: *** [caffe2/CMakeFiles/Caffe2_GPU.dir/all] Error 2
make: *** [all] Error 2
Hiroki11x commented 7 years ago

pyenv setting http://qiita.com/Kodaira_/items/feadfef9add468e3a85b http://kurogomapurin.hatenablog.com/entry/2015/10/06/154259

Hiroki11x commented 7 years ago

I found this similar issue https://github.com/caffe2/caffe2/issues/948

CMAKE_INSTALL_PREFIX=/lustre/gi75/i75012/dl/caffe2/local cmake -DUSE_REDIS=ON  -DCUDA_ARCH_NAME=Manual -DCUDA_ARCH_BIN="35 52 60 61" -DCUDA_ARCH_PTX="61" ..

then 

make install -j 128

output

../libCaffe2_CPU.so: undefined reference to `google::protobuf::io::CodedInputStream::ReadTagFallback(unsigned int)'
collect2: error: ld returned 1 exit status
make[2]: *** [caffe2/binaries/binaries/make_image_db] Error 1
make[1]: *** [caffe2/binaries/CMakeFiles/make_image_db.dir/all] Error 2
Linking CXX executable binaries/blob_test
CMakeFiles/blob_test.dir/core/blob_test.cc.o: In function `caffe2::(anonymous namespace)::TypedTensorTest_BigTensorSerialization_Test<float>::TestBody()':
blob_test.cc:(.text+0x41111): warning: the use of `tmpnam' is dangerous, better use `mkstemp'
CMakeFiles/blob_test.dir/core/blob_test.cc.o: In function `caffe2::OperatorDef caffe2::CreateOperatorDef<std::vector<std::string, std::allocator<std::string> >, std::vector<std::string, std::allocator<std::string> >, std::vector<caffe2::Argument, std::allocator<caffe2::Argument> > >(std::string const&, std::string const&, std::vector<std::string, std::allocator<std::string> > const&, std::vector<std::string, std::allocator<std::string> > const&, std::vector<caffe2::Argument, std::allocator<caffe2::Argument> > const&, caffe2::DeviceOption const&, std::string const&)':
blob_test.cc:(.text._ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_[_ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_]+0x36): undefined reference to `google::protobuf::internal::fixed_address_empty_string'
blob_test.cc:(.text._ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_[_ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_]+0x53): undefined reference to `google::protobuf::internal::fixed_address_empty_string'
blob_test.cc:(.text._ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_[_ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_]+0xad): undefined reference to `google::protobuf::Arena::AllocateAligned(std::type_info const*, unsigned long)'
blob_test.cc:(.text._ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_[_ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_]+0xd6): undefined reference to `google::protobuf::Arena::AddListNode(void*, void (*)(void*))'
blob_test.cc:(.text._ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_[_ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_]+0x1bd): undefined reference to `google::protobuf::Arena::AllocateAligned(std::type_info const*, unsigned long)'
blob_test.cc:(.text._ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_[_ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_]+0x1e6): undefined reference to `google::protobuf::Arena::AddListNode(void*, void (*)(void*))'
blob_test.cc:(.text._ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_[_ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_]+0x2cd): undefined reference to `google::protobuf::Arena::AllocateAligned(std::type_info const*, unsigned long)'
blob_test.cc:(.text._ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_[_ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_]+0x2ef): undefined reference to `google::protobuf::Arena::AddListNode(void*, void (*)(void*))'
blob_test.cc:(.text._ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_[_ZN6caffe217CreateOperatorDefISt6vectorISsSaISsEES3_S1_INS_8ArgumentESaIS4_EEEENS_11OperatorDefERKSsS9_RKT_RKT0_RKT1_RKNS_12DeviceOptionES9_]+0x3be): undefined reference to `google::protobuf::internal::fixed_address_empty_string'
libCaffe2_CPU.so: undefined reference to `google::protobuf::internal::WireFormatLite::WriteStringMaybeAliased(int, std::string const&, google::protobuf::io::CodedOutputStream*)'
/lustre/app/acc/opencv/3.2.0/lib/libopencv_core.so.3.2.0: undefined reference to `tbb::interface7::internal::task_arena_base::internal_current_slot()'
libCaffe2_CPU.so: undefined reference to `google::protobuf::internal::WireFormatLite::WriteFloatArray(float const*, int, google::protobuf::io::CodedOutputStream*)'
libCaffe2_CPU.so: undefined reference to `google::protobuf::io::CodedInputStream::ReadVarint64Fallback()'
libCaffe2_CPU.so: undefined reference to `google::protobuf::io::CodedOutputStream::WriteStringWithSizeToArray(std::string const&, unsigned char*)'
libCaffe2_CPU.so: undefined reference to `google::protobuf::internal::AssignDescriptors(std::string const&, google::protobuf::internal::MigrationSchema const*, google::protobuf::Message const* const*, unsigned int const*, google::protobuf::MessageFactory*, google::protobuf::Metadata*, google::protobuf::EnumDescriptor const**, google::protobuf::ServiceDescriptor const**)'
libCaffe2_CPU.so: undefined reference to `google::protobuf::io::CodedInputStream::IncrementRecursionDepthAndPushLimit(int)'
libCaffe2_CPU.so: undefined reference to `google::protobuf::internal::WireFormatLite::Int32Size(google::protobuf::RepeatedField<int> const&)'
libCaffe2_CPU.so: undefined reference to `google::protobuf::internal::WireFormat::ReadPackedEnumPreserveUnknowns(google::protobuf::io::CodedInputStream*, unsigned int, bool (*)(int), google::protobuf::UnknownFieldSet*, google::protobuf::RepeatedField<int>*)'
libCaffe2_CPU.so: undefined reference to `google::protobuf::io::CodedInputStream::ReadVarint32Fallback(unsigned int)'
libCaffe2_CPU.so: undefined reference to `google::protobuf::internal::RegisterAllTypes(google::protobuf::Metadata const*, int)'
libCaffe2_CPU.so: undefined reference to `google::protobuf::io::CodedOutputStream::WriteVarint32SlowPath(unsigned int)'
libCaffe2_CPU.so: undefined reference to `google::protobuf::internal::InitProtobufDefaults()'
libCaffe2_CPU.so: undefined reference to `google::protobuf::internal::WireFormatLite::WriteDoubleArray(double const*, int, google::protobuf::io::CodedOutputStream*)'
libCaffe2_CPU.so: undefined reference to `google::protobuf::io::CodedInputStream::ReadVarintSizeAsIntFallback()'
libCaffe2_CPU.so: undefined reference to `google::protobuf::internal::RepeatedPtrFieldBase::InternalExtend(int)'
libCaffe2_CPU.so: undefined reference to `google::protobuf::internal::WireFormatLite::UInt32Size(google::protobuf::RepeatedField<unsigned int> const&)'
libCaffe2_CPU.so: undefined reference to `google::protobuf::io::CodedInputStream::DecrementRecursionDepthAndPopLimit(int)'
libCaffe2_CPU.so: undefined reference to `google::protobuf::io::CodedOutputStream::WriteVarint64SlowPath(unsigned long)'
libCaffe2_CPU.so: undefined reference to `google::protobuf::internal::WireFormatLite::WriteBytesMaybeAliased(int, std::string const&, google::protobuf::io::CodedOutputStream*)'
libCaffe2_CPU.so: undefined reference to `google::protobuf::Message::SpaceUsedLong() const'
libCaffe2_CPU.so: undefined reference to `google::protobuf::io::CodedInputStream::BytesUntilTotalBytesLimit() const'
libCaffe2_CPU.so: undefined reference to `google::protobuf::io::CodedInputStream::ReadTagFallback(unsigned int)'
collect2: error: ld returned 1 exit status
make[2]: *** [caffe2/binaries/blob_test] Error 1
make[1]: *** [caffe2/CMakeFiles/blob_test.dir/all] Error 2
Linking CXX shared module python/caffe2_pybind11_state.so
Linking CXX shared module python/caffe2_pybind11_state_gpu.so
[100%] Built target caffe2_pybind11_state
[100%] Built target caffe2_pybind11_state_gpu
Hiroki11x commented 7 years ago

after finishing opencv 2.4.3 install

[100%] Built target blob_test
Linking CXX shared module python/caffe2_pybind11_state_gpu.so
Linking CXX shared module python/caffe2_pybind11_state.so
[100%] Built target caffe2_pybind11_state_gpu
[100%] Built target caffe2_pybind11_state
Install the project...
-- Install configuration: "Release"
-- Installing: /usr/local/lib/libgmock.so
CMake Error at third_party/googletest/googlemock/cmake_install.cmake:42 (FILE):
  file INSTALL cannot copy file
  "/lustre/gi75/i75012/dl/caffe2/build/third_party/googletest/googlemock/libgmock.so"
  to "/usr/local/lib/libgmock.so".
Call Stack (most recent call first):
  third_party/googletest/cmake_install.cmake:37 (INCLUDE)
  cmake_install.cmake:37 (INCLUDE)
Hiroki11x commented 7 years ago 
cmake -DCMAKE_INSTALL_PREFIX=/lustre/gi75/i75012/dl/caffe2/local -DUSE_REDIS=ON  -DCUDA_ARCH_NAME=Manual -DCUDA_ARCH_BIN="35 52 60 61" -DCUDA_ARCH_PTX="61" ..

make install -j 128

succeeded!!

Hiroki11x commented 7 years ago

I confirmed that Caffe2 inference code was able to work on Reedbush

https://github.com/rioyokotalab/models