Open asfimport opened 3 years ago
Kouhei Sutou / @kou: Could you try installing Apache Arrow C++ directly (without R) and share the command line you used?
Menno / @mennosiek: I tried installing arrow directly calling:
git clone https://github.com/apache/arrow.git
cd arrow/cpp
mkdir release
cd release
cmake ..
make
However it even fails earlier that using the R install:
-- Building using CMake version: 3.16.0
-- The C compiler identification is GNU 6.3.0
-- The CXX compiler identification is GNU 6.3.0
-- Check for working C compiler: /QOpenSys/pkgs/bin/cc
-- Check for working C compiler: /QOpenSys/pkgs/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /QOpenSys/pkgs/bin/c++
-- Check for working CXX compiler: /QOpenSys/pkgs/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Arrow version: 5.0.0 (full: '5.0.0-SNAPSHOT')
-- Arrow SO version: 500 (full: 500.0.0)
-- clang-tidy not found
-- clang-format not found
-- Could NOT find ClangTools (missing: CLANG_FORMAT_BIN CLANG_TIDY_BIN)
-- infer not found
-- Found Python3: /QOpenSys/pkgs/bin/python3.6 (found version "3.6.12") found components: Interpreter
-- Found cpplint executable at /pfmphp/phptestmsi/PFMRBI/arrow/cpp/build-support/cpplint.py
-- System processor: powerpc
-- Performing Test CXX_SUPPORTS_ALTIVEC
-- Performing Test CXX_SUPPORTS_ALTIVEC - Success
-- Arrow build warning level: PRODUCTION
Using ld linker
Configured for RELEASE build (set with cmake -DCMAKE_BUILD_TYPE={release,debug,...})
-- Build Type: RELEASE
-- Using AUTO approach to find dependencies
-- ARROW_ABSL_BUILD_VERSION: 0f3bb466b868b523cf1dc9b2aaaed65c77b28862
-- ARROW_AWSSDK_BUILD_VERSION: 1.8.133
-- ARROW_AWS_CHECKSUMS_BUILD_VERSION: v0.1.10
-- ARROW_AWS_C_COMMON_BUILD_VERSION: v0.5.10
-- ARROW_AWS_C_EVENT_STREAM_BUILD_VERSION: v0.1.5
-- ARROW_BOOST_BUILD_VERSION: 1.75.0
-- ARROW_BROTLI_BUILD_VERSION: v1.0.9
-- ARROW_BZIP2_BUILD_VERSION: 1.0.8
-- ARROW_CARES_BUILD_VERSION: 1.17.1
-- ARROW_GBENCHMARK_BUILD_VERSION: v1.5.2
-- ARROW_GFLAGS_BUILD_VERSION: v2.2.2
-- ARROW_GLOG_BUILD_VERSION: v0.4.0
-- ARROW_GRPC_BUILD_VERSION: v1.35.0
-- ARROW_GTEST_BUILD_VERSION: 1.10.0
-- ARROW_JEMALLOC_BUILD_VERSION: 5.2.1
-- ARROW_LZ4_BUILD_VERSION: v1.9.3
-- ARROW_MIMALLOC_BUILD_VERSION: v1.6.4
-- ARROW_ORC_BUILD_VERSION: 1.6.6
-- ARROW_PROTOBUF_BUILD_VERSION: v3.14.0
-- ARROW_RAPIDJSON_BUILD_VERSION: 1a803826f1197b5e30703afe4b9c0e7dd48074f5
-- ARROW_RE2_BUILD_VERSION: 2021-02-02
-- ARROW_SNAPPY_BUILD_VERSION: 1.1.8
-- ARROW_THRIFT_BUILD_VERSION: 0.13.0
-- ARROW_THRIFT_BUILD_MD5_CHECKSUM: 38a27d391a2b03214b444cb13d5664f1
-- ARROW_UTF8PROC_BUILD_VERSION: v2.6.1
-- ARROW_XSIMD_BUILD_VERSION: e9234cd6e6f4428fc260073b2c34ffe86fda1f34
-- ARROW_ZLIB_BUILD_VERSION: 1.2.11
-- ARROW_ZSTD_BUILD_VERSION: v1.4.8
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Check if compiler accepts -pthread
-- Check if compiler accepts -pthread - yes
-- Found Threads: TRUE
-- Looking for __SIZEOF_INT128__
-- Looking for __SIZEOF_INT128__ - found
-- Building without OpenSSL support. Minimum OpenSSL version 1.0.2 required.
-- Building (vendored) jemalloc from source
-- Building xsimd from source
-- Found hdfs.h at: /pfmphp/phptestmsi/PFMRBI/arrow/cpp/thirdparty/hadoop/include/hdfs.h
-- All bundled static libraries: jemalloc::jemalloc
-- CMAKE_C_FLAGS: -O3 -DNDEBUG -Wall -fno-semantic-interposition -maltivec
-- CMAKE_CXX_FLAGS: -fdiagnostics-color=always -O3 -DNDEBUG -Wall -fno-semantic-interposition -maltivec
-- Looking for backtrace
-- Looking for backtrace - not found
-- Could NOT find Backtrace (missing: Backtrace_LIBRARY Backtrace_INCLUDE_DIR)
-- Creating bundled static library target arrow_bundled_dependencies at /pfmphp/phptestmsi/PFMRBI/arrow/cpp/build/release/libarrow_bundled_dependencies.a
-- ---------------------------------------------------------------------
-- Arrow version: 5.0.0-SNAPSHOT
--
-- Build configuration summary:
-- Generator: Unix Makefiles
-- Build type: RELEASE
-- Source directory: /pfmphp/phptestmsi/PFMRBI/arrow/cpp
-- Install prefix: /usr/local
--
-- Compile and link options:
--
-- ARROW_CXXFLAGS="" [default=""]
-- Compiler flags to append when compiling Arrow
-- ARROW_BUILD_STATIC=ON [default=ON]
-- Build static libraries
-- ARROW_BUILD_SHARED=ON [default=ON]
-- Build shared libraries
-- ARROW_PACKAGE_KIND="" [default=""]
-- Arbitrary string that identifies the kind of package
-- (for informational purposes)
-- ARROW_GIT_ID=7707d333fb09fd0019a9bf03047147e05e463766 [default=""]
-- The Arrow git commit id (if any)
-- ARROW_GIT_DESCRIPTION=apache-arrow-3.0.0-888-g7707d333f [default=""]
-- The Arrow git commit description (if any)
-- ARROW_NO_DEPRECATED_API=OFF [default=OFF]
-- Exclude deprecated APIs from build
-- ARROW_USE_CCACHE=ON [default=ON]
-- Use ccache when compiling (if available)
-- ARROW_USE_LD_GOLD=OFF [default=OFF]
-- Use ld.gold for linking on Linux (if available)
-- ARROW_USE_PRECOMPILED_HEADERS=OFF [default=OFF]
-- Use precompiled headers when compiling
-- ARROW_SIMD_LEVEL=SSE4_2 [default=NONE|SSE4_2|AVX2|AVX512]
-- Compile-time SIMD optimization level
-- ARROW_RUNTIME_SIMD_LEVEL=MAX [default=NONE|SSE4_2|AVX2|AVX512|MAX]
-- Max runtime SIMD optimization level
-- ARROW_ARMV8_ARCH=armv8-a [default=armv8-a|armv8-a+crc+crypto]
-- Arm64 arch and extensions
-- ARROW_ALTIVEC=ON [default=ON]
-- Build with Altivec if compiler has support
-- ARROW_RPATH_ORIGIN=OFF [default=OFF]
-- Build Arrow libraries with RATH set to $ORIGIN
-- ARROW_INSTALL_NAME_RPATH=ON [default=ON]
-- Build Arrow libraries with install_name set to @rpath
-- ARROW_GGDB_DEBUG=ON [default=ON]
-- Pass -ggdb flag to debug builds
--
-- Test and benchmark options:
--
-- ARROW_BUILD_EXAMPLES=OFF [default=OFF]
-- Build the Arrow examples
-- ARROW_BUILD_TESTS=OFF [default=OFF]
-- Build the Arrow googletest unit tests
-- ARROW_ENABLE_TIMING_TESTS=ON [default=ON]
-- Enable timing-sensitive tests
-- ARROW_BUILD_INTEGRATION=OFF [default=OFF]
-- Build the Arrow integration test executables
-- ARROW_BUILD_BENCHMARKS=OFF [default=OFF]
-- Build the Arrow micro benchmarks
-- ARROW_BUILD_BENCHMARKS_REFERENCE=OFF [default=OFF]
-- Build the Arrow micro reference benchmarks
-- ARROW_TEST_LINKAGE=shared [default=shared|static]
-- Linkage of Arrow libraries with unit tests executables.
-- ARROW_FUZZING=OFF [default=OFF]
-- Build Arrow Fuzzing executables
-- ARROW_LARGE_MEMORY_TESTS=OFF [default=OFF]
-- Enable unit tests which use large memory
--
-- Lint options:
--
-- ARROW_ONLY_LINT=OFF [default=OFF]
-- Only define the lint and check-format targets
-- ARROW_VERBOSE_LINT=OFF [default=OFF]
-- If off, 'quiet' flags will be passed to linting tools
-- ARROW_GENERATE_COVERAGE=OFF [default=OFF]
-- Build with C++ code coverage enabled
--
-- Checks options:
--
-- ARROW_TEST_MEMCHECK=OFF [default=OFF]
-- Run the test suite using valgrind --tool=memcheck
-- ARROW_USE_ASAN=OFF [default=OFF]
-- Enable Address Sanitizer checks
-- ARROW_USE_TSAN=OFF [default=OFF]
-- Enable Thread Sanitizer checks
-- ARROW_USE_UBSAN=OFF [default=OFF]
-- Enable Undefined Behavior sanitizer checks
--
-- Project component options:
--
-- ARROW_BUILD_UTILITIES=OFF [default=OFF]
-- Build Arrow commandline utilities
-- ARROW_COMPUTE=OFF [default=OFF]
-- Build the Arrow Compute Modules
-- ARROW_CSV=OFF [default=OFF]
-- Build the Arrow CSV Parser Module
-- ARROW_CUDA=OFF [default=OFF]
-- Build the Arrow CUDA extensions (requires CUDA toolkit)
-- ARROW_DATASET=OFF [default=OFF]
-- Build the Arrow Dataset Modules
-- ARROW_FILESYSTEM=OFF [default=OFF]
-- Build the Arrow Filesystem Layer
-- ARROW_FLIGHT=OFF [default=OFF]
-- Build the Arrow Flight RPC System (requires GRPC, Protocol Buffers)
-- ARROW_GANDIVA=OFF [default=OFF]
-- Build the Gandiva libraries
-- ARROW_HDFS=OFF [default=OFF]
-- Build the Arrow HDFS bridge
-- ARROW_HIVESERVER2=OFF [default=OFF]
-- Build the HiveServer2 client and Arrow adapter
-- ARROW_IPC=ON [default=ON]
-- Build the Arrow IPC extensions
-- ARROW_JEMALLOC=ON [default=ON]
-- Build the Arrow jemalloc-based allocator
-- ARROW_JNI=OFF [default=OFF]
-- Build the Arrow JNI lib
-- ARROW_JSON=OFF [default=OFF]
-- Build Arrow with JSON support (requires RapidJSON)
-- ARROW_MIMALLOC=OFF [default=OFF]
-- Build the Arrow mimalloc-based allocator
-- ARROW_PARQUET=OFF [default=OFF]
-- Build the Parquet libraries
-- ARROW_ORC=OFF [default=OFF]
-- Build the Arrow ORC adapter
-- ARROW_PLASMA=OFF [default=OFF]
-- Build the plasma object store along with Arrow
-- ARROW_PLASMA_JAVA_CLIENT=OFF [default=OFF]
-- Build the plasma object store java client
-- ARROW_PYTHON=OFF [default=OFF]
-- Build the Arrow CPython extensions
-- ARROW_S3=OFF [default=OFF]
-- Build Arrow with S3 support (requires the AWS SDK for C++)
-- ARROW_TENSORFLOW=OFF [default=OFF]
-- Build Arrow with TensorFlow support enabled
-- ARROW_TESTING=OFF [default=OFF]
-- Build the Arrow testing libraries
--
-- Thirdparty toolchain options:
--
-- ARROW_DEPENDENCY_SOURCE=AUTO [default=AUTO|BUNDLED|SYSTEM|CONDA|VCPKG|BREW]
-- Method to use for acquiring arrow's build dependencies
-- ARROW_VERBOSE_THIRDPARTY_BUILD=OFF [default=OFF]
-- Show output from ExternalProjects rather than just logging to files
-- ARROW_DEPENDENCY_USE_SHARED=ON [default=ON]
-- Link to shared libraries
-- ARROW_BOOST_USE_SHARED=ON [default=ON]
-- Rely on boost shared libraries where relevant
-- ARROW_BROTLI_USE_SHARED=ON [default=ON]
-- Rely on Brotli shared libraries where relevant
-- ARROW_BZ2_USE_SHARED=ON [default=ON]
-- Rely on Bz2 shared libraries where relevant
-- ARROW_GFLAGS_USE_SHARED=ON [default=ON]
-- Rely on GFlags shared libraries where relevant
-- ARROW_GRPC_USE_SHARED=ON [default=ON]
-- Rely on gRPC shared libraries where relevant
-- ARROW_LZ4_USE_SHARED=ON [default=ON]
-- Rely on lz4 shared libraries where relevant
-- ARROW_OPENSSL_USE_SHARED=ON [default=ON]
-- Rely on OpenSSL shared libraries where relevant
-- ARROW_PROTOBUF_USE_SHARED=ON [default=ON]
-- Rely on Protocol Buffers shared libraries where relevant
-- ARROW_THRIFT_USE_SHARED=ON [default=ON]
-- Rely on thrift shared libraries where relevant
-- ARROW_UTF8PROC_USE_SHARED=ON [default=ON]
-- Rely on utf8proc shared libraries where relevant
-- ARROW_SNAPPY_USE_SHARED=ON [default=ON]
-- Rely on snappy shared libraries where relevant
-- ARROW_UTF8PROC_USE_SHARED=ON [default=ON]
-- Rely on utf8proc shared libraries where relevant
-- ARROW_ZSTD_USE_SHARED=ON [default=ON]
-- Rely on zstd shared libraries where relevant
-- ARROW_USE_GLOG=OFF [default=OFF]
-- Build libraries with glog support for pluggable logging
-- ARROW_WITH_BACKTRACE=ON [default=ON]
-- Build with backtrace support
-- ARROW_WITH_BROTLI=OFF [default=OFF]
-- Build with Brotli compression
-- ARROW_WITH_BZ2=OFF [default=OFF]
-- Build with BZ2 compression
-- ARROW_WITH_LZ4=OFF [default=OFF]
-- Build with lz4 compression
-- ARROW_WITH_SNAPPY=OFF [default=OFF]
-- Build with Snappy compression
-- ARROW_WITH_ZLIB=OFF [default=OFF]
-- Build with zlib compression
-- ARROW_WITH_ZSTD=OFF [default=OFF]
-- Build with zstd compression
-- ARROW_WITH_UTF8PROC=OFF [default=ON]
-- Build with support for Unicode properties using the utf8proc library
-- (only used if ARROW_COMPUTE is ON)
-- ARROW_WITH_RE2=OFF [default=ON]
-- Build with support for regular expressions using the re2 library
-- (only used if ARROW_COMPUTE or ARROW_GANDIVA is ON)
--
-- Parquet options:
--
-- PARQUET_MINIMAL_DEPENDENCY=OFF [default=OFF]
-- Depend only on Thirdparty headers to build libparquet.
-- Always OFF if building binaries
-- PARQUET_BUILD_EXECUTABLES=OFF [default=OFF]
-- Build the Parquet executable CLI tools. Requires static libraries to be built.
-- PARQUET_BUILD_EXAMPLES=OFF [default=OFF]
-- Build the Parquet examples. Requires static libraries to be built.
-- PARQUET_REQUIRE_ENCRYPTION=OFF [default=OFF]
-- Build support for encryption. Fail if OpenSSL is not found
--
-- Gandiva options:
--
-- ARROW_GANDIVA_JAVA=OFF [default=OFF]
-- Build the Gandiva JNI wrappers
-- ARROW_GANDIVA_STATIC_LIBSTDCPP=OFF [default=OFF]
-- Include -static-libstdc++ -static-libgcc when linking with
-- Gandiva static libraries
-- ARROW_GANDIVA_PC_CXX_FLAGS="" [default=""]
-- Compiler flags to append when pre-compiling Gandiva operations
--
-- Advanced developer options:
--
-- ARROW_EXTRA_ERROR_CONTEXT=OFF [default=OFF]
-- Compile with extra error context (line numbers, code)
-- ARROW_OPTIONAL_INSTALL=OFF [default=OFF]
-- If enabled install ONLY targets that have already been built. Please be
-- advised that if this is enabled 'install' will fail silently on components
-- that have not been built
-- Outputting build configuration summary to /pfmphp/phptestmsi/PFMRBI/arrow/cpp/cmake_summary.json
-- Configuring done
-- Generating done
-- Build files have been written to: /pfmphp/phptestmsi/PFMRBI/arrow/cpp
Scanning dependencies of target jemalloc_ep
[ 1%] Performing download step (download, verify and extract) for 'jemalloc_ep'
CMake Error at jemalloc_ep-stamp/jemalloc_ep-download-RELEASE.cmake:37 (message):
Command failed: 1 '/QOpenSys/pkgs/bin/cmake' '-Dmake=' '-Dconfig=' '-P' '/pfmphp/phptestmsi/PFMRBI/arrow/cpp/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-download-RELEASE-impl.cmake' See also /pfmphp/phptestmsi/PFMRBI/arrow/cpp/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-download-*.log
-- stdout output is:
-- File already exists but no hash specified (use URL_HASH):
file='/pfmphp/phptestmsi/PFMRBI/arrow/cpp/jemalloc_ep-prefix/src/jemalloc-5.2.1.tar.bz2'
Old file will be removed and new file downloaded from URL.
-- Downloading...
dst='/pfmphp/phptestmsi/PFMRBI/arrow/cpp/jemalloc_ep-prefix/src/jemalloc-5.2.1.tar.bz2'
timeout='none'
-- Using src='https://github.com/jemalloc/jemalloc/releases/download/5.2.1/jemalloc-5.2.1.tar.bz2'
-- [download 62% complete]
-- [download 100% complete]
-- [download 0% complete]
-- [download 1% complete]
-- [download 2% complete]
-- [download 3% complete]
-- [download 4% complete]
-- [download 5% complete]
-- [download 6% complete]
-- [download 7% complete]
-- [download 8% complete]
-- [download 9% complete]
-- [download 10% complete]
-- [download 11% complete]
-- [download 12% complete]
-- [download 13% complete]
-- [download 14% complete]
-- [download 15% complete]
-- [download 16% complete]
-- [download 17% complete]
-- [download 18% complete]
-- [download 19% complete]
-- [download 20% complete]
-- [download 21% complete]
-- [download 22% complete]
-- [download 23% complete]
-- [download 24% complete]
-- [download 25% complete]
-- [download 26% complete]
-- [download 27% complete]
-- [download 28% complete]
-- [download 29% complete]
-- [download 30% complete]
-- [download 31% complete]
-- [download 32% complete]
-- [download 33% complete]
-- [download 34% complete]
-- [download 35% complete]
-- [download 36% complete]
-- [download 37% complete]
-- [download 38% complete]
-- [download 40% complete]
-- [download 43% complete]
-- [download 45% complete]
-- [download 48% complete]
-- [download 51% complete]
-- [download 54% complete]
-- [download 57% complete]
-- [download 60% complete]
-- [download 63% complete]
-- [download 66% complete]
-- [download 69% complete]
-- [download 71% complete]
-- [download 72% complete]
-- [download 75% complete]
-- [download 78% complete]
-- [download 79% complete]
-- [download 82% complete]
-- [download 85% complete]
-- [download 88% complete]
-- [download 91% complete]
-- [download 94% complete]
-- [download 97% complete]
-- [download 100% complete]
-- Downloading... done
-- extracting...
src='/pfmphp/phptestmsi/PFMRBI/arrow/cpp/jemalloc_ep-prefix/src/jemalloc-5.2.1.tar.bz2'
dst='/pfmphp/phptestmsi/PFMRBI/arrow/cpp/jemalloc_ep-prefix/src/jemalloc_ep'
-- extracting... [tar xfz]
-- extracting... [error clean up]-- stderr output is:
CMake Error: Problem with archive_read_open_file(): Child process exited with status 127
CMake Error: Problem extracting tar: /pfmphp/phptestmsi/PFMRBI/arrow/cpp/jemalloc_ep-prefix/src/jemalloc-5.2.1.tar.bz2
CMake Error at jemalloc_ep-stamp/extract-jemalloc_ep.cmake:33 (message):
error: extract of
'/pfmphp/phptestmsi/PFMRBI/arrow/cpp/jemalloc_ep-prefix/src/jemalloc-5.2.1.tar.bz2'
failed
CMake Error at jemalloc_ep-stamp/jemalloc_ep-download-RELEASE-impl.cmake:29 (message):
Command failed (1): '/QOpenSys/pkgs/bin/cmake' '-P' '/pfmphp/phptestmsi/PFMRBI/arrow/cpp/jemalloc_ep-prefix/src/jemalloc_ep-stamp/extract-jemalloc_ep.cmake'CMake Error at jemalloc_ep-stamp/jemalloc_ep-download-RELEASE.cmake:47 (message):
Stopping after outputting logs.
make[2]: *** [CMakeFiles/jemalloc_ep.dir/build.make:91: jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-download] Error 1
make[1]: *** [CMakeFiles/Makefile2:439: CMakeFiles/jemalloc_ep.dir/all] Error 2
make: *** [Makefile:141: all] Error 2
Menno / @mennosiek: Installing with R I run:
cd arrow/r
R CMD INSTALL .
And the full output is:
* installing to library '/QOpenSys/pkgs/lib/R/library'
* installing *source* package 'arrow' ...
*** Generating code with data-raw/codegen.R
Error in library(decor) : there is no package called 'decor'
Calls: suppressPackageStartupMessages -> withCallingHandlers -> library
Execution halted
*** Found local C++ source
*** Building C++ libraries
*** Building with MAKEFLAGS= -jNA
**** arrow with SOURCE_DIR="../cpp" BUILD_DIR="/tmp/RtmpCyabIa/file1b6aaa1848" DEST_DIR="libarrow/arrow-4.0.0.9000" CMAKE="/QOpenSys/pkgs/bin/cmake" CC="gcc" CXX="g++ -std=gnu++11" LDFLAGS="-pthread -liconv -Wl,-brtl,-liconv,-bbigtoc,-bnoexpall,-blibpath:/QOpenSys/pkgs/lib:/QOpenSys/pkgs/lib/R/lib:/QOpenSys/usr/lib" ARROW_S3=OFF ARROW_MIMALLOC=OFF
++ pwd
+ : /pfmphp/phptestmsi/PFMRBI/arrow/r
+ : ../cpp
+ : /tmp/RtmpCyabIa/file1b6aaa1848
+ : libarrow/arrow-4.0.0.9000
+ : /QOpenSys/pkgs/bin/cmake
++ cd ../cpp
++ pwd
+ SOURCE_DIR=/pfmphp/phptestmsi/PFMRBI/arrow/cpp
++ mkdir -p libarrow/arrow-4.0.0.9000
++ cd libarrow/arrow-4.0.0.9000
++ pwd
+ DEST_DIR=/pfmphp/phptestmsi/PFMRBI/arrow/r/libarrow/arrow-4.0.0.9000
++ echo
++ tr '[:upper:]' '[:lower:]'
+ LIBARROW_MINIMAL=
+ '[' '' = false ']'
+ ARROW_DEFAULT_PARAM=OFF
+ mkdir -p /tmp/RtmpCyabIa/file1b6aaa1848
+ pushd /tmp/RtmpCyabIa/file1b6aaa1848
/tmp/RtmpCyabIa/file1b6aaa1848 /pfmphp/phptestmsi/PFMRBI/arrow/r
+ /QOpenSys/pkgs/bin/cmake -DARROW_BOOST_USE_SHARED=OFF -DARROW_BUILD_TESTS=OFF -DARROW_BUILD_SHARED=OFF -DARROW_BUILD_STATIC=ON -DARROW_COMPUTE=ON -DARROW_CSV=ON -DARROW_DATASET=ON -DARROW_DEPENDENCY_SOURCE=BUNDLED -DARROW_FILESYSTEM=ON -DARROW_JEMALLOC=OFF -DARROW_MIMALLOC=OFF -DARROW_JSON=ON -DARROW_PARQUET=ON -DARROW_S3=OFF -DARROW_WITH_BROTLI=OFF -DARROW_WITH_BZ2=OFF -DARROW_WITH_LZ4=OFF -DARROW_WITH_RE2=ON -DARROW_WITH_SNAPPY=OFF -DARROW_WITH_UTF8PROC=ON -DARROW_WITH_ZLIB=OFF -DARROW_WITH_ZSTD=OFF -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_LIBDIR=lib -DCMAKE_INSTALL_PREFIX=/pfmphp/phptestmsi/PFMRBI/arrow/r/libarrow/arrow-4.0.0.9000 -DCMAKE_EXPORT_NO_PACKAGE_REGISTRY=ON -DCMAKE_FIND_PACKAGE_NO_PACKAGE_REGISTRY=ON -DCMAKE_UNITY_BUILD=ON -G 'Unix Makefiles' /pfmphp/phptestmsi/PFMRBI/arrow/cpp
-- Building using CMake version: 3.16.0
-- The C compiler identification is GNU 6.3.0
-- The CXX compiler identification is GNU 6.3.0
-- Check for working C compiler: /QOpenSys/pkgs/bin/gcc
-- Check for working C compiler: /QOpenSys/pkgs/bin/gcc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /QOpenSys/pkgs/bin/g++
-- Check for working CXX compiler: /QOpenSys/pkgs/bin/g++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Arrow version: 5.0.0 (full: '5.0.0-SNAPSHOT')
-- Arrow SO version: 500 (full: 500.0.0)
-- clang-tidy not found
-- clang-format not found
-- Could NOT find ClangTools (missing: CLANG_FORMAT_BIN CLANG_TIDY_BIN)
-- infer not found
-- Found Python3: /QOpenSys/pkgs/bin/python3.6 (found version "3.6.12") found components: Interpreter
-- Found cpplint executable at /pfmphp/phptestmsi/PFMRBI/arrow/cpp/build-support/cpplint.py
-- System processor: powerpc
-- Performing Test CXX_SUPPORTS_ALTIVEC
-- Performing Test CXX_SUPPORTS_ALTIVEC - Success
-- Arrow build warning level: PRODUCTION
Using ld linker
Configured for RELEASE build (set with cmake -DCMAKE_BUILD_TYPE={release,debug,...})
-- Build Type: RELEASE
-- Using BUNDLED approach to find dependencies
-- ARROW_ABSL_BUILD_VERSION: 0f3bb466b868b523cf1dc9b2aaaed65c77b28862
-- ARROW_AWSSDK_BUILD_VERSION: 1.8.133
-- ARROW_AWS_CHECKSUMS_BUILD_VERSION: v0.1.10
-- ARROW_AWS_C_COMMON_BUILD_VERSION: v0.5.10
-- ARROW_AWS_C_EVENT_STREAM_BUILD_VERSION: v0.1.5
-- ARROW_BOOST_BUILD_VERSION: 1.75.0
-- ARROW_BROTLI_BUILD_VERSION: v1.0.9
-- ARROW_BZIP2_BUILD_VERSION: 1.0.8
-- ARROW_CARES_BUILD_VERSION: 1.17.1
-- ARROW_GBENCHMARK_BUILD_VERSION: v1.5.2
-- ARROW_GFLAGS_BUILD_VERSION: v2.2.2
-- ARROW_GLOG_BUILD_VERSION: v0.4.0
-- ARROW_GRPC_BUILD_VERSION: v1.35.0
-- ARROW_GTEST_BUILD_VERSION: 1.10.0
-- ARROW_JEMALLOC_BUILD_VERSION: 5.2.1
-- ARROW_LZ4_BUILD_VERSION: v1.9.3
-- ARROW_MIMALLOC_BUILD_VERSION: v1.6.4
-- ARROW_ORC_BUILD_VERSION: 1.6.6
-- ARROW_PROTOBUF_BUILD_VERSION: v3.14.0
-- ARROW_RAPIDJSON_BUILD_VERSION: 1a803826f1197b5e30703afe4b9c0e7dd48074f5
-- ARROW_RE2_BUILD_VERSION: 2021-02-02
-- ARROW_SNAPPY_BUILD_VERSION: 1.1.8
-- ARROW_THRIFT_BUILD_VERSION: 0.13.0
-- ARROW_THRIFT_BUILD_MD5_CHECKSUM: 38a27d391a2b03214b444cb13d5664f1
-- ARROW_UTF8PROC_BUILD_VERSION: v2.6.1
-- ARROW_XSIMD_BUILD_VERSION: e9234cd6e6f4428fc260073b2c34ffe86fda1f34
-- ARROW_ZLIB_BUILD_VERSION: 1.2.11
-- ARROW_ZSTD_BUILD_VERSION: v1.4.8
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
-- Found Threads: TRUE
-- Looking for __SIZEOF_INT128__
-- Looking for __SIZEOF_INT128__ - found
-- Boost include dir: /tmp/RtmpCyabIa/file1b6aaa1848/boost_ep-prefix/src/boost_ep
-- Boost libraries: boost_system_static;boost_filesystem_static
-- Building without OpenSSL support. Minimum OpenSSL version 1.0.2 required.
Building Apache Thrift from source
-- Building RapidJSON from source
-- Building xsimd from source
-- Building RE2 from source
-- Building utf8proc from source
-- Found hdfs.h at: /pfmphp/phptestmsi/PFMRBI/arrow/cpp/thirdparty/hadoop/include/hdfs.h
-- All bundled static libraries: thrift::thrift;re2::re2;utf8proc::utf8proc
-- CMAKE_C_FLAGS: -O3 -DNDEBUG -Wall -fno-semantic-interposition -maltivec
-- CMAKE_CXX_FLAGS: -Wno-subobject-linkage -fdiagnostics-color=always -O3 -DNDEBUG -Wall -fno-semantic-interposition -maltivec
-- Looking for backtrace
-- Looking for backtrace - not found
-- Could NOT find Backtrace (missing: Backtrace_LIBRARY Backtrace_INCLUDE_DIR)
-- Creating bundled static library target arrow_bundled_dependencies at /tmp/RtmpCyabIa/file1b6aaa1848/release/libarrow_bundled_dependencies.a
-- ---------------------------------------------------------------------
-- Arrow version: 5.0.0-SNAPSHOT
--
-- Build configuration summary:
-- Generator: Unix Makefiles
-- Build type: RELEASE
-- Source directory: /pfmphp/phptestmsi/PFMRBI/arrow/cpp
-- Install prefix: /pfmphp/phptestmsi/PFMRBI/arrow/r/libarrow/arrow-4.0.0.9000
--
-- Compile and link options:
--
-- ARROW_CXXFLAGS="" [default=""]
-- Compiler flags to append when compiling Arrow
-- ARROW_BUILD_STATIC=ON [default=ON]
-- Build static libraries
-- ARROW_BUILD_SHARED=OFF [default=ON]
-- Build shared libraries
-- ARROW_PACKAGE_KIND="" [default=""]
-- Arbitrary string that identifies the kind of package
-- (for informational purposes)
-- ARROW_GIT_ID=7707d333fb09fd0019a9bf03047147e05e463766 [default=""]
-- The Arrow git commit id (if any)
-- ARROW_GIT_DESCRIPTION=apache-arrow-3.0.0-888-g7707d333f [default=""]
-- The Arrow git commit description (if any)
-- ARROW_NO_DEPRECATED_API=OFF [default=OFF]
-- Exclude deprecated APIs from build
-- ARROW_USE_CCACHE=ON [default=ON]
-- Use ccache when compiling (if available)
-- ARROW_USE_LD_GOLD=OFF [default=OFF]
-- Use ld.gold for linking on Linux (if available)
-- ARROW_USE_PRECOMPILED_HEADERS=OFF [default=OFF]
-- Use precompiled headers when compiling
-- ARROW_SIMD_LEVEL=SSE4_2 [default=NONE|SSE4_2|AVX2|AVX512]
-- Compile-time SIMD optimization level
-- ARROW_RUNTIME_SIMD_LEVEL=MAX [default=NONE|SSE4_2|AVX2|AVX512|MAX]
-- Max runtime SIMD optimization level
-- ARROW_ARMV8_ARCH=armv8-a [default=armv8-a|armv8-a+crc+crypto]
-- Arm64 arch and extensions
-- ARROW_ALTIVEC=ON [default=ON]
-- Build with Altivec if compiler has support
-- ARROW_RPATH_ORIGIN=OFF [default=OFF]
-- Build Arrow libraries with RATH set to $ORIGIN
-- ARROW_INSTALL_NAME_RPATH=ON [default=ON]
-- Build Arrow libraries with install_name set to @rpath
-- ARROW_GGDB_DEBUG=ON [default=ON]
-- Pass -ggdb flag to debug builds
--
-- Test and benchmark options:
--
-- ARROW_BUILD_EXAMPLES=OFF [default=OFF]
-- Build the Arrow examples
-- ARROW_BUILD_TESTS=OFF [default=OFF]
-- Build the Arrow googletest unit tests
-- ARROW_ENABLE_TIMING_TESTS=ON [default=ON]
-- Enable timing-sensitive tests
-- ARROW_BUILD_INTEGRATION=OFF [default=OFF]
-- Build the Arrow integration test executables
-- ARROW_BUILD_BENCHMARKS=OFF [default=OFF]
-- Build the Arrow micro benchmarks
-- ARROW_BUILD_BENCHMARKS_REFERENCE=OFF [default=OFF]
-- Build the Arrow micro reference benchmarks
-- ARROW_TEST_LINKAGE=static [default=shared|static]
-- Linkage of Arrow libraries with unit tests executables.
-- ARROW_FUZZING=OFF [default=OFF]
-- Build Arrow Fuzzing executables
-- ARROW_LARGE_MEMORY_TESTS=OFF [default=OFF]
-- Enable unit tests which use large memory
--
-- Lint options:
--
-- ARROW_ONLY_LINT=OFF [default=OFF]
-- Only define the lint and check-format targets
-- ARROW_VERBOSE_LINT=OFF [default=OFF]
-- If off, 'quiet' flags will be passed to linting tools
-- ARROW_GENERATE_COVERAGE=OFF [default=OFF]
-- Build with C++ code coverage enabled
--
-- Checks options:
--
-- ARROW_TEST_MEMCHECK=OFF [default=OFF]
-- Run the test suite using valgrind --tool=memcheck
-- ARROW_USE_ASAN=OFF [default=OFF]
-- Enable Address Sanitizer checks
-- ARROW_USE_TSAN=OFF [default=OFF]
-- Enable Thread Sanitizer checks
-- ARROW_USE_UBSAN=OFF [default=OFF]
-- Enable Undefined Behavior sanitizer checks
--
-- Project component options:
--
-- ARROW_BUILD_UTILITIES=OFF [default=OFF]
-- Build Arrow commandline utilities
-- ARROW_COMPUTE=ON [default=OFF]
-- Build the Arrow Compute Modules
-- ARROW_CSV=ON [default=OFF]
-- Build the Arrow CSV Parser Module
-- ARROW_CUDA=OFF [default=OFF]
-- Build the Arrow CUDA extensions (requires CUDA toolkit)
-- ARROW_DATASET=ON [default=OFF]
-- Build the Arrow Dataset Modules
-- ARROW_FILESYSTEM=ON [default=OFF]
-- Build the Arrow Filesystem Layer
-- ARROW_FLIGHT=OFF [default=OFF]
-- Build the Arrow Flight RPC System (requires GRPC, Protocol Buffers)
-- ARROW_GANDIVA=OFF [default=OFF]
-- Build the Gandiva libraries
-- ARROW_HDFS=OFF [default=OFF]
-- Build the Arrow HDFS bridge
-- ARROW_HIVESERVER2=OFF [default=OFF]
-- Build the HiveServer2 client and Arrow adapter
-- ARROW_IPC=ON [default=ON]
-- Build the Arrow IPC extensions
-- ARROW_JEMALLOC=OFF [default=ON]
-- Build the Arrow jemalloc-based allocator
-- ARROW_JNI=OFF [default=OFF]
-- Build the Arrow JNI lib
-- ARROW_JSON=ON [default=OFF]
-- Build Arrow with JSON support (requires RapidJSON)
-- ARROW_MIMALLOC=OFF [default=OFF]
-- Build the Arrow mimalloc-based allocator
-- ARROW_PARQUET=ON [default=OFF]
-- Build the Parquet libraries
-- ARROW_ORC=OFF [default=OFF]
-- Build the Arrow ORC adapter
-- ARROW_PLASMA=OFF [default=OFF]
-- Build the plasma object store along with Arrow
-- ARROW_PLASMA_JAVA_CLIENT=OFF [default=OFF]
-- Build the plasma object store java client
-- ARROW_PYTHON=OFF [default=OFF]
-- Build the Arrow CPython extensions
-- ARROW_S3=OFF [default=OFF]
-- Build Arrow with S3 support (requires the AWS SDK for C++)
-- ARROW_TENSORFLOW=OFF [default=OFF]
-- Build Arrow with TensorFlow support enabled
-- ARROW_TESTING=OFF [default=OFF]
-- Build the Arrow testing libraries
--
-- Thirdparty toolchain options:
--
-- ARROW_DEPENDENCY_SOURCE=BUNDLED [default=AUTO|BUNDLED|SYSTEM|CONDA|VCPKG|BREW]
-- Method to use for acquiring arrow's build dependencies
-- ARROW_VERBOSE_THIRDPARTY_BUILD=OFF [default=OFF]
-- Show output from ExternalProjects rather than just logging to files
-- ARROW_DEPENDENCY_USE_SHARED=ON [default=ON]
-- Link to shared libraries
-- ARROW_BOOST_USE_SHARED=OFF [default=ON]
-- Rely on boost shared libraries where relevant
-- ARROW_BROTLI_USE_SHARED=ON [default=ON]
-- Rely on Brotli shared libraries where relevant
-- ARROW_BZ2_USE_SHARED=ON [default=ON]
-- Rely on Bz2 shared libraries where relevant
-- ARROW_GFLAGS_USE_SHARED=ON [default=ON]
-- Rely on GFlags shared libraries where relevant
-- ARROW_GRPC_USE_SHARED=ON [default=ON]
-- Rely on gRPC shared libraries where relevant
-- ARROW_LZ4_USE_SHARED=ON [default=ON]
-- Rely on lz4 shared libraries where relevant
-- ARROW_OPENSSL_USE_SHARED=ON [default=ON]
-- Rely on OpenSSL shared libraries where relevant
-- ARROW_PROTOBUF_USE_SHARED=ON [default=ON]
-- Rely on Protocol Buffers shared libraries where relevant
-- ARROW_THRIFT_USE_SHARED=ON [default=ON]
-- Rely on thrift shared libraries where relevant
-- ARROW_UTF8PROC_USE_SHARED=ON [default=ON]
-- Rely on utf8proc shared libraries where relevant
-- ARROW_SNAPPY_USE_SHARED=ON [default=ON]
-- Rely on snappy shared libraries where relevant
-- ARROW_UTF8PROC_USE_SHARED=ON [default=ON]
-- Rely on utf8proc shared libraries where relevant
-- ARROW_ZSTD_USE_SHARED=ON [default=ON]
-- Rely on zstd shared libraries where relevant
-- ARROW_USE_GLOG=OFF [default=OFF]
-- Build libraries with glog support for pluggable logging
-- ARROW_WITH_BACKTRACE=ON [default=ON]
-- Build with backtrace support
-- ARROW_WITH_BROTLI=OFF [default=OFF]
-- Build with Brotli compression
-- ARROW_WITH_BZ2=OFF [default=OFF]
-- Build with BZ2 compression
-- ARROW_WITH_LZ4=OFF [default=OFF]
-- Build with lz4 compression
-- ARROW_WITH_SNAPPY=OFF [default=OFF]
-- Build with Snappy compression
-- ARROW_WITH_ZLIB=OFF [default=OFF]
-- Build with zlib compression
-- ARROW_WITH_ZSTD=OFF [default=OFF]
-- Build with zstd compression
-- ARROW_WITH_UTF8PROC=ON [default=ON]
-- Build with support for Unicode properties using the utf8proc library
-- (only used if ARROW_COMPUTE is ON)
-- ARROW_WITH_RE2=ON [default=ON]
-- Build with support for regular expressions using the re2 library
-- (only used if ARROW_COMPUTE or ARROW_GANDIVA is ON)
--
-- Parquet options:
--
-- PARQUET_MINIMAL_DEPENDENCY=OFF [default=OFF]
-- Depend only on Thirdparty headers to build libparquet.
-- Always OFF if building binaries
-- PARQUET_BUILD_EXECUTABLES=OFF [default=OFF]
-- Build the Parquet executable CLI tools. Requires static libraries to be built.
-- PARQUET_BUILD_EXAMPLES=OFF [default=OFF]
-- Build the Parquet examples. Requires static libraries to be built.
-- PARQUET_REQUIRE_ENCRYPTION=OFF [default=OFF]
-- Build support for encryption. Fail if OpenSSL is not found
--
-- Gandiva options:
--
-- ARROW_GANDIVA_JAVA=OFF [default=OFF]
-- Build the Gandiva JNI wrappers
-- ARROW_GANDIVA_STATIC_LIBSTDCPP=OFF [default=OFF]
-- Include -static-libstdc++ -static-libgcc when linking with
-- Gandiva static libraries
-- ARROW_GANDIVA_PC_CXX_FLAGS="" [default=""]
-- Compiler flags to append when pre-compiling Gandiva operations
--
-- Advanced developer options:
--
-- ARROW_EXTRA_ERROR_CONTEXT=OFF [default=OFF]
-- Compile with extra error context (line numbers, code)
-- ARROW_OPTIONAL_INSTALL=OFF [default=OFF]
-- If enabled install ONLY targets that have already been built. Please be
-- advised that if this is enabled 'install' will fail silently on components
-- that have not been built
-- Outputting build configuration summary to /tmp/RtmpCyabIa/file1b6aaa1848/cmake_summary.json
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/RtmpCyabIa/file1b6aaa1848
+ /QOpenSys/pkgs/bin/cmake --build . --target install
gmake: the '-j' option requires a positive integer argument
Scanning dependencies of target boost_ep
[ 1%] Creating directories for 'boost_ep'
[ 2%] Performing download step (download, verify and extract) for 'boost_ep'
-- boost_ep download command succeeded. See also /tmp/RtmpCyabIa/file1b6aaa1848/boost_ep-prefix/src/boost_ep-stamp/boost_ep-download-*.log
[ 3%] No patch step for 'boost_ep'
[ 4%] No update step for 'boost_ep'
[ 6%] No configure step for 'boost_ep'
[ 7%] No build step for 'boost_ep'
[ 8%] No install step for 'boost_ep'
[ 9%] Completed 'boost_ep'
[ 9%] Built target boost_ep
Scanning dependencies of target utf8proc_ep
[ 10%] Creating directories for 'utf8proc_ep'
[ 12%] Performing download step (download, verify and extract) for 'utf8proc_ep'
-- utf8proc_ep download command succeeded. See also /tmp/RtmpCyabIa/file1b6aaa1848/utf8proc_ep-prefix/src/utf8proc_ep-stamp/utf8proc_ep-download-*.log
[ 13%] No patch step for 'utf8proc_ep'
[ 14%] No update step for 'utf8proc_ep'
[ 15%] Performing configure step for 'utf8proc_ep'
-- utf8proc_ep configure command succeeded. See also /tmp/RtmpCyabIa/file1b6aaa1848/utf8proc_ep-prefix/src/utf8proc_ep-stamp/utf8proc_ep-configure-*.log
[ 17%] Performing build step for 'utf8proc_ep'
-- utf8proc_ep build command succeeded. See also /tmp/RtmpCyabIa/file1b6aaa1848/utf8proc_ep-prefix/src/utf8proc_ep-stamp/utf8proc_ep-build-*.log
[ 18%] Performing install step for 'utf8proc_ep'
-- utf8proc_ep install command succeeded. See also /tmp/RtmpCyabIa/file1b6aaa1848/utf8proc_ep-prefix/src/utf8proc_ep-stamp/utf8proc_ep-install-*.log
[ 19%] Completed 'utf8proc_ep'
[ 19%] Built target utf8proc_ep
Scanning dependencies of target thrift_ep
[ 20%] Creating directories for 'thrift_ep'
[ 21%] Performing download step (download, verify and extract) for 'thrift_ep'
-- thrift_ep download command succeeded. See also /tmp/RtmpCyabIa/file1b6aaa1848/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-download-*.log
[ 23%] No patch step for 'thrift_ep'
[ 24%] No update step for 'thrift_ep'
[ 25%] Performing configure step for 'thrift_ep'
-- thrift_ep configure command succeeded. See also /tmp/RtmpCyabIa/file1b6aaa1848/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-configure-*.log
[ 26%] Performing build step for 'thrift_ep'
CMake Error at /tmp/RtmpCyabIa/file1b6aaa1848/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-RELEASE.cmake:37 (message):
Command failed: 2 'make' See also /tmp/RtmpCyabIa/file1b6aaa1848/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-*.log
-- stdout output is:
Scanning dependencies of target thrift
[ 2%] Building CXX object lib/cpp/CMakeFiles/thrift.dir/src/thrift/TApplicationException.cpp.o-- stderr output is:
In file included from /tmp/RtmpCyabIa/file1b6aaa1848/boost_ep-prefix/src/boost_ep/boost/numeric/conversion/cast.hpp:32:0,
from /tmp/RtmpCyabIa/file1b6aaa1848/thrift_ep-prefix/src/thrift_ep/lib/cpp/src/thrift/transport/TTransportException.h:23,
from /tmp/RtmpCyabIa/file1b6aaa1848/thrift_ep-prefix/src/thrift_ep/lib/cpp/src/thrift/transport/TTransport.h:24,
from /tmp/RtmpCyabIa/file1b6aaa1848/thrift_ep-prefix/src/thrift_ep/lib/cpp/src/thrift/protocol/TProtocol.h:28,
from /tmp/RtmpCyabIa/file1b6aaa1848/thrift_ep-prefix/src/thrift_ep/lib/cpp/src/thrift/TApplicationException.cpp:21:
/tmp/RtmpCyabIa/file1b6aaa1848/boost_ep-prefix/src/boost_ep/boost/type.hpp:13:3: error: template with C linkage
template <class T>
^~~~~~~~
compilation terminated due to -fmax-errors=1.
make[5]: *** [lib/cpp/CMakeFiles/thrift.dir/build.make:63: lib/cpp/CMakeFiles/thrift.dir/src/thrift/TApplicationException.cpp.o] Error 1
make[4]: *** [CMakeFiles/Makefile2:96: lib/cpp/CMakeFiles/thrift.dir/all] Error 2
make[3]: *** [Makefile:152: all] Error 2CMake Error at /tmp/RtmpCyabIa/file1b6aaa1848/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-RELEASE.cmake:47 (message):
Stopping after outputting logs.
make[2]: *** [CMakeFiles/thrift_ep.dir/build.make:114: thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build] Error 1
make[1]: *** [CMakeFiles/Makefile2:676: CMakeFiles/thrift_ep.dir/all] Error 2
gmake: *** [Makefile:141: all] Error 2
**** Error building Arrow C++. Re-run with ARROW_R_DEV=true for debug information.
Neal Richardson / @nealrichardson: Looks like the error is coming from boost, i.e. not in arrow source. Unless there's some CFLAGS or whatever that we should be passing but aren't, your options seem to be:
1) Turn ARROW_PARQUET=OFF
(parquet requires thrift, which requires the boost headers at build time)
2) Report an issue to boost and hope they can fix it, and then you can install the fixed boost version and use that at Arrow build time.
Menno / @mennosiek: Unfortunately I need arrow specifically for parquet so option 1 wouldn't work.
Kouhei Sutou / @kou:
Could you try cmake .. -DARROW_JEMALLOC=OFF
and re-run make
with Apache Arrow C++ (not R)? It will be failed on the same location with R.
And could you provide ${BUILD_DIR}/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-*.log
?
Menno / @mennosiek: It does fail at the same location as you said, with the same message:
[ 7%] Performing build step for 'thrift_ep'
CMake Error at /pfmphp/phptestmsi/PFMRBI/arrow/cpp/release/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-RELEASE.cmake:37 (message):
Command failed: 2 'make' See also /pfmphp/phptestmsi/PFMRBI/arrow/cpp/release/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-*.log
-- stdout output is:
[ 2%] Building CXX object lib/cpp/CMakeFiles/thrift.dir/src/thrift/TApplicationException.cpp.o-- stderr output is:
In file included from /pfmphp/phptestmsi/PFMRBI/arrow/cpp/release/boost_ep-prefix/src/boost_ep/boost/numeric/conversion/cast.hpp:32:0,
from /pfmphp/phptestmsi/PFMRBI/arrow/cpp/release/thrift_ep-prefix/src/thrift_ep/lib/cpp/src/thrift/transport/TTransportException.h:23,
from /pfmphp/phptestmsi/PFMRBI/arrow/cpp/release/thrift_ep-prefix/src/thrift_ep/lib/cpp/src/thrift/transport/TTransport.h:24,
from /pfmphp/phptestmsi/PFMRBI/arrow/cpp/release/thrift_ep-prefix/src/thrift_ep/lib/cpp/src/thrift/protocol/TProtocol.h:28,
from /pfmphp/phptestmsi/PFMRBI/arrow/cpp/release/thrift_ep-prefix/src/thrift_ep/lib/cpp/src/thrift/TApplicationException.cpp:21:
/pfmphp/phptestmsi/PFMRBI/arrow/cpp/release/boost_ep-prefix/src/boost_ep/boost/type.hpp:13:3: error: template with C linkage
template <class T>
^~~~~~~~
compilation terminated due to -fmax-errors=1.
make[5]: *** [lib/cpp/CMakeFiles/thrift.dir/build.make:63: lib/cpp/CMakeFiles/thrift.dir/src/thrift/TApplicationException.cpp.o] Error 1
make[4]: *** [CMakeFiles/Makefile2:96: lib/cpp/CMakeFiles/thrift.dir/all] Error 2
make[3]: *** [Makefile:152: all] Error 2CMake Error at /pfmphp/phptestmsi/PFMRBI/arrow/cpp/release/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-RELEASE.cmake:47 (message):
Stopping after outputting logs.
make[2]: *** [CMakeFiles/thrift_ep.dir/build.make:114: thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build] Error 1
make[1]: *** [CMakeFiles/Makefile2:676: CMakeFiles/thrift_ep.dir/all] Error 2
make: *** [Makefile:141: all] Error 2
The log outputs the same message:
Menno / @mennosiek: The only thing I can find when I search online is that when compiler system headers are included many errors occure regarding the template with C linkage.
There is a possible problem with option -isystem on AIX.
In their case it was fixed avoiding the -isystem option by doing something like this:
if ((CMAKE_SYSTEM_NAME STREQUAL "AIX" OR CMAKE_SYSTEM_NAME STREQUAL "OS400") AND CMAKE_CXX_COMPILER_ID STREQUAL "GNU")
include_directories("includefile")
else()
include_directories(SYSTEM "includefile")
endif()
Is there any location in arrow's source code where this might apply?
Menno / @mennosiek: If I install with ARROW_PARQUET=OFF the bluid fails as well:
[ 15%] Built target toolchain
Scanning dependencies of target arrow_dependencies
[ 15%] Built target arrow_dependencies
Scanning dependencies of target arrow_objlib
[ 15%] Building CXX object src/arrow/CMakeFiles/arrow_objlib.dir/array/array_base.cc.o
In file included from /pfmphp/phptestmsi/PFMRBI/arrow/cpp/src/arrow/type.h:33:0,
from /pfmphp/phptestmsi/PFMRBI/arrow/cpp/src/arrow/array/array_base.h:31,
from /pfmphp/phptestmsi/PFMRBI/arrow/cpp/src/arrow/array/array_base.cc:18:
/pfmphp/phptestmsi/PFMRBI/arrow/cpp/src/arrow/util/endian.h:28:42: fatal error: endian.h: No such file or directory
#include <endian.h> // IWYU pragma: keep
^
compilation terminated.
make[2]: *** [src/arrow/CMakeFiles/arrow_objlib.dir/build.make:63: src/arrow/CMakeFiles/arrow_objlib.dir/array/array_base.cc.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:1195: src/arrow/CMakeFiles/arrow_objlib.dir/all] Error 2
make: *** [Makefile:141: all] Error 2
Is arrow supported for AIX?
Kouhei Sutou / @kou:
Thanks.
I wanted to see the command line that causes build error but thrift_ep-build-err.log
doesn't include it...
Is arrow supported for AIX?
We have never tried AIX.
It seems that endian.h
doesn't exist on AIX. We need a contributor to add support for AIX.
Neal Richardson / @nealrichardson: Speaking of endian.h, I'm reminded of work to get Arrow to compile on Solaris, so perhaps AIX would need similar conditional handling.
Antoine Pitrou / @pitrou: @kiszk Do you think this is a bug in Arrow? Otherwise, perhaps we should simply chose this issue.
Kazuaki Ishizaki / @kiszk:
According to [this issue|[https://github.com/protocolbuffers/protobuf/issues/8373],] AIX does not have {}endian.h{
}. Do we apply this change?
Kouhei Sutou / @kou: Thanks for the information. It seems that we need something like https://github.com/protocolbuffers/protobuf/pull/9065/files .
Kazuaki Ishizaki / @kiszk: I got an AIX instance for a few weeks. I will work to fix errors on AIX.
@kiszk is this still an issue?
Let me see when I will be back from my vacation.
When installing arrow on IBM i it fails the install at the thrift dependency install with the following output:
Environment: IBM i | AS400 | AIX Reporter: Menno / @mennosiek
Original Issue Attachments:
Note: This issue was originally created as ARROW-12885. Please see the migration documentation for further details.