Closed asfimport closed 2 years ago
asfimport
commented
3 years ago Neal Richardson / @nealrichardson: Looks like jemalloc is failing to build (configure, actually) for some reason. We could explore that if you want, and/or you can disable jemalloc by setting the environment variable ARROW_JEMALLOC=OFF prior to installing.
asfimport
commented
3 years ago Stephan Radel: Hi Neal,
thanks for your really really fast response. I tried already and came one steps further. In the attempt with ARROW_JEMALLOC=OFF it failed at this step:
...
[ 40%] Performing build step for 're2_ep'
CMake Error at /tmp/RtmpDvg58T/file77e46d62dd11/re2_ep-prefix/src/re2_ep-stamp/re2_ep-build-RELEASE.cmake:37 (message):
Command failed: 2 'make' See also /tmp/RtmpDvg58T/file77e46d62dd11/re2_ep-prefix/src/re2_ep-stamp/re2_ep-build-*.log
...
Then I tried to turn ARROW_WITH_RE2=OFF. This led to a failure at this step ...
...
[ 37%] Performing configure step for 'utf8proc_ep'
CMake Error at /tmp/RtmpdEhslY/file77ef6f144009/utf8proc_ep-prefix/src/utf8proc_ep-stamp/utf8proc_ep-configure-RELEASE.cmake:37 (message):
Command failed: 1 '/tmp/RtmpdEhslY/file77ef7a9abd9e/cmake-3.19.2-Linux-x86_64/bin/cmake' '-DCMAKE_C_COMPILER=/usr/bin/ccache' '-DCMAKE_CXX_COMPILER=/usr/bin/ccache' '-DCMAKE_AR=/usr/bin/ar' '-DCMAKE_RANLIB=/usr/bin/ranlib' '-DCMAKE_INSTALL_PREFIX=/tmp/RtmpdEhslY/file77ef6f144009/utf8proc_ep-install' '-DCMAKE_BUILD_TYPE=RELEASE' '-DCMAKE_INSTALL_LIBDIR=lib' '-DBUILD_SHARED_LIBS=OFF' '-GUnix Makefiles' '/tmp/RtmpdEhslY/file77ef6f144009/utf8proc_ep-prefix/src/utf8proc_ep' See also /tmp/RtmpdEhslY/file77ef6f144009/utf8proc_ep-prefix/src/utf8proc_ep-stamp/utf8proc_ep-configure-*.log
-- stdout output is:
-- The C compiler identification is unknown
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - failed
-- Check for working C compiler: /usr/bin/ccache
-- Check for working C compiler: /usr/bin/ccache - broken
-- Configuring incomplete, errors occurred!
See also "/tmp/RtmpdEhslY/file77ef6f144009/utf8proc_ep-prefix/src/utf8proc_ep-build/CMakeFiles/CMakeOutput.log".
See also "/tmp/RtmpdEhslY/file77ef6f144009/utf8proc_ep-prefix/src/utf8proc_ep-build/CMakeFiles/CMakeError.log".-- stderr output is:
CMake Error at /tmp/RtmpdEhslY/file77ef7a9abd9e/cmake-3.19.2-Linux-x86_64/share/cmake-3.19/Modules/CMakeTestCCompiler.cmake:66 (message):
The C compiler "/usr/bin/ccache" is not able to compile a simple test program. It fails with the following output: Change Dir: /tmp/RtmpdEhslY/file77ef6f144009/utf8proc_ep-prefix/src/utf8proc_ep-build/CMakeFiles/CMakeTmp
Run Build Command(s):/usr/bin/make cmTC_fe1d4/fast && make[4]: Entering directory '/tmp/RtmpdEhslY/file77ef6f144009/utf8proc_ep-prefix/src/utf8proc_ep-build/CMakeFiles/CMakeTmp'
make -f CMakeFiles/cmTC_fe1d4.dir/build.make CMakeFiles/cmTC_fe1d4.dir/build
make[5]: Entering directory '/tmp/RtmpdEhslY/file77ef6f144009/utf8proc_ep-prefix/src/utf8proc_ep-build/CMakeFiles/CMakeTmp'
Building C object CMakeFiles/cmTC_fe1d4.dir/testCCompiler.c.o
/usr/bin/ccache -o CMakeFiles/cmTC_fe1d4.dir/testCCompiler.c.o -c /tmp/RtmpdEhslY/file77ef6f144009/utf8proc_ep-prefix/src/utf8proc_ep-build/CMakeFiles/CMakeTmp/testCCompiler.c
ccache: error: missing equal sign in "CMakeFiles/cmTC_fe1d4.dir/testCCompiler.c.o"
make[5]: *** [CMakeFiles/cmTC_fe1d4.dir/build.make:85: CMakeFiles/cmTC_fe1d4.dir/testCCompiler.c.o] Error 1
make[5]: Leaving directory '/tmp/RtmpdEhslY/file77ef6f144009/utf8proc_ep-prefix/src/utf8proc_ep-build/CMakeFiles/CMakeTmp'
make[4]: *** [Makefile:140: cmTC_fe1d4/fast] Error 2
make[4]: Leaving directory '/tmp/RtmpdEhslY/file77ef6f144009/utf8proc_ep-prefix/src/utf8proc_ep-build/CMakeFiles/CMakeTmp'
CMake will not be able to correctly generate this project.
...Does it make sense to try further and disable ARROW_WITH_UTF8PROC also?
Thanks and Br
Stephan
asfimport
commented
3 years ago Neal Richardson / @nealrichardson:
You could, but clearly something's not right so we should dig in. Can you export EXTRA_CMAKE_FLAGS="-DARROW_VERBOSE_THIRDPARTY_BUILD=ON" and retry? That should tell us what the actual errors are in better detail.
asfimport
commented
3 years ago Stephan Radel: Hi Neal, just tried with the following result:
* installing *source* package ‘arrow’ ...
** package ‘arrow’ successfully unpacked and MD5 sums checked
trying URL 'https://arrow-r-nightly.s3.amazonaws.com/libarrow/src/arrow-4.0.0.zip'
Error in download.file(from_url, to_file, quiet = quietly) :
cannot open URL 'https://arrow-r-nightly.s3.amazonaws.com/libarrow/src/arrow-4.0.0.zip'
trying URL 'https://www.apache.org/dyn/closer.lua?action=download&filename=arrow/arrow-4.0.0/apache-arrow-4.0.0.tar.gz'
Content type 'application/octet-stream' length 9042294 bytes (8.6 MB)
==================================================
downloaded 8.6 MB*** Successfully retrieved C++ source
*** Building C++ libraries
*** Building with MAKEFLAGS= -j2
**** cmake
trying URL 'https://github.com/Kitware/CMake/releases/download/v3.19.2/cmake-3.19.2-Linux-x86_64.tar.gz'
Content type 'application/octet-stream' length 42931014 bytes (40.9 MB)
==================================================
downloaded 40.9 MB**** arrow with SOURCE_DIR="/tmp/RtmpAceTDo/file76b8509c8069/apache-arrow-4.0.0/cpp" BUILD_DIR="/tmp/RtmpAceTDo/file76b84aa8ed93" DEST_DIR="libarrow/arrow-4.0.0" CMAKE="/tmp/RtmpAceTDo/file76b87b320dd6/cmake-3.19.2-Linux-x86_64/bin/cmake" CC="ccache gcc" CXX="ccache g++ -std=gnu++11" LDFLAGS="-Wl,-z,relro" ARROW_S3=OFF ARROW_MIMALLOC=OFF
++ pwd
+ : /tmp/RtmpB1VF1I/R.INSTALL768141288ba1/arrow
+ : /tmp/RtmpAceTDo/file76b8509c8069/apache-arrow-4.0.0/cpp
+ : /tmp/RtmpAceTDo/file76b84aa8ed93
+ : libarrow/arrow-4.0.0
+ : /tmp/RtmpAceTDo/file76b87b320dd6/cmake-3.19.2-Linux-x86_64/bin/cmake
++ cd /tmp/RtmpAceTDo/file76b8509c8069/apache-arrow-4.0.0/cpp
++ pwd
+ SOURCE_DIR=/tmp/RtmpAceTDo/file76b8509c8069/apache-arrow-4.0.0/cpp
++ mkdir -p libarrow/arrow-4.0.0
++ cd libarrow/arrow-4.0.0
++ pwd
+ DEST_DIR=/tmp/RtmpB1VF1I/R.INSTALL768141288ba1/arrow/libarrow/arrow-4.0.0
+ '[' '' = false ']'
+ ARROW_DEFAULT_PARAM=OFF
+ mkdir -p /tmp/RtmpAceTDo/file76b84aa8ed93
+ pushd /tmp/RtmpAceTDo/file76b84aa8ed93
/tmp/RtmpAceTDo/file76b84aa8ed93 /tmp/RtmpB1VF1I/R.INSTALL768141288ba1/arrow
+ /tmp/RtmpAceTDo/file76b87b320dd6/cmake-3.19.2-Linux-x86_64/bin/cmake -DARROW_BOOST_USE_SHARED=OFF -DARROW_BUILD_TESTS=OFF -DARROW_BUILD_SHARED=OFF -DARROW_BUILD_STATIC=ON -DARROW_COMPUTE=ON -DARROW_CSV=ON -DARROW_DATASET=ON -DARROW_DEPENDENCY_SOURCE=BUNDLED -DARROW_FILESYSTEM=ON -DARROW_JEMALLOC=ON -DARROW_MIMALLOC=OFF -DARROW_JSON=ON -DARROW_PARQUET=ON -DARROW_S3=OFF -DARROW_WITH_BROTLI=OFF -DARROW_WITH_BZ2=OFF -DARROW_WITH_LZ4=OFF -DARROW_WITH_RE2=ON -DARROW_WITH_SNAPPY=OFF -DARROW_WITH_UTF8PROC=ON -DARROW_WITH_ZLIB=OFF -DARROW_WITH_ZSTD=OFF -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_LIBDIR=lib -DCMAKE_INSTALL_PREFIX=/tmp/RtmpB1VF1I/R.INSTALL768141288ba1/arrow/libarrow/arrow-4.0.0 -DCMAKE_EXPORT_NO_PACKAGE_REGISTRY=ON -DCMAKE_FIND_PACKAGE_NO_PACKAGE_REGISTRY=ON -DCMAKE_UNITY_BUILD=ON -DARROW_VERBOSE_THIRDPARTY_BUILD=ON -G 'Unix Makefiles' /tmp/RtmpAceTDo/file76b8509c8069/apache-arrow-4.0.0/cpp
-- Building using CMake version: 3.19.2
-- The C compiler identification is GNU 8.3.0
-- The CXX compiler identification is GNU 8.3.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/bin/ccache - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/ccache - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Arrow version: 4.0.0 (full: '4.0.0')
-- Arrow SO version: 400 (full: 400.0.0)
-- clang-tidy not found
-- clang-format not found
-- Could NOT find ClangTools (missing: CLANG_FORMAT_BIN CLANG_TIDY_BIN)
-- infer not found
fatal: not a git repository (or any of the parent directories): .git
-- Found Python3: /usr/bin/python3.7 (found version "3.7.3") found components: Interpreter
-- Using ccache: /usr/bin/ccache
-- Found cpplint executable at /tmp/RtmpAceTDo/file76b8509c8069/apache-arrow-4.0.0/cpp/build-support/cpplint.py
-- System processor: x86_64
-- Performing Test CXX_SUPPORTS_SSE4_2
-- Performing Test CXX_SUPPORTS_SSE4_2 - Success
-- Performing Test CXX_SUPPORTS_AVX2
-- Performing Test CXX_SUPPORTS_AVX2 - Success
-- Performing Test CXX_SUPPORTS_AVX512
-- Performing Test CXX_SUPPORTS_AVX512 - Success
-- Arrow build warning level: PRODUCTION
Using ld linker
Configured for RELEASE build (set with cmake -DCMAKE_BUILD_TYPE={release,debug,...})
-- Build Type: RELEASE
-- Using BUNDLED approach to find dependencies
-- ARROW_ABSL_BUILD_VERSION: 0f3bb466b868b523cf1dc9b2aaaed65c77b28862
-- ARROW_AWSSDK_BUILD_VERSION: 1.8.133
-- ARROW_AWS_CHECKSUMS_BUILD_VERSION: v0.1.10
-- ARROW_AWS_C_COMMON_BUILD_VERSION: v0.4.59
-- ARROW_AWS_C_EVENT_STREAM_BUILD_VERSION: v0.1.5
-- ARROW_BOOST_BUILD_VERSION: 1.75.0
-- ARROW_BROTLI_BUILD_VERSION: v1.0.9
-- ARROW_BZIP2_BUILD_VERSION: 1.0.8
-- ARROW_CARES_BUILD_VERSION: 1.17.1
-- ARROW_GBENCHMARK_BUILD_VERSION: v1.5.2
-- ARROW_GFLAGS_BUILD_VERSION: v2.2.2
-- ARROW_GLOG_BUILD_VERSION: v0.4.0
-- ARROW_GRPC_BUILD_VERSION: v1.35.0
-- ARROW_GTEST_BUILD_VERSION: 1.10.0
-- ARROW_JEMALLOC_BUILD_VERSION: 5.2.1
-- ARROW_LZ4_BUILD_VERSION: v1.9.3
-- ARROW_MIMALLOC_BUILD_VERSION: v1.6.4
-- ARROW_ORC_BUILD_VERSION: 1.6.6
-- ARROW_PROTOBUF_BUILD_VERSION: v3.14.0
-- ARROW_RAPIDJSON_BUILD_VERSION: 1a803826f1197b5e30703afe4b9c0e7dd48074f5
-- ARROW_RE2_BUILD_VERSION: 2021-02-02
-- ARROW_SNAPPY_BUILD_VERSION: 1.1.8
-- ARROW_THRIFT_BUILD_VERSION: 0.13.0
-- ARROW_THRIFT_BUILD_MD5_CHECKSUM: 38a27d391a2b03214b444cb13d5664f1
-- ARROW_UTF8PROC_BUILD_VERSION: v2.6.1
-- ARROW_XSIMD_BUILD_VERSION: e9234cd6e6f4428fc260073b2c34ffe86fda1f34
-- ARROW_ZLIB_BUILD_VERSION: 1.2.11
-- ARROW_ZSTD_BUILD_VERSION: v1.4.8
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Check if compiler accepts -pthread
-- Check if compiler accepts -pthread - yes
-- Found Threads: TRUE
-- Looking for __SIZEOF_INT128__
-- Looking for __SIZEOF_INT128__ - found
-- Boost include dir: /tmp/RtmpAceTDo/file76b84aa8ed93/boost_ep-prefix/src/boost_ep
-- Boost libraries: boost_system_static;boost_filesystem_static
-- Building without OpenSSL support. Minimum OpenSSL version 1.0.2 required.
Building Apache Thrift from source
-- Building (vendored) jemalloc from source
-- Building RapidJSON from source
-- Building xsimd from source
-- Building RE2 from source
-- Building utf8proc from source
-- Found hdfs.h at: /usr/share/hadoop/include/hdfs.h
-- All bundled static libraries: thrift::thrift;jemalloc::jemalloc;re2::re2;utf8proc::utf8proc
-- CMAKE_C_FLAGS: -O3 -DNDEBUG -Wall -fno-semantic-interposition -msse4.2
-- CMAKE_CXX_FLAGS: -Wno-noexcept-type -Wno-subobject-linkage -fdiagnostics-color=always -O3 -DNDEBUG -Wall -fno-semantic-interposition -msse4.2
-- Looking for backtrace
-- Looking for backtrace - found
-- backtrace facility detected in default set of libraries
-- Found Backtrace: /usr/include
-- Creating bundled static library target arrow_bundled_dependencies at /tmp/RtmpAceTDo/file76b84aa8ed93/release/libarrow_bundled_dependencies.a
-- ---------------------------------------------------------------------
-- Arrow version: 4.0.0
--
-- Build configuration summary:
-- Generator: Unix Makefiles
-- Build type: RELEASE
-- Source directory: /tmp/RtmpAceTDo/file76b8509c8069/apache-arrow-4.0.0/cpp
-- Install prefix: /tmp/RtmpB1VF1I/R.INSTALL768141288ba1/arrow/libarrow/arrow-4.0.0
--
-- Compile and link options:
--
-- ARROW_CXXFLAGS="" [default=""]
-- Compiler flags to append when compiling Arrow
-- ARROW_BUILD_STATIC=ON [default=ON]
-- Build static libraries
-- ARROW_BUILD_SHARED=OFF [default=ON]
-- Build shared libraries
-- ARROW_PACKAGE_KIND="" [default=""]
-- Arbitrary string that identifies the kind of package
-- (for informational purposes)
-- ARROW_GIT_ID="" [default=""]
-- The Arrow git commit id (if any)
-- ARROW_GIT_DESCRIPTION="" [default=""]
-- The Arrow git commit description (if any)
-- ARROW_NO_DEPRECATED_API=OFF [default=OFF]
-- Exclude deprecated APIs from build
-- ARROW_USE_CCACHE=ON [default=ON]
-- Use ccache when compiling (if available)
-- ARROW_USE_LD_GOLD=OFF [default=OFF]
-- Use ld.gold for linking on Linux (if available)
-- ARROW_USE_PRECOMPILED_HEADERS=OFF [default=OFF]
-- Use precompiled headers when compiling
-- ARROW_SIMD_LEVEL=SSE4_2 [default=NONE|SSE4_2|AVX2|AVX512]
-- Compile-time SIMD optimization level
-- ARROW_RUNTIME_SIMD_LEVEL=MAX [default=NONE|SSE4_2|AVX2|AVX512|MAX]
-- Max runtime SIMD optimization level
-- ARROW_ARMV8_ARCH=armv8-a [default=armv8-a|armv8-a+crc+crypto]
-- Arm64 arch and extensions
-- ARROW_ALTIVEC=ON [default=ON]
-- Build with Altivec if compiler has support
-- ARROW_RPATH_ORIGIN=OFF [default=OFF]
-- Build Arrow libraries with RATH set to $ORIGIN
-- ARROW_INSTALL_NAME_RPATH=ON [default=ON]
-- Build Arrow libraries with install_name set to @rpath
-- ARROW_GGDB_DEBUG=ON [default=ON]
-- Pass -ggdb flag to debug builds
--
-- Test and benchmark options:
--
-- ARROW_BUILD_EXAMPLES=OFF [default=OFF]
-- Build the Arrow examples
-- ARROW_BUILD_TESTS=OFF [default=OFF]
-- Build the Arrow googletest unit tests
-- ARROW_ENABLE_TIMING_TESTS=ON [default=ON]
-- Enable timing-sensitive tests
-- ARROW_BUILD_INTEGRATION=OFF [default=OFF]
-- Build the Arrow integration test executables
-- ARROW_BUILD_BENCHMARKS=OFF [default=OFF]
-- Build the Arrow micro benchmarks
-- ARROW_BUILD_BENCHMARKS_REFERENCE=OFF [default=OFF]
-- Build the Arrow micro reference benchmarks
-- ARROW_TEST_LINKAGE=static [default=shared|static]
-- Linkage of Arrow libraries with unit tests executables.
-- ARROW_FUZZING=OFF [default=OFF]
-- Build Arrow Fuzzing executables
-- ARROW_LARGE_MEMORY_TESTS=OFF [default=OFF]
-- Enable unit tests which use large memory
--
-- Lint options:
--
-- ARROW_ONLY_LINT=OFF [default=OFF]
-- Only define the lint and check-format targets
-- ARROW_VERBOSE_LINT=OFF [default=OFF]
-- If off, 'quiet' flags will be passed to linting tools
-- ARROW_GENERATE_COVERAGE=OFF [default=OFF]
-- Build with C++ code coverage enabled
--
-- Checks options:
--
-- ARROW_TEST_MEMCHECK=OFF [default=OFF]
-- Run the test suite using valgrind --tool=memcheck
-- ARROW_USE_ASAN=OFF [default=OFF]
-- Enable Address Sanitizer checks
-- ARROW_USE_TSAN=OFF [default=OFF]
-- Enable Thread Sanitizer checks
-- ARROW_USE_UBSAN=OFF [default=OFF]
-- Enable Undefined Behavior sanitizer checks
--
-- Project component options:
--
-- ARROW_BUILD_UTILITIES=OFF [default=OFF]
-- Build Arrow commandline utilities
-- ARROW_COMPUTE=ON [default=OFF]
-- Build the Arrow Compute Modules
-- ARROW_CSV=ON [default=OFF]
-- Build the Arrow CSV Parser Module
-- ARROW_CUDA=OFF [default=OFF]
-- Build the Arrow CUDA extensions (requires CUDA toolkit)
-- ARROW_DATASET=ON [default=OFF]
-- Build the Arrow Dataset Modules
-- ARROW_FILESYSTEM=ON [default=OFF]
-- Build the Arrow Filesystem Layer
-- ARROW_FLIGHT=OFF [default=OFF]
-- Build the Arrow Flight RPC System (requires GRPC, Protocol Buffers)
-- ARROW_GANDIVA=OFF [default=OFF]
-- Build the Gandiva libraries
-- ARROW_HDFS=OFF [default=OFF]
-- Build the Arrow HDFS bridge
-- ARROW_HIVESERVER2=OFF [default=OFF]
-- Build the HiveServer2 client and Arrow adapter
-- ARROW_IPC=ON [default=ON]
-- Build the Arrow IPC extensions
-- ARROW_JEMALLOC=ON [default=ON]
-- Build the Arrow jemalloc-based allocator
-- ARROW_JNI=OFF [default=OFF]
-- Build the Arrow JNI lib
-- ARROW_JSON=ON [default=OFF]
-- Build Arrow with JSON support (requires RapidJSON)
-- ARROW_MIMALLOC=OFF [default=OFF]
-- Build the Arrow mimalloc-based allocator
-- ARROW_PARQUET=ON [default=OFF]
-- Build the Parquet libraries
-- ARROW_ORC=OFF [default=OFF]
-- Build the Arrow ORC adapter
-- ARROW_PLASMA=OFF [default=OFF]
-- Build the plasma object store along with Arrow
-- ARROW_PLASMA_JAVA_CLIENT=OFF [default=OFF]
-- Build the plasma object store java client
-- ARROW_PYTHON=OFF [default=OFF]
-- Build the Arrow CPython extensions
-- ARROW_S3=OFF [default=OFF]
-- Build Arrow with S3 support (requires the AWS SDK for C++)
-- ARROW_TENSORFLOW=OFF [default=OFF]
-- Build Arrow with TensorFlow support enabled
-- ARROW_TESTING=OFF [default=OFF]
-- Build the Arrow testing libraries
--
-- Thirdparty toolchain options:
--
-- ARROW_DEPENDENCY_SOURCE=BUNDLED [default=AUTO|BUNDLED|SYSTEM|CONDA|VCPKG|BREW]
-- Method to use for acquiring arrow's build dependencies
-- ARROW_VERBOSE_THIRDPARTY_BUILD=ON [default=OFF]
-- Show output from ExternalProjects rather than just logging to files
-- ARROW_DEPENDENCY_USE_SHARED=ON [default=ON]
-- Link to shared libraries
-- ARROW_BOOST_USE_SHARED=OFF [default=ON]
-- Rely on boost shared libraries where relevant
-- ARROW_BROTLI_USE_SHARED=ON [default=ON]
-- Rely on Brotli shared libraries where relevant
-- ARROW_BZ2_USE_SHARED=ON [default=ON]
-- Rely on Bz2 shared libraries where relevant
-- ARROW_GFLAGS_USE_SHARED=ON [default=ON]
-- Rely on GFlags shared libraries where relevant
-- ARROW_GRPC_USE_SHARED=ON [default=ON]
-- Rely on gRPC shared libraries where relevant
-- ARROW_LZ4_USE_SHARED=ON [default=ON]
-- Rely on lz4 shared libraries where relevant
-- ARROW_OPENSSL_USE_SHARED=ON [default=ON]
-- Rely on OpenSSL shared libraries where relevant
-- ARROW_PROTOBUF_USE_SHARED=ON [default=ON]
-- Rely on Protocol Buffers shared libraries where relevant
-- ARROW_THRIFT_USE_SHARED=ON [default=ON]
-- Rely on thrift shared libraries where relevant
-- ARROW_UTF8PROC_USE_SHARED=ON [default=ON]
-- Rely on utf8proc shared libraries where relevant
-- ARROW_SNAPPY_USE_SHARED=ON [default=ON]
-- Rely on snappy shared libraries where relevant
-- ARROW_UTF8PROC_USE_SHARED=ON [default=ON]
-- Rely on utf8proc shared libraries where relevant
-- ARROW_ZSTD_USE_SHARED=ON [default=ON]
-- Rely on zstd shared libraries where relevant
-- ARROW_USE_GLOG=OFF [default=OFF]
-- Build libraries with glog support for pluggable logging
-- ARROW_WITH_BACKTRACE=ON [default=ON]
-- Build with backtrace support
-- ARROW_WITH_BROTLI=OFF [default=OFF]
-- Build with Brotli compression
-- ARROW_WITH_BZ2=OFF [default=OFF]
-- Build with BZ2 compression
-- ARROW_WITH_LZ4=OFF [default=OFF]
-- Build with lz4 compression
-- ARROW_WITH_SNAPPY=OFF [default=OFF]
-- Build with Snappy compression
-- ARROW_WITH_ZLIB=OFF [default=OFF]
-- Build with zlib compression
-- ARROW_WITH_ZSTD=OFF [default=OFF]
-- Build with zstd compression
-- ARROW_WITH_UTF8PROC=ON [default=ON]
-- Build with support for Unicode properties using the utf8proc library
-- (only used if ARROW_COMPUTE is ON)
-- ARROW_WITH_RE2=ON [default=ON]
-- Build with support for regular expressions using the re2 library
-- (only used if ARROW_COMPUTE or ARROW_GANDIVA is ON)
--
-- Parquet options:
--
-- PARQUET_MINIMAL_DEPENDENCY=OFF [default=OFF]
-- Depend only on Thirdparty headers to build libparquet.
-- Always OFF if building binaries
-- PARQUET_BUILD_EXECUTABLES=OFF [default=OFF]
-- Build the Parquet executable CLI tools. Requires static libraries to be built.
-- PARQUET_BUILD_EXAMPLES=OFF [default=OFF]
-- Build the Parquet examples. Requires static libraries to be built.
-- PARQUET_REQUIRE_ENCRYPTION=OFF [default=OFF]
-- Build support for encryption. Fail if OpenSSL is not found
--
-- Gandiva options:
--
-- ARROW_GANDIVA_JAVA=OFF [default=OFF]
-- Build the Gandiva JNI wrappers
-- ARROW_GANDIVA_STATIC_LIBSTDCPP=OFF [default=OFF]
-- Include -static-libstdc++ -static-libgcc when linking with
-- Gandiva static libraries
-- ARROW_GANDIVA_PC_CXX_FLAGS="" [default=""]
-- Compiler flags to append when pre-compiling Gandiva operations
--
-- Advanced developer options:
--
-- ARROW_EXTRA_ERROR_CONTEXT=OFF [default=OFF]
-- Compile with extra error context (line numbers, code)
-- ARROW_OPTIONAL_INSTALL=OFF [default=OFF]
-- If enabled install ONLY targets that have already been built. Please be
-- advised that if this is enabled 'install' will fail silently on components
-- that have not been built
-- Outputting build configuration summary to /tmp/RtmpAceTDo/file76b84aa8ed93/cmake_summary.json
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/RtmpAceTDo/file76b84aa8ed93
+ /tmp/RtmpAceTDo/file76b87b320dd6/cmake-3.19.2-Linux-x86_64/bin/cmake --build . --target install
make[1]: Entering directory '/tmp/RtmpAceTDo/file76b84aa8ed93'
make[2]: Entering directory '/tmp/RtmpAceTDo/file76b84aa8ed93'
make[3]: Entering directory '/tmp/RtmpAceTDo/file76b84aa8ed93'
make[3]: Entering directory '/tmp/RtmpAceTDo/file76b84aa8ed93'
Scanning dependencies of target boost_ep
make[3]: Leaving directory '/tmp/RtmpAceTDo/file76b84aa8ed93'
Scanning dependencies of target jemalloc_ep
make[3]: Leaving directory '/tmp/RtmpAceTDo/file76b84aa8ed93'
make[3]: Entering directory '/tmp/RtmpAceTDo/file76b84aa8ed93'
make[3]: Entering directory '/tmp/RtmpAceTDo/file76b84aa8ed93'
[ 1%] Creating directories for 'jemalloc_ep'
[ 2%] Creating directories for 'boost_ep'
[ 3%] Performing download step (download, verify and extract) for 'boost_ep'
[ 4%] Performing download step (download, verify and extract) for 'jemalloc_ep'
-- Downloading...
dst='/tmp/RtmpAceTDo/file76b84aa8ed93/boost_ep-prefix/src/boost_1_75_0.tar.gz'
timeout='none'
inactivity timeout='none'
-- Using src='https://github.com/ursa-labs/thirdparty/releases/download/latest/boost_1_75_0.tar.gz'
-- Downloading...
dst='/tmp/RtmpAceTDo/file76b84aa8ed93/jemalloc_ep-prefix/src/jemalloc-5.2.1.tar.bz2'
timeout='none'
inactivity timeout='none'
-- Using src='https://github.com/jemalloc/jemalloc/releases/download/5.2.1/jemalloc-5.2.1.tar.bz2'
-- [download 100% complete]
-- [download 0% complete]
-- [download 1% complete]
-- [download 2% complete]
-- [download 3% complete]
-- [download 4% complete]
-- [download 5% complete]
-- [download 6% complete]
-- [download 7% complete]
-- [download 100% complete]
-- [download 8% complete]
-- [download 9% complete]
-- [download 10% complete]
-- [download 11% complete]
-- [download 12% complete]
-- [download 13% complete]
-- [download 14% complete]
-- [download 0% complete]
-- [download 15% complete]
-- [download 16% complete]
-- [download 17% complete]
-- [download 2% complete]
-- [download 3% complete]
-- [download 18% complete]
-- [download 8% complete]
-- [download 17% complete]
-- [download 18% complete]
-- [download 25% complete]
-- [download 19% complete]
-- [download 26% complete]
-- [download 35% complete]
-- [download 37% complete]
-- [download 20% complete]
-- [download 44% complete]
-- [download 49% complete]
-- [download 52% complete]
-- [download 55% complete]
-- [download 58% complete]
-- [download 21% complete]
-- [download 64% complete]
-- [download 67% complete]
-- [download 73% complete]
-- [download 76% complete]
-- [download 22% complete]
-- [download 82% complete]
-- [download 86% complete]
-- [download 92% complete]
-- [download 95% complete]
-- [download 23% complete]
-- [download 100% complete]
-- Downloading... done
-- [download 24% complete]
-- [download 25% complete]
-- [download 26% complete]
-- extracting...
src='/tmp/RtmpAceTDo/file76b84aa8ed93/jemalloc_ep-prefix/src/jemalloc-5.2.1.tar.bz2'
dst='/tmp/RtmpAceTDo/file76b84aa8ed93/jemalloc_ep-prefix/src/jemalloc_ep'
-- extracting... [tar xfz]
-- [download 27% complete]
-- [download 28% complete]
-- [download 29% complete]
-- [download 30% complete]
-- [download 31% complete]
-- [download 32% complete]
-- [download 33% complete]
-- [download 34% complete]
-- [download 35% complete]
-- [download 36% complete]
-- [download 37% complete]
-- [download 38% complete]
-- [download 39% complete]
-- [download 40% complete]
-- [download 41% complete]
-- extracting... [analysis]
-- extracting... [rename]
-- extracting... [clean up]
-- extracting... done
-- [download 42% complete]
[ 5%] No update step for 'jemalloc_ep'
-- [download 43% complete]
[ 6%] Performing patch step for 'jemalloc_ep'
-- [download 44% complete]
-- [download 46% complete]
[ 7%] Performing configure step for 'jemalloc_ep'
-- [download 47% complete]
-- [download 48% complete]
-- [download 49% complete]
-- [download 50% complete]
-- [download 51% complete]
-- [download 52% complete]
-- [download 53% complete]
-- [download 54% complete]
-- [download 55% complete]
-- [download 56% complete]
-- [download 57% complete]
-- [download 58% complete]
-- [download 59% complete]
-- [download 60% complete]
-- [download 61% complete]
-- [download 62% complete]
-- [download 63% complete]
-- [download 64% complete]
-- [download 65% complete]
-- [download 66% complete]
-- [download 67% complete]
-- [download 68% complete]
-- [download 69% complete]
-- [download 70% complete]
-- [download 71% complete]
-- [download 72% complete]
-- [download 73% complete]
-- [download 74% complete]
-- [download 75% complete]
-- [download 76% complete]
-- [download 77% complete]
-- [download 78% complete]
-- [download 79% complete]
-- [download 80% complete]
-- [download 81% complete]
-- [download 82% complete]
-- [download 83% complete]
-- [download 84% complete]
-- [download 85% complete]
-- [download 86% complete]
-- [download 87% complete]
-- [download 88% complete]
-- [download 89% complete]
checking for xsltproc... /usr/bin/xsltproc
checking for gcc... /usr/bin/ccache
checking whether the C compiler works... no
-- [download 90% complete]
-- [download 91% complete]
-- [download 92% complete]
-- [download 93% complete]
-- [download 94% complete]
-- [download 95% complete]
-- [download 96% complete]
-- [download 97% complete]
-- [download 98% complete]
-- [download 99% complete]
-- [download 100% complete]
-- Downloading... done
configure: error: in `/tmp/RtmpAceTDo/file76b84aa8ed93/jemalloc_ep-prefix/src/jemalloc_ep':
configure: error: C compiler cannot create executables
See `config.log' for more details
-- extracting...
src='/tmp/RtmpAceTDo/file76b84aa8ed93/boost_ep-prefix/src/boost_1_75_0.tar.gz'
dst='/tmp/RtmpAceTDo/file76b84aa8ed93/boost_ep-prefix/src/boost_ep'
-- extracting... [tar xfz]
make[3]: *** [CMakeFiles/jemalloc_ep.dir/build.make:128: jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure] Error 77
make[3]: Leaving directory '/tmp/RtmpAceTDo/file76b84aa8ed93'
make[2]: *** [CMakeFiles/Makefile2:648: CMakeFiles/jemalloc_ep.dir/all] Error 2
make[2]: *** Waiting for unfinished jobs....
-- extracting... [analysis]
-- extracting... [rename]
-- extracting... [clean up]
-- extracting... done
[ 8%] No update step for 'boost_ep'
[ 9%] No patch step for 'boost_ep'
[ 10%] No configure step for 'boost_ep'
[ 11%] No build step for 'boost_ep'
[ 12%] No install step for 'boost_ep'
[ 13%] Completed 'boost_ep'
make[3]: Leaving directory '/tmp/RtmpAceTDo/file76b84aa8ed93'
[ 13%] Built target boost_ep
make[2]: Leaving directory '/tmp/RtmpAceTDo/file76b84aa8ed93'
make[1]: *** [Makefile:160: all] Error 2
make[1]: Leaving directory '/tmp/RtmpAceTDo/file76b84aa8ed93'
**** Error building Arrow C++. Re-run with ARROW_R_DEV=true for debug information.Stephan Radel: Hi Neal,
just found the cause ... there were some optimizations applied according this blogpost: http://dirk.eddelbuettel.com/blog/2017/11/27/. Obviously the described ccache-method prevented R+arrow from compiling properly. When I turned off this optimization, everything works as expected.
Sorry for bothering you with that topic and thanks a lot for your support!
Br
Stephan
asfimport
commented
3 years ago Neal Richardson / @nealrichardson: Thanks, glad you've worked through the issue. I don't quite understand why the build is failing with ccache, so I've reopened this so we can investigate more.
asfimport
commented
3 years ago Antoine Pitrou / @pitrou: @nealrichardson Do you still plan to investigate?
asfimport
commented
3 years ago Neal Richardson / @nealrichardson: It's probably worth someone investigating
asfimport
commented
3 years ago Stephan Radel: Hi Antoine, hi Neal, I'm afraid I don't have time to investigate this further. I understand that we have not yet found the root cause. But removing the optimisation has solved my acute problem. Thanks for your support!!
asfimport
commented
2 years ago Jonathan Keane / @jonkeane: We resolved an issue that looks very similar in ARROW-14638 and I suspect this will be resolved by that as well. I'm going to close this for now, but if you do still run into this issue after our next release (8.0.0, which should be done shortly) either re-open this, or please create a new Jira so we can dig into it. Thanks!
Dear Apache Team,
I'm not able to install Arrow 4.0.0 properly on Debian 10 via Docker. I tried several switches from recommendation here: https://arrow.apache.org/docs/r/articles/install.html (ARROW_USE_PKG_CONFIG TRUE/FALSE, LIBARROW_BINARY TRUE/FALSE) but with no success so far.
Here the latest log:
Thanks and Br
Stephan
Environment: debian:buster-slim, pkg-config installed Reporter: Stephan Radel
Related issues:
Note: This issue was originally created as ARROW-12654. Please see the migration documentation for further details.