Closed asfimport closed 2 years ago
asfimport
commented
3 years ago Jonathan Keane / @jonkeane: Hello, thank you for submitting a ticket.
Would you mind telling us what operating system you're using? It would also be helpful to send us the output when you run R CMD INSTALL arrow_3.0.0.tar.gz? It would also be helpful to set the environment variable ARROW_R_DEV=TRUE which will enable a bit more verbose output there.
asfimport
commented
3 years ago Karthikeyan Janakiraman: Hey, Please find the below requested output. Please feel free to let me know for any other details. Thanks much.
[root@c1cce557dba3 tmp]# cat /etc/*elease
CentOS Linux release 7.9.2009 (Core)
NAME="CentOS Linux" VERSION="7
(Core)" ID="centos" ID_LIKE="rhel fedora" VERSION_ID="7" PRETTY_NAME="CentOS Linux 7 (Core)" ANSI_COLOR="0;31" CPE_NAME="cpe:/o:centos:centos:7" HOME_URL="https://www.centos.org/" BUG_REPORT_URL="https://bugs.centos.org/"CENTOS_MANTISBT_PROJECT="CentOS-7" CENTOS_MANTISBT_PROJECT_VERSION="7" REDHAT_SUPPORT_PRODUCT="centos" REDHAT_SUPPORT_PRODUCT_VERSION="7"CentOS Linux release 7.9.2009 (Core) CentOS Linux release 7.9.2009 (Core) [root@c1cce557dba3 tmp]#
[root@c1cce557dba3 tmp]# export ARROW_R_DEV=TRUE
[root@c1cce557dba3 tmp]# R CMD INSTALL arrow_3.0.0.tar.gz
* installing to library ‘/usr/lib64/R/library’
* installing *source* package ‘arrow’ ...
** package ‘arrow’ successfully unpacked and MD5 sums checked
** using staged installation
*** Arrow C++ libraries found via pkg-config
PKG_CFLAGS= -DARROW_R_WITH_ARROW
PKG_LIBS=-larrow_dataset -lparquet -larrow
** libs
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c array.cpp -o array.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c array_from_vector.cpp -o array_from_vector.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c array_to_vector.cpp -o array_to_vector.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c arraydata.cpp -o arraydata.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c arrowExports.cpp -o arrowExports.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c buffer.cpp -o buffer.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c chunkedarray.cpp -o chunkedarray.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c compression.cpp -o compression.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c compute.cpp -o compute.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c csv.cpp -o csv.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c dataset.cpp -o dataset.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c datatype.cpp -o datatype.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c expression.cpp -o expression.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c feather.cpp -o feather.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c field.cpp -o field.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c filesystem.cpp -o filesystem.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c imports.cpp -o imports.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c io.cpp -o io.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c json.cpp -o json.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c memorypool.cpp -o memorypool.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c message.cpp -o message.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c parquet.cpp -o parquet.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c py-to-r.cpp -o py-to-r.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c recordbatch.cpp -o recordbatch.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c recordbatchreader.cpp -o recordbatchreader.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c recordbatchwriter.cpp -o recordbatchwriter.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c scalar.cpp -o scalar.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c schema.cpp -o schema.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c symbols.cpp -o symbols.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c table.cpp -o table.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c threadpool.cpp -o threadpool.o
g++ -m64 -std=gnu++11 -shared -L/usr/lib64/R/lib -Wl,-z,relro -o arrow.so array.o array_from_vector.o array_to_vector.o arraydata.o arrowExports.o buffer.o chunkedarray.o compression.o compute.o csv.o dataset.o datatype.o expression.o feather.o field.o filesystem.o imports.o io.o json.o memorypool.o message.o parquet.o py-to-r.o recordbatch.o recordbatchreader.o recordbatchwriter.o scalar.o schema.o symbols.o table.o threadpool.o -larrow_dataset -lparquet -larrow -L/usr/lib64/R/lib -lR
installing to /usr/lib64/R/library/00LOCK-arrow/00new/arrow/libs
** R
** inst
** byte-compile and prepare package for lazy loading
** help
*** installing help indices
Warning in file.copy(file.path(R.home("doc"), "html", "R.css"), outman) :
problem copying /usr/share/doc/R-3.6.0/html/R.css to /usr/lib64/R/library/00LOCK-arrow/00new/arrow/html/R.css: No such file or directory
converting help for package ‘arrow’
finding HTML links ... done
ArrayData html
ChunkedArray html
Codec html
CsvReadOptions html
CsvTableReader html
DataType html
Dataset html
DictionaryType html
Expression html
FeatherReader html
Field html
FileFormat html
FileInfo html
FileSelector html
FileSystem html
FileWriteOptions html
FixedWidthType html
InputStream html
MemoryPool html
Message html
MessageReader html
OutputStream html
ParquetArrowReaderProperties html
ParquetFileReader html
ParquetFileWriter html
ParquetWriterProperties html
Partitioning html
RecordBatch html
RecordBatchReader html
RecordBatchWriter html
Scalar html
Scanner html
Schema html
Table html
array html
arrow-package html
arrow_available html
arrow_info html
buffer html
cast_options html
codec_is_available html
compression html
copy_files html
cpu_count html
data-type html
dataset_factory html
default_memory_pool html
dictionary html
enums html
flight_connect html
flight_get html
flight_put html
hive_partition html
install_arrow html
install_pyarrow html
list_flights html
load_flight_server html
make_readable_file html
map_batches html
match_arrow html
mmap_create html
mmap_open html
open_dataset html
read_delim_arrow html
read_feather html
read_ipc_stream html
read_json_arrow html
read_message html
read_parquet html
read_schema html
reexports html
Rd warning: /tmp/Rtmp07WHSB/R.INSTALL79d5ba23548/arrow/man/reexports.Rd:26: file link ‘starts_with’ in package ‘tidyselect’ does not exist and so has been treated as a topic
Rd warning: /tmp/Rtmp07WHSB/R.INSTALL79d5ba23548/arrow/man/reexports.Rd:26: file link ‘everything’ in package ‘tidyselect’ does not exist and so has been treated as a topic
Rd warning: /tmp/Rtmp07WHSB/R.INSTALL79d5ba23548/arrow/man/reexports.Rd:26: file link ‘one_of’ in package ‘tidyselect’ does not exist and so has been treated as a topic
s3_bucket html
type html
unify_schemas html
write_dataset html
write_feather html
write_ipc_stream html
write_parquet html
write_to_raw html
** building package indices
** installing vignettes
** testing if installed package can be loaded from temporary location
** checking absolute paths in shared objects and dynamic libraries
** testing if installed package can be loaded from final location
** testing if installed package keeps a record of temporary installation path
* DONE (arrow)
Warning in file.create(f.tg) :
cannot create file '/usr/share/doc/R-3.6.0/html/packages.html', reason 'No such file or directory'
Warning in utils::make.packages.html(.Library, docdir = R.home("doc")) :
cannot update HTML package index
[root@c1cce557dba3 tmp]# Jonathan Keane / @jonkeane: Thank you for that, that's super helpful.
I see in the output the line *** Arrow C++ libraries found via pkg-config which tells us that the R package is linking to a version of lib arrow that it has found via pkg-config (the most likely candidate here is one installed at the system level, if I'm parsing the logs correctly, it might be located in /usr/local/include ). Is it possible you installed libarrow some other way before the R package?
There are a few options:
You could try setting ARROW_USE_PKG_CONFIG=FALSE which will avoid using pkg-config to look for libarrow, you'll also want to set LIBARROW_MINIMAL=FALSE and ARROW_R_DEV=TRUE and try to reinstall
Or, if you want to uninstall the installed version of libarrow, you can do that and the reinstall with LIBARROW_MINIMAL=FALSE and ARROW_R_DEV=TRUE should trigger a full build.
With either of these options, you will need to install the devtoolset-8 if you don't already have it to enable the version of gcc that is required for using S3 with arrow.
ARROW_R_DEV=TRUE isn't strictly necessary, of course but more verbosity is helpful.
asfimport
commented
3 years ago Karthikeyan Janakiraman: Thanks for the suggestion, I followed the steps and seeing the same error. Here are the steps I followed, please have a look and advise what might be wrong here.
Set requested environment variables
export ARROW_USE_PKG_CONFIG=FALSE
export LIBARROW_MINIMAL=FALSE
export ARROW_R_DEV=TRUEInstall the required packages.
yum install devtoolset-8 --nogpgcheck
yum install -y https://apache.bintray.com/arrow/centos/$(cut -d: -f5 /etc/system-release-cpe | cut -d. -f1)/apache-arrow-release-latest.rpm
yum install -y arrow-devel
yum install -y arrow-glib-devel
yum install -y arrow-dataset-devel
yum install -y parquet-devel
yum install -y parquet-glib-develInstall arrow R package.
{code:java} [root@3800c0c7ea36 tmp]# R CMD INSTALL arrow_3.0.0.tar.gz
downloaded 7.8 MB*** Successfully retrieved C++ source
{code}
Trying to read parquet file from S3.
> library('arrow')
Attaching package: ‘arrow’
The following object is masked from ‘package:utils’: timestamp>
> df <- read_parquet("s3://mybucket/test-parquet/refinement.parquet")
Error: NotImplemented: Got S3 URI but Arrow compiled without S3 support
>
asfimport
commented
3 years ago Jonathan Keane / @jonkeane: Thanks for the output again. A few things:
In the build log it looks like there's a failure when downloading cmake (which is strange, I just checked the URL and that downloads fine for me).
**** cmake
trying URL 'https://github.com/Kitware/CMake/releases/download/v3.19.2/cmake-3.19.2-Linux-x86_64.tar.gz'
Error in download.file(from_url, to_file, quiet = quietly) :
cannot open URL 'https://github.com/Kitware/CMake/releases/download/v3.19.2/cmake-3.19.2-Linux-x86_64.tar.gz'
/usr/bin/gtar: /tmp/RtmpJeSgXG/file2ae5174da5a: Cannot open: No such file or directory
/usr/bin/gtar: Error is not recoverable: exiting now
sh: /tmp/RtmpJeSgXG/file2ae17ed47c0/cmake-3.19.2-Linux-x86_64/bin/cmake: No such file or directory
Error in system(paste("export", env_vars, "&& $CMAKE --system-information"), :
error in running command
Calls: build_libarrow ... cmake_gcc_version -> cmake_cxx_compiler_vars -> systemBut one way to avoid needing to download cmake in the build process is to install it directly (I think yum install cmake3 should do it). And then try reinstalling and see if the process gets further. Can you try this and see how it goes?
One more note: the system installed with the following aren't going to help us here — the official arrow releases for centos7 don't have S3 support enabled because in order to enable S3 support the devtoolset-8 must be installed.
yum install -y arrow-devel
yum install -y arrow-glib-devel
yum install -y arrow-dataset-develKarthikeyan Janakiraman: On devtoolset-8, this was already installed. Hope it looks good ?
[root@3800c0c7ea36 tmp]# rpm -qa | grep devtoolset-8
devtoolset-8-systemtap-devel-3.3-2.el7.x86_64
devtoolset-8-strace-4.24-4.el7.x86_64
devtoolset-8-dwz-0.12-1.1.el7.x86_64
devtoolset-8-8.1-1.el7.x86_64
devtoolset-8-systemtap-3.3-2.el7.x86_64
devtoolset-8-perftools-8.1-1.el7.x86_64
devtoolset-8-libquadmath-devel-8.3.1-3.2.el7.x86_64
devtoolset-8-runtime-8.1-1.el7.x86_64
devtoolset-8-dyninst-9.3.2-6.el7.x86_64
devtoolset-8-elfutils-libs-0.176-1.el7.x86_64
devtoolset-8-gdb-8.2-3.el7.x86_64
devtoolset-8-memstomp-0.1.5-5.el7.x86_64
devtoolset-8-gcc-gfortran-8.3.1-3.2.el7.x86_64
devtoolset-8-elfutils-libelf-0.176-1.el7.x86_64
devtoolset-8-systemtap-runtime-3.3-2.el7.x86_64
devtoolset-8-elfutils-0.176-1.el7.x86_64
devtoolset-8-valgrind-3.14.0-16.el7.x86_64
devtoolset-8-ltrace-0.7.91-1.el7.x86_64
devtoolset-8-gcc-8.3.1-3.2.el7.x86_64
devtoolset-8-toolchain-8.1-1.el7.x86_64
devtoolset-8-systemtap-client-3.3-2.el7.x86_64
devtoolset-8-oprofile-1.3.0-2.el7.x86_64
devtoolset-8-gcc-c++-8.3.1-3.2.el7.x86_64
devtoolset-8-binutils-2.30-55.el7.2.x86_64
devtoolset-8-libstdc++-devel-8.3.1-3.2.el7.x86_64
devtoolset-8-make-4.2.1-4.el7.x86_64
[root@3800c0c7ea36 tmp]# I could see some progress this time cmake seems to have worked however I still see s3 option is not being enabled and the installation tries to download from github to which I dont seem to have access to. Is there alternative for these github downloads ?
[root@3800c0c7ea36 tmp]# R CMD INSTALL arrow_3.0.0.tar.gz
* installing to library ‘/usr/lib64/R/library’
* installing *source* package ‘arrow’ ...
** package ‘arrow’ successfully unpacked and MD5 sums checked
** using staged installation
trying URL 'https://dl.bintray.com/ursalabs/arrow-r/libarrow/src/arrow-3.0.0.zip'
Error in download.file(from_url, to_file, quiet = quietly) :
cannot open URL 'https://dl.bintray.com/ursalabs/arrow-r/libarrow/src/arrow-3.0.0.zip'
trying URL 'https://www.apache.org/dyn/closer.lua?action=download&filename=arrow/arrow-3.0.0/apache-arrow-3.0.0.tar.gz'
Error in download.file(from_url, to_file, quiet = quietly) :
cannot open URL 'https://www.apache.org/dyn/closer.lua?action=download&filename=arrow/arrow-3.0.0/apache-arrow-3.0.0.tar.gz'
trying URL 'https://www.apache.org/dyn/closer.lua?action=download&filename=arrow/arrow-3.0.0/apache-arrow-3.0.0.tar.gz'
Content type 'application/x-gzip' length 8200790 bytes (7.8 MB)
==================================================
downloaded 7.8 MB*** Successfully retrieved C++ source
*** Building C++ libraries
*** Building with MAKEFLAGS= -j2
**** S3 support not available for gcc < 4.9; building with ARROW_S3=OFF
**** mimalloc support not available for gcc < 4.9; building with ARROW_MIMALLOC=OFF
**** arrow with SOURCE_DIR="/tmp/RtmpqK4yeM/file44b45405feb/apache-arrow-3.0.0/cpp" BUILD_DIR="/tmp/RtmpqK4yeM/file44b5965220a" DEST_DIR="libarrow/arrow-3.0.0" CMAKE="/usr/bin/cmake3" CC="gcc -m64 -std=gnu99" CXX="g++ -m64 -std=gnu++11" LDFLAGS="-Wl,-z,relro" ARROW_S3=OFF ARROW_MIMALLOC=OFF
++ pwd
+ : /tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow
+ : /tmp/RtmpqK4yeM/file44b45405feb/apache-arrow-3.0.0/cpp
+ : /tmp/RtmpqK4yeM/file44b5965220a
+ : libarrow/arrow-3.0.0
+ : /usr/bin/cmake3
++ cd /tmp/RtmpqK4yeM/file44b45405feb/apache-arrow-3.0.0/cpp
++ pwd
+ SOURCE_DIR=/tmp/RtmpqK4yeM/file44b45405feb/apache-arrow-3.0.0/cpp
++ mkdir -p libarrow/arrow-3.0.0
++ cd libarrow/arrow-3.0.0
++ pwd
+ DEST_DIR=/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0
+ '[' '' = '' ']'
+ which ninja
+ '[' FALSE = false ']'
+ ARROW_DEFAULT_PARAM=OFF
+ mkdir -p /tmp/RtmpqK4yeM/file44b5965220a
+ pushd /tmp/RtmpqK4yeM/file44b5965220a
/tmp/RtmpqK4yeM/file44b5965220a /tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow
+ /usr/bin/cmake3 -DARROW_BOOST_USE_SHARED=OFF -DARROW_BUILD_TESTS=OFF -DARROW_BUILD_SHARED=OFF -DARROW_BUILD_STATIC=ON -DARROW_COMPUTE=ON -DARROW_CSV=ON -DARROW_DATASET=ON -DARROW_DEPENDENCY_SOURCE=BUNDLED -DARROW_FILESYSTEM=ON -DARROW_JEMALLOC=ON -DARROW_MIMALLOC=OFF -DARROW_JSON=ON -DARROW_PARQUET=ON -DARROW_S3=OFF -DARROW_WITH_BROTLI=OFF -DARROW_WITH_BZ2=OFF -DARROW_WITH_LZ4=OFF -DARROW_WITH_SNAPPY=OFF -DARROW_WITH_UTF8PROC=OFF -DARROW_WITH_ZLIB=OFF -DARROW_WITH_ZSTD=OFF -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_LIBDIR=lib -DCMAKE_INSTALL_PREFIX=/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0 -DCMAKE_EXPORT_NO_PACKAGE_REGISTRY=ON -DCMAKE_FIND_PACKAGE_NO_PACKAGE_REGISTRY=ON -DCMAKE_UNITY_BUILD=ON -G 'Unix Makefiles' /tmp/RtmpqK4yeM/file44b45405feb/apache-arrow-3.0.0/cpp
-- Building using CMake version: 3.17.5
-- The C compiler identification is GNU 4.8.5
-- The CXX compiler identification is GNU 4.8.5
-- Check for working C compiler: /usr/bin/gcc
-- Check for working C compiler: /usr/bin/gcc - works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/g++
-- Check for working CXX compiler: /usr/bin/g++ - works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Arrow version: 3.0.0 (full: '3.0.0')
-- Arrow SO version: 300 (full: 300.0.0)
-- clang-tidy not found
-- clang-format not found
-- Could NOT find ClangTools (missing: CLANG_FORMAT_BIN CLANG_TIDY_BIN)
-- infer not found
fatal: Not a git repository (or any of the parent directories): .git
-- Found Python3: /opt/anaconda3-4.4.0/bin/python3.6 (found version "3.6.1") found components: Interpreter
-- Found cpplint executable at /tmp/RtmpqK4yeM/file44b45405feb/apache-arrow-3.0.0/cpp/build-support/cpplint.py
-- System processor: x86_64
-- Performing Test CXX_SUPPORTS_SSE4_2
-- Performing Test CXX_SUPPORTS_SSE4_2 - Success
-- Performing Test CXX_SUPPORTS_AVX2
-- Performing Test CXX_SUPPORTS_AVX2 - Failed
-- Performing Test CXX_SUPPORTS_AVX512
-- Performing Test CXX_SUPPORTS_AVX512 - Failed
-- Arrow build warning level: PRODUCTION
Using ld linker
Configured for RELEASE build (set with cmake -DCMAKE_BUILD_TYPE={release,debug,...})
-- Build Type: RELEASE
-- Using BUNDLED approach to find dependencies
-- ARROW_ABSL_BUILD_VERSION: 0f3bb466b868b523cf1dc9b2aaaed65c77b28862
-- ARROW_AWSSDK_BUILD_VERSION: 1.8.90
-- ARROW_AWS_CHECKSUMS_BUILD_VERSION: v0.1.5
-- ARROW_AWS_C_COMMON_BUILD_VERSION: v0.4.59
-- ARROW_AWS_C_EVENT_STREAM_BUILD_VERSION: v0.1.5
-- ARROW_BOOST_BUILD_VERSION: 1.71.0
-- ARROW_BROTLI_BUILD_VERSION: v1.0.7
-- ARROW_BZIP2_BUILD_VERSION: 1.0.8
-- ARROW_CARES_BUILD_VERSION: 1.16.1
-- ARROW_GBENCHMARK_BUILD_VERSION: v1.5.2
-- ARROW_GFLAGS_BUILD_VERSION: v2.2.2
-- ARROW_GLOG_BUILD_VERSION: v0.4.0
-- ARROW_GRPC_BUILD_VERSION: v1.33.2
-- ARROW_GTEST_BUILD_VERSION: 1.10.0
-- ARROW_JEMALLOC_BUILD_VERSION: 5.2.1
-- ARROW_LZ4_BUILD_VERSION: v1.9.2
-- ARROW_MIMALLOC_BUILD_VERSION: v1.6.4
-- ARROW_ORC_BUILD_VERSION: 1.6.2
-- ARROW_PROTOBUF_BUILD_VERSION: v3.13.0
-- ARROW_RAPIDJSON_BUILD_VERSION: 1a803826f1197b5e30703afe4b9c0e7dd48074f5
-- ARROW_RE2_BUILD_VERSION: 2019-08-01
-- ARROW_SNAPPY_BUILD_VERSION: 1.1.8
-- ARROW_THRIFT_BUILD_VERSION: 0.12.0
-- ARROW_THRIFT_BUILD_MD5_CHECKSUM: 3deebbb4d1ca77dd9c9e009a1ea02183
-- ARROW_UTF8PROC_BUILD_VERSION: v2.5.0
-- ARROW_ZLIB_BUILD_VERSION: 1.2.11
-- ARROW_ZSTD_BUILD_VERSION: v1.4.5
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Check if compiler accepts -pthread
-- Check if compiler accepts -pthread - yes
-- Found Threads: TRUE
-- Looking for __SIZEOF_INT128__
-- Looking for __SIZEOF_INT128__ - found
-- Added static library dependency boost_system_static: /tmp/RtmpqK4yeM/file44b5965220a/boost_ep-prefix/src/boost_ep/stage/lib/libboost_system.a
-- Added static library dependency boost_filesystem_static: /tmp/RtmpqK4yeM/file44b5965220a/boost_ep-prefix/src/boost_ep/stage/lib/libboost_filesystem.a
-- Added static library dependency boost_regex_static: /tmp/RtmpqK4yeM/file44b5965220a/boost_ep-prefix/src/boost_ep/stage/lib/libboost_regex.a
-- Boost include dir: /tmp/RtmpqK4yeM/file44b5965220a/boost_ep-prefix/src/boost_ep
-- Boost libraries: boost_system_static;boost_filesystem_static
-- Building without OpenSSL support. Minimum OpenSSL version 1.0.2 required.
Building Apache Thrift from source
-- Building (vendored) jemalloc from source
-- Building RapidJSON from source
-- Building RE2 from source
-- Found hdfs.h at: /tmp/RtmpqK4yeM/file44b45405feb/apache-arrow-3.0.0/cpp/thirdparty/hadoop/include/hdfs.h
-- All bundled static libraries: boost_system_static;boost_filesystem_static;boost_regex_static;thrift::thrift;jemalloc::jemalloc;re2::re2
-- CMAKE_C_FLAGS: -O3 -DNDEBUG -Wall -Wno-attributes -msse4.2
-- CMAKE_CXX_FLAGS: -Wno-subobject-linkage -O3 -DNDEBUG -Wall -Wno-attributes -msse4.2
-- Looking for backtrace
-- Looking for backtrace - found
-- backtrace facility detected in default set of libraries
-- Found Backtrace: /usr/include
-- Creating bundled static library target arrow_bundled_dependencies at /tmp/RtmpqK4yeM/file44b5965220a/release/libarrow_bundled_dependencies.a
-- ---------------------------------------------------------------------
-- Arrow version: 3.0.0
--
-- Build configuration summary:
-- Generator: Unix Makefiles
-- Build type: RELEASE
-- Source directory: /tmp/RtmpqK4yeM/file44b45405feb/apache-arrow-3.0.0/cpp
-- Install prefix: /tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0
--
-- Compile and link options:
--
-- ARROW_CXXFLAGS="" [default=""]
-- Compiler flags to append when compiling Arrow
-- ARROW_BUILD_STATIC=ON [default=ON]
-- Build static libraries
-- ARROW_BUILD_SHARED=OFF [default=ON]
-- Build shared libraries
-- ARROW_PACKAGE_KIND="" [default=""]
-- Arbitrary string that identifies the kind of package
-- (for informational purposes)
-- ARROW_GIT_ID="" [default=""]
-- The Arrow git commit id (if any)
-- ARROW_GIT_DESCRIPTION="" [default=""]
-- The Arrow git commit description (if any)
-- ARROW_NO_DEPRECATED_API=OFF [default=OFF]
-- Exclude deprecated APIs from build
-- ARROW_USE_CCACHE=ON [default=ON]
-- Use ccache when compiling (if available)
-- ARROW_USE_LD_GOLD=OFF [default=OFF]
-- Use ld.gold for linking on Linux (if available)
-- ARROW_USE_PRECOMPILED_HEADERS=OFF [default=OFF]
-- Use precompiled headers when compiling
-- ARROW_SIMD_LEVEL=SSE4_2 [default=NONE|SSE4_2|AVX2|AVX512]
-- Compile-time SIMD optimization level
-- ARROW_RUNTIME_SIMD_LEVEL=MAX [default=NONE|SSE4_2|AVX2|AVX512|MAX]
-- Max runtime SIMD optimization level
-- ARROW_ARMV8_ARCH=armv8-a [default=armv8-a|armv8-a+crc+crypto]
-- Arm64 arch and extensions
-- ARROW_ALTIVEC=ON [default=ON]
-- Build with Altivec if compiler has support
-- ARROW_RPATH_ORIGIN=OFF [default=OFF]
-- Build Arrow libraries with RATH set to $ORIGIN
-- ARROW_INSTALL_NAME_RPATH=ON [default=ON]
-- Build Arrow libraries with install_name set to @rpath
-- ARROW_GGDB_DEBUG=ON [default=ON]
-- Pass -ggdb flag to debug builds
--
-- Test and benchmark options:
--
-- ARROW_BUILD_EXAMPLES=OFF [default=OFF]
-- Build the Arrow examples
-- ARROW_BUILD_TESTS=OFF [default=OFF]
-- Build the Arrow googletest unit tests
-- ARROW_ENABLE_TIMING_TESTS=ON [default=ON]
-- Enable timing-sensitive tests
-- ARROW_BUILD_INTEGRATION=OFF [default=OFF]
-- Build the Arrow integration test executables
-- ARROW_BUILD_BENCHMARKS=OFF [default=OFF]
-- Build the Arrow micro benchmarks
-- ARROW_BUILD_BENCHMARKS_REFERENCE=OFF [default=OFF]
-- Build the Arrow micro reference benchmarks
-- ARROW_TEST_LINKAGE=static [default=shared|static]
-- Linkage of Arrow libraries with unit tests executables.
-- ARROW_FUZZING=OFF [default=OFF]
-- Build Arrow Fuzzing executables
-- ARROW_LARGE_MEMORY_TESTS=OFF [default=OFF]
-- Enable unit tests which use large memory
--
-- Lint options:
--
-- ARROW_ONLY_LINT=OFF [default=OFF]
-- Only define the lint and check-format targets
-- ARROW_VERBOSE_LINT=OFF [default=OFF]
-- If off, 'quiet' flags will be passed to linting tools
-- ARROW_GENERATE_COVERAGE=OFF [default=OFF]
-- Build with C++ code coverage enabled
--
-- Checks options:
--
-- ARROW_TEST_MEMCHECK=OFF [default=OFF]
-- Run the test suite using valgrind --tool=memcheck
-- ARROW_USE_ASAN=OFF [default=OFF]
-- Enable Address Sanitizer checks
-- ARROW_USE_TSAN=OFF [default=OFF]
-- Enable Thread Sanitizer checks
-- ARROW_USE_UBSAN=OFF [default=OFF]
-- Enable Undefined Behavior sanitizer checks
--
-- Project component options:
--
-- ARROW_BUILD_UTILITIES=OFF [default=OFF]
-- Build Arrow commandline utilities
-- ARROW_COMPUTE=ON [default=OFF]
-- Build the Arrow Compute Modules
-- ARROW_CSV=ON [default=OFF]
-- Build the Arrow CSV Parser Module
-- ARROW_CUDA=OFF [default=OFF]
-- Build the Arrow CUDA extensions (requires CUDA toolkit)
-- ARROW_DATASET=ON [default=OFF]
-- Build the Arrow Dataset Modules
-- ARROW_FILESYSTEM=ON [default=OFF]
-- Build the Arrow Filesystem Layer
-- ARROW_FLIGHT=OFF [default=OFF]
-- Build the Arrow Flight RPC System (requires GRPC, Protocol Buffers)
-- ARROW_GANDIVA=OFF [default=OFF]
-- Build the Gandiva libraries
-- ARROW_HDFS=OFF [default=OFF]
-- Build the Arrow HDFS bridge
-- ARROW_HIVESERVER2=OFF [default=OFF]
-- Build the HiveServer2 client and Arrow adapter
-- ARROW_IPC=ON [default=ON]
-- Build the Arrow IPC extensions
-- ARROW_JEMALLOC=ON [default=ON]
-- Build the Arrow jemalloc-based allocator
-- ARROW_JNI=OFF [default=OFF]
-- Build the Arrow JNI lib
-- ARROW_JSON=ON [default=OFF]
-- Build Arrow with JSON support (requires RapidJSON)
-- ARROW_MIMALLOC=OFF [default=OFF]
-- Build the Arrow mimalloc-based allocator
-- ARROW_PARQUET=ON [default=OFF]
-- Build the Parquet libraries
-- ARROW_ORC=OFF [default=OFF]
-- Build the Arrow ORC adapter
-- ARROW_PLASMA=OFF [default=OFF]
-- Build the plasma object store along with Arrow
-- ARROW_PLASMA_JAVA_CLIENT=OFF [default=OFF]
-- Build the plasma object store java client
-- ARROW_PYTHON=OFF [default=OFF]
-- Build the Arrow CPython extensions
-- ARROW_S3=OFF [default=OFF]
-- Build Arrow with S3 support (requires the AWS SDK for C++)
-- ARROW_TENSORFLOW=OFF [default=OFF]
-- Build Arrow with TensorFlow support enabled
-- ARROW_TESTING=OFF [default=OFF]
-- Build the Arrow testing libraries
--
-- Thirdparty toolchain options:
--
-- ARROW_DEPENDENCY_SOURCE=BUNDLED [default=AUTO|BUNDLED|SYSTEM|CONDA|BREW]
-- Method to use for acquiring arrow's build dependencies
-- ARROW_VERBOSE_THIRDPARTY_BUILD=OFF [default=OFF]
-- Show output from ExternalProjects rather than just logging to files
-- ARROW_DEPENDENCY_USE_SHARED=ON [default=ON]
-- Link to shared libraries
-- ARROW_BOOST_USE_SHARED=OFF [default=ON]
-- Rely on boost shared libraries where relevant
-- ARROW_BROTLI_USE_SHARED=ON [default=ON]
-- Rely on Brotli shared libraries where relevant
-- ARROW_BZ2_USE_SHARED=ON [default=ON]
-- Rely on Bz2 shared libraries where relevant
-- ARROW_GFLAGS_USE_SHARED=ON [default=ON]
-- Rely on GFlags shared libraries where relevant
-- ARROW_GRPC_USE_SHARED=ON [default=ON]
-- Rely on gRPC shared libraries where relevant
-- ARROW_LZ4_USE_SHARED=ON [default=ON]
-- Rely on lz4 shared libraries where relevant
-- ARROW_OPENSSL_USE_SHARED=ON [default=ON]
-- Rely on OpenSSL shared libraries where relevant
-- ARROW_PROTOBUF_USE_SHARED=ON [default=ON]
-- Rely on Protocol Buffers shared libraries where relevant
-- ARROW_THRIFT_USE_SHARED=ON [default=ON]
-- Rely on thrift shared libraries where relevant
-- ARROW_UTF8PROC_USE_SHARED=ON [default=ON]
-- Rely on utf8proc shared libraries where relevant
-- ARROW_SNAPPY_USE_SHARED=ON [default=ON]
-- Rely on snappy shared libraries where relevant
-- ARROW_UTF8PROC_USE_SHARED=ON [default=ON]
-- Rely on utf8proc shared libraries where relevant
-- ARROW_ZSTD_USE_SHARED=ON [default=ON]
-- Rely on zstd shared libraries where relevant
-- ARROW_USE_GLOG=OFF [default=OFF]
-- Build libraries with glog support for pluggable logging
-- ARROW_WITH_BACKTRACE=ON [default=ON]
-- Build with backtrace support
-- ARROW_WITH_BROTLI=OFF [default=OFF]
-- Build with Brotli compression
-- ARROW_WITH_BZ2=OFF [default=OFF]
-- Build with BZ2 compression
-- ARROW_WITH_LZ4=OFF [default=OFF]
-- Build with lz4 compression
-- ARROW_WITH_SNAPPY=OFF [default=OFF]
-- Build with Snappy compression
-- ARROW_WITH_ZLIB=OFF [default=OFF]
-- Build with zlib compression
-- ARROW_WITH_ZSTD=OFF [default=OFF]
-- Build with zstd compression
-- ARROW_WITH_UTF8PROC=OFF [default=ON]
-- Build with support for Unicode properties using the utf8proc library
-- (only used if ARROW_COMPUTE is ON)
-- ARROW_WITH_RE2=ON [default=ON]
-- Build with support for regular expressions using the re2 library
-- (only used if ARROW_COMPUTE or ARROW_GANDIVA is ON)
--
-- Parquet options:
--
-- PARQUET_MINIMAL_DEPENDENCY=OFF [default=OFF]
-- Depend only on Thirdparty headers to build libparquet.
-- Always OFF if building binaries
-- PARQUET_BUILD_EXECUTABLES=OFF [default=OFF]
-- Build the Parquet executable CLI tools. Requires static libraries to be built.
-- PARQUET_BUILD_EXAMPLES=OFF [default=OFF]
-- Build the Parquet examples. Requires static libraries to be built.
-- PARQUET_REQUIRE_ENCRYPTION=OFF [default=OFF]
-- Build support for encryption. Fail if OpenSSL is not found
--
-- Gandiva options:
--
-- ARROW_GANDIVA_JAVA=OFF [default=OFF]
-- Build the Gandiva JNI wrappers
-- ARROW_GANDIVA_STATIC_LIBSTDCPP=OFF [default=OFF]
-- Include -static-libstdc++ -static-libgcc when linking with
-- Gandiva static libraries
-- ARROW_GANDIVA_PC_CXX_FLAGS="" [default=""]
-- Compiler flags to append when pre-compiling Gandiva operations
--
-- Advanced developer options:
--
-- ARROW_EXTRA_ERROR_CONTEXT=OFF [default=OFF]
-- Compile with extra error context (line numbers, code)
-- ARROW_OPTIONAL_INSTALL=OFF [default=OFF]
-- If enabled install ONLY targets that have already been built. Please be
-- advised that if this is enabled 'install' will fail silently on components
-- that have not been built
-- Outputting build configuration summary to /tmp/RtmpqK4yeM/file44b5965220a/cmake_summary.json
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/RtmpqK4yeM/file44b5965220a
+ /usr/bin/cmake3 --build . --target install
Scanning dependencies of target jemalloc_ep
Scanning dependencies of target boost_ep
[ 1%] Creating directories for 'jemalloc_ep'
[ 2%] Creating directories for 'boost_ep'
[ 4%] Performing download step (download, verify and extract) for 'jemalloc_ep'
[ 5%] Performing download step (download, verify and extract) for 'boost_ep'
-- boost_ep download command succeeded. See also /tmp/RtmpqK4yeM/file44b5965220a/boost_ep-prefix/src/boost_ep-stamp/boost_ep-download-*.log
[ 6%] No patch step for 'boost_ep'
[ 8%] No update step for 'boost_ep'
[ 9%] Performing configure step for 'boost_ep'
-- boost_ep configure command succeeded. See also /tmp/RtmpqK4yeM/file44b5965220a/boost_ep-prefix/src/boost_ep-stamp/boost_ep-configure-*.log
[ 10%] Performing build step for 'boost_ep'
-- boost_ep build command succeeded. See also /tmp/RtmpqK4yeM/file44b5965220a/boost_ep-prefix/src/boost_ep-stamp/boost_ep-build-*.log
[ 12%] No install step for 'boost_ep'
[ 13%] Completed 'boost_ep'
[ 13%] Built target boost_ep
Scanning dependencies of target rapidjson_ep
[ 14%] Creating directories for 'rapidjson_ep'
[ 16%] Performing download step (download, verify and extract) for 'rapidjson_ep'
CMake Error at jemalloc_ep-stamp/jemalloc_ep-download-RELEASE.cmake:37 (message):
Command failed: 1 '/usr/bin/cmake3' '-Dmake=' '-Dconfig=' '-P' '/tmp/RtmpqK4yeM/file44b5965220a/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-download-RELEASE-impl.cmake' See also /tmp/RtmpqK4yeM/file44b5965220a/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-download-*.log
-- stdout output is:
-- Downloading...
dst='/tmp/RtmpqK4yeM/file44b5965220a/jemalloc_ep-prefix/src/jemalloc-5.2.1.tar.bz2'
timeout='none'
-- Using src='https://github.com/jemalloc/jemalloc/releases/download/5.2.1/jemalloc-5.2.1.tar.bz2'
-- Using src='https://github.com/ursa-labs/thirdparty/releases/download/latest/jemalloc-5.2.1.tar.bz2'
-- Retrying...
-- Using src='https://github.com/jemalloc/jemalloc/releases/download/5.2.1/jemalloc-5.2.1.tar.bz2'
-- Using src='https://github.com/ursa-labs/thirdparty/releases/download/latest/jemalloc-5.2.1.tar.bz2'
-- Retry after 5 seconds (attempt #2) ...
-- Using src='https://github.com/jemalloc/jemalloc/releases/download/5.2.1/jemalloc-5.2.1.tar.bz2'
-- Using src='https://github.com/ursa-labs/thirdparty/releases/download/latest/jemalloc-5.2.1.tar.bz2'
-- Retry after 5 seconds (attempt #3) ...
-- Using src='https://github.com/jemalloc/jemalloc/releases/download/5.2.1/jemalloc-5.2.1.tar.bz2'
-- Using src='https://github.com/ursa-labs/thirdparty/releases/download/latest/jemalloc-5.2.1.tar.bz2'
-- Retry after 15 seconds (attempt #4) ...
-- Using src='https://github.com/jemalloc/jemalloc/releases/download/5.2.1/jemalloc-5.2.1.tar.bz2'
-- Using src='https://github.com/ursa-labs/thirdparty/releases/download/latest/jemalloc-5.2.1.tar.bz2'
-- Retry after 60 seconds (attempt #5) ...
-- Using src='https://github.com/jemalloc/jemalloc/releases/download/5.2.1/jemalloc-5.2.1.tar.bz2'
-- Using src='https://github.com/ursa-labs/thirdparty/releases/download/latest/jemalloc-5.2.1.tar.bz2'-- stderr output is:
...skipping to end...
certificate: subject: CN=github.com,O="GitHub, Inc.",L=San Francisco,ST=California,C=US start date: Mar 12 00:00:00 2021 GMT expire date: Mar 23 23:59:59 2022 GMT common name: github.com issuer: CN=COF-proxy-intermediate-CA-v2,OU=chiproxy06p,O=
One,L=Chicago,ST=IL,C=US GET /ursa-labs/thirdparty/releases/download/latest/jemalloc-5.2.1.tar.bz2
HTTP/1.1 User-Agent: curl/7.29.0 Host: github.com Accept: */* The requested URL returned error: 403 Forbidden Closing connection 5 --- LOG END ---
error: downloading 'https://github.com/jemalloc/jemalloc/releases/download/5.2.1/jemalloc-5.2.1.tar.bz2' failed
status_code: 22
status_string: "HTTP response code said error"
log:
--- LOG BEGIN ---
GET /jemalloc/jemalloc/releases/download/5.2.1/jemalloc-5.2.1.tar.bz2
HTTP/1.1 User-Agent: curl/7.29.0 Host: github.com Accept: */* The requested URL returned error: 403 Forbidden Closing connection 6 --- LOG END ---
error: downloading 'https://github.com/ursa-labs/thirdparty/releases/download/latest/jemalloc-5.2.1.tar.bz2' failed
status_code: 22
status_string: "HTTP response code said error"
log:
--- LOG BEGIN ---
GET /ursa-labs/thirdparty/releases/download/latest/jemalloc-5.2.1.tar.bz2
HTTP/1.1 User-Agent: curl/7.29.0 Host: github.com Accept: */* The requested URL returned error: 403 Forbidden Closing connection 7 --- LOG END ---
error: downloading 'https://github.com/jemalloc/jemalloc/releases/download/5.2.1/jemalloc-5.2.1.tar.bz2' failed
status_code: 22
status_string: "HTTP response code said error"
log:
--- LOG BEGIN ---
GET /jemalloc/jemalloc/releases/download/5.2.1/jemalloc-5.2.1.tar.bz2
HTTP/1.1 User-Agent: curl/7.29.0 Host: github.com Accept: */* The requested URL returned error: 403 Forbidden Closing connection 8 --- LOG END ---
error: downloading 'https://github.com/ursa-labs/thirdparty/releases/download/latest/jemalloc-5.2.1.tar.bz2' failed
status_code: 22
status_string: "HTTP response code said error"
log:
--- LOG BEGIN ---
GET /ursa-labs/thirdparty/releases/download/latest/jemalloc-5.2.1.tar.bz2
HTTP/1.1 User-Agent: curl/7.29.0 Host: github.com Accept: */* The requested URL returned error: 403 Forbidden Closing connection 9 --- LOG END ---
error: downloading 'https://github.com/jemalloc/jemalloc/releases/download/5.2.1/jemalloc-5.2.1.tar.bz2' failed
status_code: 22
status_string: "HTTP response code said error"
log:
--- LOG BEGIN ---
GET /jemalloc/jemalloc/releases/download/5.2.1/jemalloc-5.2.1.tar.bz2
HTTP/1.1 User-Agent: curl/7.29.0 Host: github.com Accept: */* The requested URL returned error: 403 Forbidden Closing connection 10 --- LOG END ---
error: downloading 'https://github.com/ursa-labs/thirdparty/releases/download/latest/jemalloc-5.2.1.tar.bz2' failed
status_code: 22
status_string: "HTTP response code said error"
log:
--- LOG BEGIN ---
GET /ursa-labs/thirdparty/releases/download/latest/jemalloc-5.2.1.tar.bz2
HTTP/1.1 User-Agent: curl/7.29.0 Host: github.com Accept: */* The requested URL returned error: 403 Forbidden Closing connection 11 --- LOG END ---
CMake Error at jemalloc_ep-stamp/jemalloc_ep-download-RELEASE-impl.cmake:9 (message):
Command failed (1): '/usr/bin/cmake3' '-P' '/tmp/RtmpqK4yeM/file44b5965220a/jemalloc_ep-prefix/src/jemalloc_ep-stamp/download-jemalloc_ep.cmake'CMake Error at jemalloc_ep-stamp/jemalloc_ep-download-RELEASE.cmake:47 (message):
Stopping after outputting logs.
make[2]: *** [jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-download] Error 1
make[1]: *** [CMakeFiles/jemalloc_ep.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
CMake Error at rapidjson_ep-stamp/rapidjson_ep-download-RELEASE.cmake:37 (message):
Command failed: 1 '/usr/bin/cmake3' '-Dmake=' '-Dconfig=' '-P' '/tmp/RtmpqK4yeM/file44b5965220a/src/rapidjson_ep-stamp/rapidjson_ep-download-RELEASE-impl.cmake' See also /tmp/RtmpqK4yeM/file44b5965220a/src/rapidjson_ep-stamp/rapidjson_ep-download-*.log
-- stdout output is:
-- Downloading...
dst='/tmp/RtmpqK4yeM/file44b5965220a/src/1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz'
timeout='none'
-- Using src='https://github.com/miloyip/rapidjson/archive/1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz'
-- Using src='https://github.com/ursa-labs/thirdparty/releases/download/latest/rapidjson-1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz'
-- Retrying...
-- Using src='https://github.com/miloyip/rapidjson/archive/1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz'
-- Using src='https://github.com/ursa-labs/thirdparty/releases/download/latest/rapidjson-1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz'
-- Retry after 5 seconds (attempt #2) ...
-- Using src='https://github.com/miloyip/rapidjson/archive/1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz'
-- Using src='https://github.com/ursa-labs/thirdparty/releases/download/latest/rapidjson-1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz'
-- Retry after 5 seconds (attempt #3) ...
-- Using src='https://github.com/miloyip/rapidjson/archive/1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz'
-- Using src='https://github.com/ursa-labs/thirdparty/releases/download/latest/rapidjson-1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz'
-- Retry after 15 seconds (attempt #4) ...
-- Using src='https://github.com/miloyip/rapidjson/archive/1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz'
-- Using src='https://github.com/ursa-labs/thirdparty/releases/download/latest/rapidjson-1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz'
-- Retry after 60 seconds (attempt #5) ...
-- Using src='https://github.com/miloyip/rapidjson/archive/1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz'
-- Using src='https://github.com/ursa-labs/thirdparty/releases/download/latest/rapidjson-1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz'-- stderr output is:
...skipping to end...
ursa-labs/thirdparty/releases/download/latest/rapidjson-1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz
HTTP/1.1 User-Agent: curl/7.29.0 Host: github.com Accept: */*
The requested URL returned error: 403 Forbidden Closing connection 5 --- LOG END ---
error: downloading 'https://github.com/miloyip/rapidjson/archive/1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz' failed
status_code: 22
status_string: "HTTP response code said error"
log:
--- LOG BEGIN ---
GET
/miloyip/rapidjson/archive/1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz
HTTP/1.1 User-Agent: curl/7.29.0 Host: github.com Accept: */* The requested URL returned error: 403 Forbidden Closing connection 6 --- LOG END ---
error: downloading 'https://github.com/ursa-labs/thirdparty/releases/download/latest/rapidjson-1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz' failed
status_code: 22
status_string: "HTTP response code said error"
log:
--- LOG BEGIN ---
GET
/ursa-labs/thirdparty/releases/download/latest/rapidjson-1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz
HTTP/1.1 User-Agent: curl/7.29.0 Host: github.com Accept: */* The requested URL returned error: 403 Forbidden Closing connection 7 --- LOG END ---
error: downloading 'https://github.com/miloyip/rapidjson/archive/1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz' failed
status_code: 22
status_string: "HTTP response code said error"
log:
--- LOG BEGIN ---
/miloyip/rapidjson/archive/1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz
HTTP/1.1 User-Agent: curl/7.29.0 Host: github.com Accept: */* The requested URL returned error: 403 Forbidden Closing connection 8 --- LOG END ---
error: downloading 'https://github.com/ursa-labs/thirdparty/releases/download/latest/rapidjson-1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz' failed
status_code: 22
status_string: "HTTP response code said error"
log:
--- LOG BEGIN ---
/ursa-labs/thirdparty/releases/download/latest/rapidjson-1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz
HTTP/1.1 User-Agent: curl/7.29.0 Host: github.com Accept: */* The requested URL returned error: 403 Forbidden Closing connection 9 --- LOG END ---
error: downloading 'https://github.com/miloyip/rapidjson/archive/1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz' failed
status_code: 22
status_string: "HTTP response code said error"
log:
--- LOG BEGIN ---
/miloyip/rapidjson/archive/1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz
HTTP/1.1 User-Agent: curl/7.29.0 Host: github.com Accept: */* The requested URL returned error: 403 Forbidden Closing connection 10 --- LOG END ---
error: downloading 'https://github.com/ursa-labs/thirdparty/releases/download/latest/rapidjson-1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz' failed
status_code: 22
status_string: "HTTP response code said error"
log:
--- LOG BEGIN ---
/ursa-labs/thirdparty/releases/download/latest/rapidjson-1a803826f1197b5e30703afe4b9c0e7dd48074f5.tar.gz
HTTP/1.1 User-Agent: curl/7.29.0 Host: github.com Accept: */* The requested URL returned error: 403 Forbidden Closing connection 11 --- LOG END ---
CMake Error at rapidjson_ep-stamp/rapidjson_ep-download-RELEASE-impl.cmake:9 (message):
Command failed (1): '/usr/bin/cmake3' '-P' '/tmp/RtmpqK4yeM/file44b5965220a/src/rapidjson_ep-stamp/download-rapidjson_ep.cmake'CMake Error at rapidjson_ep-stamp/rapidjson_ep-download-RELEASE.cmake:47 (message):
Stopping after outputting logs.
make[2]: *** [src/rapidjson_ep-stamp/rapidjson_ep-download] Error 1
make[1]: *** [CMakeFiles/rapidjson_ep.dir/all] Error 2
gmake: *** [all] Error 2
+ popd
/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow
PKG_CFLAGS=-I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW
PKG_LIBS=-larrow_dataset -lparquet -larrow
** libs
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c array.cpp -o array.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c array_from_vector.cpp -o array_from_vector.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c array_to_vector.cpp -o array_to_vector.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c arraydata.cpp -o arraydata.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c arrowExports.cpp -o arrowExports.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c buffer.cpp -o buffer.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c chunkedarray.cpp -o chunkedarray.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c compression.cpp -o compression.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c compute.cpp -o compute.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c csv.cpp -o csv.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c dataset.cpp -o dataset.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c datatype.cpp -o datatype.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c expression.cpp -o expression.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c feather.cpp -o feather.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c field.cpp -o field.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c filesystem.cpp -o filesystem.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c imports.cpp -o imports.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c io.cpp -o io.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c json.cpp -o json.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c memorypool.cpp -o memorypool.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c message.cpp -o message.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c parquet.cpp -o parquet.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c py-to-r.cpp -o py-to-r.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c recordbatch.cpp -o recordbatch.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c recordbatchreader.cpp -o recordbatchreader.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c recordbatchwriter.cpp -o recordbatchwriter.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c scalar.cpp -o scalar.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c schema.cpp -o schema.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c symbols.cpp -o symbols.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c table.cpp -o table.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c threadpool.cpp -o threadpool.o
g++ -m64 -std=gnu++11 -shared -L/usr/lib64/R/lib -Wl,-z,relro -o arrow.so array.o array_from_vector.o array_to_vector.o arraydata.o arrowExports.o buffer.o chunkedarray.o compression.o compute.o csv.o dataset.o datatype.o expression.o feather.o field.o filesystem.o imports.o io.o json.o memorypool.o message.o parquet.o py-to-r.o recordbatch.o recordbatchreader.o recordbatchwriter.o scalar.o schema.o symbols.o table.o threadpool.o -larrow_dataset -lparquet -larrow -L/usr/lib64/R/lib -lR
installing to /usr/lib64/R/library/00LOCK-arrow/00new/arrow/libs
** R
** inst
** byte-compile and prepare package for lazy loading
** help
*** installing help indices
Warning in file.copy(file.path(R.home("doc"), "html", "R.css"), outman) :
problem copying /usr/share/doc/R-3.6.0/html/R.css to /usr/lib64/R/library/00LOCK-arrow/00new/arrow/html/R.css: No such file or directory
converting help for package ‘arrow’
finding HTML links ... done
ArrayData html
ChunkedArray html
Codec html
CsvReadOptions html
CsvTableReader html
DataType html
Dataset html
DictionaryType html
Expression html
FeatherReader html
Field html
FileFormat html
FileInfo html
FileSelector html
FileSystem html
FileWriteOptions html
FixedWidthType html
InputStream html
MemoryPool html
Message html
MessageReader html
OutputStream html
ParquetArrowReaderProperties html
ParquetFileReader html
ParquetFileWriter html
ParquetWriterProperties html
Partitioning html
RecordBatch html
RecordBatchReader html
RecordBatchWriter html
Scalar html
Scanner html
Schema html
Table html
array html
arrow-package html
arrow_available html
arrow_info html
buffer html
cast_options html
codec_is_available html
compression html
copy_files html
cpu_count html
data-type html
dataset_factory html
default_memory_pool html
dictionary html
enums html
flight_connect html
flight_get html
flight_put html
hive_partition html
install_arrow html
install_pyarrow html
list_flights html
load_flight_server html
make_readable_file html
map_batches html
match_arrow html
mmap_create html
mmap_open html
open_dataset html
read_delim_arrow html
read_feather html
read_ipc_stream html
read_json_arrow html
read_message html
read_parquet html
read_schema html
reexports html
Rd warning: /tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/man/reexports.Rd:26: file link ‘starts_with’ in package ‘tidyselect’ does not exist and so has been treated as a topic
Rd warning: /tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/man/reexports.Rd:26: file link ‘everything’ in package ‘tidyselect’ does not exist and so has been treated as a topic
Rd warning: /tmp/RtmpnECges/R.INSTALL437112f5bd0/arrow/man/reexports.Rd:26: file link ‘one_of’ in package ‘tidyselect’ does not exist and so has been treated as a topic
s3_bucket html
type html
unify_schemas html
write_dataset html
write_feather html
write_ipc_stream html
write_parquet html
write_to_raw html
** building package indices
** installing vignettes
** testing if installed package can be loaded from temporary location
** checking absolute paths in shared objects and dynamic libraries
** testing if installed package can be loaded from final location
** testing if installed package keeps a record of temporary installation path
* DONE (arrow)
Warning in file.create(f.tg) :
cannot create file '/usr/share/doc/R-3.6.0/html/packages.html', reason 'No such file or directory'
Warning in utils::make.packages.html(.Library, docdir = R.home("doc")) :
cannot update HTML package index
[root@3800c0c7ea36 tmp]#
Jonathan Keane / @jonkeane: Hello, did you enable the devtoolset-8 (either for this session or system wide) before running the build? The line below shows that the build process isn't picking up the newer version of gcc which is required for S3 support. As a side not here, you might also need to install CURL and OpenSSL as dependencies if they aren't already, if they aren't installed you'll get similar messages saying that those are needed to enable S3 support see: https://arrow.apache.org/docs/r/articles/install.html#s3-support).
**** S3 support not available for gcc < 4.9; building with ARROW_S3=OFFAs to the github downloads: it looks from those logs you're getting a 403 forbidden on those URLs which is surprising — they are release artifacts which are totally public and I have tried them in an entirely un-authenticated session and can get them just fine. Is it possible that the machine / public IP you are on is making a large number of requests? If you can resolve this, the method of installation we've been using is definitely the way to go (compared to what I have below).
If you can't resolve the github issues, you could try to install the system dependencies you're having trouble downloading and then build libarrow separately in a way that the build process uses your system dependencies (e.g. with the cmake flag -DARROW_DEPENDENCY_SOURCE=AUTO, see https://arrow.apache.org/docs/developers/cpp/building.html#build-dependency-management for details on how arrow does dependency management during this process, and the rest of the page has more detailed information for how to build libarrow itself). https://arrow.apache.org/docs/r/articles/install.html has more information about how to link the r package against this built version of libarrow (along with a few options for how/where to install it, etc.). I'll reiterate though that if you can resolve why you're getting 403s the first process will be much easier and more straightforward for you.
asfimport
commented
3 years ago Karthikeyan Janakiraman: Thanks for the suggestion, It looks like our Org is blocking public github access from CLI for security reasons. I will try to get an exception, however it will be great if we could manually download the dependencies like jemalloc and put it somewhere so the installation can use it from there rather than trying to download from github.
asfimport
commented
3 years ago Karthikeyan Janakiraman: I need to use https://arrow.apache.org/docs/developers/cpp/building.html#offline-builds but I couldn't use script thirdparty/download_dependencies.sh which again uses wget to download the packages from github and fails with 403.
It will be really great if you could point me to examples of using "ARROW_$LIBRARY_URL" from the offline build procedure then I can manually download the package so the installation can use it from local.
say for example for JEMALLOC should I set env as ARROW_JEMALLOC_URL=/path/to/jemalloc-5.2.1.tar.bz2 ?
Unfortunately public github access is blocked on my end for security reasons so I will have to workaround this. Appreciate your help.
asfimport
commented
3 years ago Karthikeyan Janakiraman: @jonkeane I think I am almost there after manually downloading the binaries and setting the URL variables.
Currently struck at awssdk_ep-build related error, logs doesn't help much. Could you please advise what could resolve this please ?
[root@ea90f76f63be app]# R CMD INSTALL arrow_3.0.0.tar.gz
* installing to library ‘/usr/lib64/R/library’
* installing *source* package ‘arrow’ ...
** package ‘arrow’ successfully unpacked and MD5 sums checked
** using staged installation
trying URL 'https://dl.bintray.com/ursalabs/arrow-r/libarrow/src/arrow-3.0.0.zip'
Error in download.file(from_url, to_file, quiet = quietly) :
cannot open URL 'https://dl.bintray.com/ursalabs/arrow-r/libarrow/src/arrow-3.0.0.zip'
trying URL 'https://www.apache.org/dyn/closer.lua?action=download&filename=arrow/arrow-3.0.0/apache-arrow-3.0.0.tar.gz'
Content type 'application/x-gzip' length 8200790 bytes (7.8 MB)
==================================================
downloaded 7.8 MB*** Successfully retrieved C++ source
*** Building C++ libraries
*** Building with MAKEFLAGS= -j2
**** arrow with SOURCE_DIR="/tmp/Rtmpz4nE7G/file591d7022962e/apache-arrow-3.0.0/cpp" BUILD_DIR="/tmp/Rtmpz4nE7G/file591d48481e24" DEST_DIR="libarrow/arrow-3.0.0" CMAKE="/usr/bin/cmake3" CC="gcc -m64 -std=gnu99" CXX="g++ -m64 -std=gnu++11" LDFLAGS="-Wl,-z,relro" ARROW_S3=ON ARROW_MIMALLOC=OFF
++ pwd
+ : /tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow
+ : /tmp/Rtmpz4nE7G/file591d7022962e/apache-arrow-3.0.0/cpp
+ : /tmp/Rtmpz4nE7G/file591d48481e24
+ : libarrow/arrow-3.0.0
+ : /usr/bin/cmake3
++ cd /tmp/Rtmpz4nE7G/file591d7022962e/apache-arrow-3.0.0/cpp
++ pwd
+ SOURCE_DIR=/tmp/Rtmpz4nE7G/file591d7022962e/apache-arrow-3.0.0/cpp
++ mkdir -p libarrow/arrow-3.0.0
++ cd libarrow/arrow-3.0.0
++ pwd
+ DEST_DIR=/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0
+ '[' '' = '' ']'
+ which ninja
+ '[' '' = false ']'
+ ARROW_DEFAULT_PARAM=OFF
+ mkdir -p /tmp/Rtmpz4nE7G/file591d48481e24
+ pushd /tmp/Rtmpz4nE7G/file591d48481e24
/tmp/Rtmpz4nE7G/file591d48481e24 /tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow
+ /usr/bin/cmake3 -DARROW_BOOST_USE_SHARED=OFF -DARROW_BUILD_TESTS=OFF -DARROW_BUILD_SHARED=OFF -DARROW_BUILD_STATIC=ON -DARROW_COMPUTE=ON -DARROW_CSV=ON -DARROW_DATASET=ON -DARROW_DEPENDENCY_SOURCE=BUNDLED -DARROW_FILESYSTEM=ON -DARROW_JEMALLOC=ON -DARROW_MIMALLOC=OFF -DARROW_JSON=ON -DARROW_PARQUET=ON -DARROW_S3=ON -DARROW_WITH_BROTLI=OFF -DARROW_WITH_BZ2=OFF -DARROW_WITH_LZ4=OFF -DARROW_WITH_SNAPPY=OFF -DARROW_WITH_UTF8PROC=OFF -DARROW_WITH_ZLIB=OFF -DARROW_WITH_ZSTD=OFF -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_LIBDIR=lib -DCMAKE_INSTALL_PREFIX=/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0 -DCMAKE_EXPORT_NO_PACKAGE_REGISTRY=ON -DCMAKE_FIND_PACKAGE_NO_PACKAGE_REGISTRY=ON -DCMAKE_UNITY_BUILD=ON -G 'Unix Makefiles' /tmp/Rtmpz4nE7G/file591d7022962e/apache-arrow-3.0.0/cpp
-- Building using CMake version: 3.17.5
-- The C compiler identification is GNU 8.3.1
-- The CXX compiler identification is GNU 8.3.1
-- Check for working C compiler: /opt/rh/devtoolset-8/root/usr/bin/gcc
-- Check for working C compiler: /opt/rh/devtoolset-8/root/usr/bin/gcc - works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /opt/rh/devtoolset-8/root/usr/bin/g++
-- Check for working CXX compiler: /opt/rh/devtoolset-8/root/usr/bin/g++ - works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Arrow version: 3.0.0 (full: '3.0.0')
-- Arrow SO version: 300 (full: 300.0.0)
-- clang-tidy not found
-- clang-format not found
-- Could NOT find ClangTools (missing: CLANG_FORMAT_BIN CLANG_TIDY_BIN)
-- infer not found
fatal: Not a git repository (or any of the parent directories): .git
-- Found Python3: /opt/anaconda3-4.4.0/bin/python3.6 (found version "3.6.1") found components: Interpreter
-- Found cpplint executable at /tmp/Rtmpz4nE7G/file591d7022962e/apache-arrow-3.0.0/cpp/build-support/cpplint.py
-- System processor: x86_64
-- Performing Test CXX_SUPPORTS_SSE4_2
-- Performing Test CXX_SUPPORTS_SSE4_2 - Success
-- Performing Test CXX_SUPPORTS_AVX2
-- Performing Test CXX_SUPPORTS_AVX2 - Success
-- Performing Test CXX_SUPPORTS_AVX512
-- Performing Test CXX_SUPPORTS_AVX512 - Success
-- Arrow build warning level: PRODUCTION
Using ld linker
Configured for RELEASE build (set with cmake -DCMAKE_BUILD_TYPE={release,debug,...})
-- Build Type: RELEASE
-- Using BUNDLED approach to find dependencies
-- ARROW_ABSL_BUILD_VERSION: 0f3bb466b868b523cf1dc9b2aaaed65c77b28862
-- ARROW_AWSSDK_BUILD_VERSION: 1.8.90
-- ARROW_AWS_CHECKSUMS_BUILD_VERSION: v0.1.5
-- ARROW_AWS_C_COMMON_BUILD_VERSION: v0.4.59
-- ARROW_AWS_C_EVENT_STREAM_BUILD_VERSION: v0.1.5
-- ARROW_BOOST_BUILD_VERSION: 1.71.0
-- ARROW_BROTLI_BUILD_VERSION: v1.0.7
-- ARROW_BZIP2_BUILD_VERSION: 1.0.8
-- ARROW_CARES_BUILD_VERSION: 1.16.1
-- ARROW_GBENCHMARK_BUILD_VERSION: v1.5.2
-- ARROW_GFLAGS_BUILD_VERSION: v2.2.2
-- ARROW_GLOG_BUILD_VERSION: v0.4.0
-- ARROW_GRPC_BUILD_VERSION: v1.33.2
-- ARROW_GTEST_BUILD_VERSION: 1.10.0
-- ARROW_JEMALLOC_BUILD_VERSION: 5.2.1
-- ARROW_LZ4_BUILD_VERSION: v1.9.2
-- ARROW_MIMALLOC_BUILD_VERSION: v1.6.4
-- ARROW_ORC_BUILD_VERSION: 1.6.2
-- ARROW_PROTOBUF_BUILD_VERSION: v3.13.0
-- ARROW_RAPIDJSON_BUILD_VERSION: 1a803826f1197b5e30703afe4b9c0e7dd48074f5
-- ARROW_RE2_BUILD_VERSION: 2019-08-01
-- ARROW_SNAPPY_BUILD_VERSION: 1.1.8
-- ARROW_THRIFT_BUILD_VERSION: 0.12.0
-- ARROW_THRIFT_BUILD_MD5_CHECKSUM: 3deebbb4d1ca77dd9c9e009a1ea02183
-- ARROW_UTF8PROC_BUILD_VERSION: v2.5.0
-- ARROW_ZLIB_BUILD_VERSION: 1.2.11
-- ARROW_ZSTD_BUILD_VERSION: v1.4.5
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Check if compiler accepts -pthread
-- Check if compiler accepts -pthread - yes
-- Found Threads: TRUE
-- Looking for __SIZEOF_INT128__
-- Looking for __SIZEOF_INT128__ - found
-- Boost include dir: /tmp/Rtmpz4nE7G/file591d48481e24/boost_ep-prefix/src/boost_ep
-- Boost libraries: boost_system_static;boost_filesystem_static
-- Found OpenSSL: /usr/lib64/libcrypto.so (found suitable version "1.0.2k", minimum required is "1.0.2")
-- Found OpenSSL Crypto Library: /usr/lib64/libcrypto.so
-- Building with OpenSSL (Version: 1.0.2k) support
Building Apache Thrift from source
-- Building (vendored) jemalloc from source
-- Building RapidJSON from source
-- Building ZLIB from source
-- Building RE2 from source
-- Found hdfs.h at: /tmp/Rtmpz4nE7G/file591d7022962e/apache-arrow-3.0.0/cpp/thirdparty/hadoop/include/hdfs.h
Building AWS C++ SDK from source
-- Found CURL: /usr/lib64/libcurl.so (found version "7.29.0")
-- Found AWS SDK headers: /tmp/Rtmpz4nE7G/file591d48481e24/awssdk_ep-install/include
-- Found AWS SDK libraries: aws-cpp-sdk-identity-management;aws-cpp-sdk-sts;aws-cpp-sdk-cognito-identity;aws-cpp-sdk-s3;aws-cpp-sdk-core;AWS::aws-c-event-stream;AWS::aws-checksums;AWS::aws-c-common
-- All bundled static libraries: thrift::thrift;jemalloc::jemalloc;ZLIB::ZLIB;re2::re2;aws-cpp-sdk-identity-management;aws-cpp-sdk-sts;aws-cpp-sdk-cognito-identity;aws-cpp-sdk-s3;aws-cpp-sdk-core;AWS::aws-c-event-stream;AWS::aws-checksums;AWS::aws-c-common
-- CMAKE_C_FLAGS: -O3 -DNDEBUG -Wall -fno-semantic-interposition -msse4.2
-- CMAKE_CXX_FLAGS: -Wno-noexcept-type -Wno-subobject-linkage -fdiagnostics-color=always -O3 -DNDEBUG -Wall -fno-semantic-interposition -msse4.2
-- Looking for backtrace
-- Looking for backtrace - found
-- backtrace facility detected in default set of libraries
-- Found Backtrace: /usr/include
-- Creating bundled static library target arrow_bundled_dependencies at /tmp/Rtmpz4nE7G/file591d48481e24/release/libarrow_bundled_dependencies.a
-- ---------------------------------------------------------------------
-- Arrow version: 3.0.0
--
-- Build configuration summary:
-- Generator: Unix Makefiles
-- Build type: RELEASE
-- Source directory: /tmp/Rtmpz4nE7G/file591d7022962e/apache-arrow-3.0.0/cpp
-- Install prefix: /tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0
--
-- Compile and link options:
--
-- ARROW_CXXFLAGS="" [default=""]
-- Compiler flags to append when compiling Arrow
-- ARROW_BUILD_STATIC=ON [default=ON]
-- Build static libraries
-- ARROW_BUILD_SHARED=OFF [default=ON]
-- Build shared libraries
-- ARROW_PACKAGE_KIND="" [default=""]
-- Arbitrary string that identifies the kind of package
-- (for informational purposes)
-- ARROW_GIT_ID="" [default=""]
-- The Arrow git commit id (if any)
-- ARROW_GIT_DESCRIPTION="" [default=""]
-- The Arrow git commit description (if any)
-- ARROW_NO_DEPRECATED_API=OFF [default=OFF]
-- Exclude deprecated APIs from build
-- ARROW_USE_CCACHE=ON [default=ON]
-- Use ccache when compiling (if available)
-- ARROW_USE_LD_GOLD=OFF [default=OFF]
-- Use ld.gold for linking on Linux (if available)
-- ARROW_USE_PRECOMPILED_HEADERS=OFF [default=OFF]
-- Use precompiled headers when compiling
-- ARROW_SIMD_LEVEL=SSE4_2 [default=NONE|SSE4_2|AVX2|AVX512]
-- Compile-time SIMD optimization level
-- ARROW_RUNTIME_SIMD_LEVEL=MAX [default=NONE|SSE4_2|AVX2|AVX512|MAX]
-- Max runtime SIMD optimization level
-- ARROW_ARMV8_ARCH=armv8-a [default=armv8-a|armv8-a+crc+crypto]
-- Arm64 arch and extensions
-- ARROW_ALTIVEC=ON [default=ON]
-- Build with Altivec if compiler has support
-- ARROW_RPATH_ORIGIN=OFF [default=OFF]
-- Build Arrow libraries with RATH set to $ORIGIN
-- ARROW_INSTALL_NAME_RPATH=ON [default=ON]
-- Build Arrow libraries with install_name set to @rpath
-- ARROW_GGDB_DEBUG=ON [default=ON]
-- Pass -ggdb flag to debug builds
--
-- Test and benchmark options:
--
-- ARROW_BUILD_EXAMPLES=OFF [default=OFF]
-- Build the Arrow examples
-- ARROW_BUILD_TESTS=OFF [default=OFF]
-- Build the Arrow googletest unit tests
-- ARROW_ENABLE_TIMING_TESTS=ON [default=ON]
-- Enable timing-sensitive tests
-- ARROW_BUILD_INTEGRATION=OFF [default=OFF]
-- Build the Arrow integration test executables
-- ARROW_BUILD_BENCHMARKS=OFF [default=OFF]
-- Build the Arrow micro benchmarks
-- ARROW_BUILD_BENCHMARKS_REFERENCE=OFF [default=OFF]
-- Build the Arrow micro reference benchmarks
-- ARROW_TEST_LINKAGE=static [default=shared|static]
-- Linkage of Arrow libraries with unit tests executables.
-- ARROW_FUZZING=OFF [default=OFF]
-- Build Arrow Fuzzing executables
-- ARROW_LARGE_MEMORY_TESTS=OFF [default=OFF]
-- Enable unit tests which use large memory
--
-- Lint options:
--
-- ARROW_ONLY_LINT=OFF [default=OFF]
-- Only define the lint and check-format targets
-- ARROW_VERBOSE_LINT=OFF [default=OFF]
-- If off, 'quiet' flags will be passed to linting tools
-- ARROW_GENERATE_COVERAGE=OFF [default=OFF]
-- Build with C++ code coverage enabled
--
-- Checks options:
--
-- ARROW_TEST_MEMCHECK=OFF [default=OFF]
-- Run the test suite using valgrind --tool=memcheck
-- ARROW_USE_ASAN=OFF [default=OFF]
-- Enable Address Sanitizer checks
-- ARROW_USE_TSAN=OFF [default=OFF]
-- Enable Thread Sanitizer checks
-- ARROW_USE_UBSAN=OFF [default=OFF]
-- Enable Undefined Behavior sanitizer checks
--
-- Project component options:
--
-- ARROW_BUILD_UTILITIES=OFF [default=OFF]
-- Build Arrow commandline utilities
-- ARROW_COMPUTE=ON [default=OFF]
-- Build the Arrow Compute Modules
-- ARROW_CSV=ON [default=OFF]
-- Build the Arrow CSV Parser Module
-- ARROW_CUDA=OFF [default=OFF]
-- Build the Arrow CUDA extensions (requires CUDA toolkit)
-- ARROW_DATASET=ON [default=OFF]
-- Build the Arrow Dataset Modules
-- ARROW_FILESYSTEM=ON [default=OFF]
-- Build the Arrow Filesystem Layer
-- ARROW_FLIGHT=OFF [default=OFF]
-- Build the Arrow Flight RPC System (requires GRPC, Protocol Buffers)
-- ARROW_GANDIVA=OFF [default=OFF]
-- Build the Gandiva libraries
-- ARROW_HDFS=OFF [default=OFF]
-- Build the Arrow HDFS bridge
-- ARROW_HIVESERVER2=OFF [default=OFF]
-- Build the HiveServer2 client and Arrow adapter
-- ARROW_IPC=ON [default=ON]
-- Build the Arrow IPC extensions
-- ARROW_JEMALLOC=ON [default=ON]
-- Build the Arrow jemalloc-based allocator
-- ARROW_JNI=OFF [default=OFF]
-- Build the Arrow JNI lib
-- ARROW_JSON=ON [default=OFF]
-- Build Arrow with JSON support (requires RapidJSON)
-- ARROW_MIMALLOC=OFF [default=OFF]
-- Build the Arrow mimalloc-based allocator
-- ARROW_PARQUET=ON [default=OFF]
-- Build the Parquet libraries
-- ARROW_ORC=OFF [default=OFF]
-- Build the Arrow ORC adapter
-- ARROW_PLASMA=OFF [default=OFF]
-- Build the plasma object store along with Arrow
-- ARROW_PLASMA_JAVA_CLIENT=OFF [default=OFF]
-- Build the plasma object store java client
-- ARROW_PYTHON=OFF [default=OFF]
-- Build the Arrow CPython extensions
-- ARROW_S3=ON [default=OFF]
-- Build Arrow with S3 support (requires the AWS SDK for C++)
-- ARROW_TENSORFLOW=OFF [default=OFF]
-- Build Arrow with TensorFlow support enabled
-- ARROW_TESTING=OFF [default=OFF]
-- Build the Arrow testing libraries
--
-- Thirdparty toolchain options:
--
-- ARROW_DEPENDENCY_SOURCE=BUNDLED [default=AUTO|BUNDLED|SYSTEM|CONDA|BREW]
-- Method to use for acquiring arrow's build dependencies
-- ARROW_VERBOSE_THIRDPARTY_BUILD=OFF [default=OFF]
-- Show output from ExternalProjects rather than just logging to files
-- ARROW_DEPENDENCY_USE_SHARED=ON [default=ON]
-- Link to shared libraries
-- ARROW_BOOST_USE_SHARED=OFF [default=ON]
-- Rely on boost shared libraries where relevant
-- ARROW_BROTLI_USE_SHARED=ON [default=ON]
-- Rely on Brotli shared libraries where relevant
-- ARROW_BZ2_USE_SHARED=ON [default=ON]
-- Rely on Bz2 shared libraries where relevant
-- ARROW_GFLAGS_USE_SHARED=ON [default=ON]
-- Rely on GFlags shared libraries where relevant
-- ARROW_GRPC_USE_SHARED=ON [default=ON]
-- Rely on gRPC shared libraries where relevant
-- ARROW_LZ4_USE_SHARED=ON [default=ON]
-- Rely on lz4 shared libraries where relevant
-- ARROW_OPENSSL_USE_SHARED=ON [default=ON]
-- Rely on OpenSSL shared libraries where relevant
-- ARROW_PROTOBUF_USE_SHARED=ON [default=ON]
-- Rely on Protocol Buffers shared libraries where relevant
-- ARROW_THRIFT_USE_SHARED=ON [default=ON]
-- Rely on thrift shared libraries where relevant
-- ARROW_UTF8PROC_USE_SHARED=ON [default=ON]
-- Rely on utf8proc shared libraries where relevant
-- ARROW_SNAPPY_USE_SHARED=ON [default=ON]
-- Rely on snappy shared libraries where relevant
-- ARROW_UTF8PROC_USE_SHARED=ON [default=ON]
-- Rely on utf8proc shared libraries where relevant
-- ARROW_ZSTD_USE_SHARED=ON [default=ON]
-- Rely on zstd shared libraries where relevant
-- ARROW_USE_GLOG=OFF [default=OFF]
-- Build libraries with glog support for pluggable logging
-- ARROW_WITH_BACKTRACE=ON [default=ON]
-- Build with backtrace support
-- ARROW_WITH_BROTLI=OFF [default=OFF]
-- Build with Brotli compression
-- ARROW_WITH_BZ2=OFF [default=OFF]
-- Build with BZ2 compression
-- ARROW_WITH_LZ4=OFF [default=OFF]
-- Build with lz4 compression
-- ARROW_WITH_SNAPPY=OFF [default=OFF]
-- Build with Snappy compression
-- ARROW_WITH_ZLIB=ON [default=OFF]
-- Build with zlib compression
-- ARROW_WITH_ZSTD=OFF [default=OFF]
-- Build with zstd compression
-- ARROW_WITH_UTF8PROC=OFF [default=ON]
-- Build with support for Unicode properties using the utf8proc library
-- (only used if ARROW_COMPUTE is ON)
-- ARROW_WITH_RE2=ON [default=ON]
-- Build with support for regular expressions using the re2 library
-- (only used if ARROW_COMPUTE or ARROW_GANDIVA is ON)
--
-- Parquet options:
--
-- PARQUET_MINIMAL_DEPENDENCY=OFF [default=OFF]
-- Depend only on Thirdparty headers to build libparquet.
-- Always OFF if building binaries
-- PARQUET_BUILD_EXECUTABLES=OFF [default=OFF]
-- Build the Parquet executable CLI tools. Requires static libraries to be built.
-- PARQUET_BUILD_EXAMPLES=OFF [default=OFF]
-- Build the Parquet examples. Requires static libraries to be built.
-- PARQUET_REQUIRE_ENCRYPTION=OFF [default=OFF]
-- Build support for encryption. Fail if OpenSSL is not found
--
-- Gandiva options:
--
-- ARROW_GANDIVA_JAVA=OFF [default=OFF]
-- Build the Gandiva JNI wrappers
-- ARROW_GANDIVA_STATIC_LIBSTDCPP=OFF [default=OFF]
-- Include -static-libstdc++ -static-libgcc when linking with
-- Gandiva static libraries
-- ARROW_GANDIVA_PC_CXX_FLAGS="" [default=""]
-- Compiler flags to append when pre-compiling Gandiva operations
--
-- Advanced developer options:
--
-- ARROW_EXTRA_ERROR_CONTEXT=OFF [default=OFF]
-- Compile with extra error context (line numbers, code)
-- ARROW_OPTIONAL_INSTALL=OFF [default=OFF]
-- If enabled install ONLY targets that have already been built. Please be
-- advised that if this is enabled 'install' will fail silently on components
-- that have not been built
-- Outputting build configuration summary to /tmp/Rtmpz4nE7G/file591d48481e24/cmake_summary.json
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/Rtmpz4nE7G/file591d48481e24
+ /usr/bin/cmake3 --build . --target install
Scanning dependencies of target boost_ep
Scanning dependencies of target jemalloc_ep
[ 2%] Creating directories for 'boost_ep'
[ 2%] Creating directories for 'jemalloc_ep'
[ 3%] Performing download step (verify and extract) for 'boost_ep'
[ 4%] Performing download step (verify and extract) for 'jemalloc_ep'
-- jemalloc_ep download command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-download-*.log
[ 5%] Performing patch step for 'jemalloc_ep'
[ 6%] No update step for 'jemalloc_ep'
[ 7%] Performing configure step for 'jemalloc_ep'
-- boost_ep download command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/boost_ep-prefix/src/boost_ep-stamp/boost_ep-download-*.log
[ 8%] No patch step for 'boost_ep'
[ 8%] No update step for 'boost_ep'
[ 9%] No configure step for 'boost_ep'
[ 10%] No build step for 'boost_ep'
[ 11%] No install step for 'boost_ep'
[ 12%] Completed 'boost_ep'
[ 12%] Built target boost_ep
Scanning dependencies of target rapidjson_ep
[ 13%] Creating directories for 'rapidjson_ep'
[ 13%] Performing download step (verify and extract) for 'rapidjson_ep'
-- rapidjson_ep download command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/src/rapidjson_ep-stamp/rapidjson_ep-download-*.log
[ 14%] No patch step for 'rapidjson_ep'
[ 15%] No update step for 'rapidjson_ep'
[ 16%] Performing configure step for 'rapidjson_ep'
-- rapidjson_ep configure command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/src/rapidjson_ep-stamp/rapidjson_ep-configure-*.log
[ 17%] Performing build step for 'rapidjson_ep'
-- rapidjson_ep build command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/src/rapidjson_ep-stamp/rapidjson_ep-build-*.log
[ 18%] Performing install step for 'rapidjson_ep'
-- rapidjson_ep install command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/src/rapidjson_ep-stamp/rapidjson_ep-install-*.log
[ 19%] Completed 'rapidjson_ep'
[ 19%] Built target rapidjson_ep
Scanning dependencies of target aws_c_common_ep
[ 20%] Creating directories for 'aws_c_common_ep'
[ 21%] Performing download step (verify and extract) for 'aws_c_common_ep'
-- aws_c_common_ep download command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/aws_c_common_ep-prefix/src/aws_c_common_ep-stamp/aws_c_common_ep-download-*.log
[ 22%] No patch step for 'aws_c_common_ep'
[ 23%] No update step for 'aws_c_common_ep'
[ 24%] Performing configure step for 'aws_c_common_ep'
-- aws_c_common_ep configure command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/aws_c_common_ep-prefix/src/aws_c_common_ep-stamp/aws_c_common_ep-configure-*.log
[ 24%] Performing build step for 'aws_c_common_ep'
-- jemalloc_ep configure command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure-*.log
[ 24%] Performing build step for 'jemalloc_ep'
-- aws_c_common_ep build command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/aws_c_common_ep-prefix/src/aws_c_common_ep-stamp/aws_c_common_ep-build-*.log
[ 24%] Performing install step for 'aws_c_common_ep'
-- aws_c_common_ep install command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/aws_c_common_ep-prefix/src/aws_c_common_ep-stamp/aws_c_common_ep-install-*.log
[ 25%] Completed 'aws_c_common_ep'
[ 25%] Built target aws_c_common_ep
Scanning dependencies of target aws_checksums_ep
[ 25%] Creating directories for 'aws_checksums_ep'
[ 26%] Performing download step (verify and extract) for 'aws_checksums_ep'
-- aws_checksums_ep download command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/aws_checksums_ep-prefix/src/aws_checksums_ep-stamp/aws_checksums_ep-download-*.log
[ 27%] No patch step for 'aws_checksums_ep'
[ 28%] No update step for 'aws_checksums_ep'
[ 29%] Performing configure step for 'aws_checksums_ep'
-- aws_checksums_ep configure command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/aws_checksums_ep-prefix/src/aws_checksums_ep-stamp/aws_checksums_ep-configure-*.log
[ 30%] Performing build step for 'aws_checksums_ep'
-- aws_checksums_ep build command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/aws_checksums_ep-prefix/src/aws_checksums_ep-stamp/aws_checksums_ep-build-*.log
[ 31%] Performing install step for 'aws_checksums_ep'
-- aws_checksums_ep install command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/aws_checksums_ep-prefix/src/aws_checksums_ep-stamp/aws_checksums_ep-install-*.log
[ 32%] Completed 'aws_checksums_ep'
[ 32%] Built target aws_checksums_ep
Scanning dependencies of target zlib_ep
[ 32%] Creating directories for 'zlib_ep'
[ 33%] Performing download step (download, verify and extract) for 'zlib_ep'
-- zlib_ep download command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/zlib_ep-prefix/src/zlib_ep-stamp/zlib_ep-download-*.log
[ 34%] No patch step for 'zlib_ep'
[ 35%] No update step for 'zlib_ep'
[ 36%] Performing configure step for 'zlib_ep'
-- zlib_ep configure command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/zlib_ep-prefix/src/zlib_ep-stamp/zlib_ep-configure-*.log
[ 37%] Performing build step for 'zlib_ep'
-- zlib_ep build command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/zlib_ep-prefix/src/zlib_ep-stamp/zlib_ep-build-*.log
[ 38%] Performing install step for 'zlib_ep'
-- zlib_ep install command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/zlib_ep-prefix/src/zlib_ep-stamp/zlib_ep-install-*.log
[ 39%] Completed 'zlib_ep'
[ 39%] Built target zlib_ep
Scanning dependencies of target re2_ep
[ 40%] Creating directories for 're2_ep'
[ 41%] Performing download step (verify and extract) for 're2_ep'
-- re2_ep download command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/re2_ep-prefix/src/re2_ep-stamp/re2_ep-download-*.log
[ 42%] No patch step for 're2_ep'
[ 43%] No update step for 're2_ep'
[ 43%] Performing configure step for 're2_ep'
-- re2_ep configure command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/re2_ep-prefix/src/re2_ep-stamp/re2_ep-configure-*.log
[ 44%] Performing build step for 're2_ep'
-- jemalloc_ep build command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-build-*.log
[ 44%] Performing install step for 'jemalloc_ep'
-- jemalloc_ep install command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-install-*.log
[ 45%] Completed 'jemalloc_ep'
[ 45%] Built target jemalloc_ep
Scanning dependencies of target arrow_dataset_objlib
[ 46%] Building CXX object src/arrow/dataset/CMakeFiles/arrow_dataset_objlib.dir/Unity/unity_1_cxx.cxx.o
[ 47%] Building CXX object src/arrow/dataset/CMakeFiles/arrow_dataset_objlib.dir/Unity/unity_0_cxx.cxx.o
-- re2_ep build command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/re2_ep-prefix/src/re2_ep-stamp/re2_ep-build-*.log
[ 48%] Performing install step for 're2_ep'
-- re2_ep install command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/re2_ep-prefix/src/re2_ep-stamp/re2_ep-install-*.log
[ 48%] Completed 're2_ep'
[ 48%] Built target re2_ep
Scanning dependencies of target thrift_ep
[ 49%] Creating directories for 'thrift_ep'
[ 50%] Performing download step (verify and extract) for 'thrift_ep'
-- thrift_ep download command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-download-*.log
[ 51%] No patch step for 'thrift_ep'
[ 51%] No update step for 'thrift_ep'
[ 52%] Performing configure step for 'thrift_ep'
-- thrift_ep configure command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-configure-*.log
[ 53%] Performing build step for 'thrift_ep'
[ 53%] Built target arrow_dataset_objlib
Scanning dependencies of target aws_c_event_stream_ep
[ 54%] Creating directories for 'aws_c_event_stream_ep'
[ 55%] Performing download step (verify and extract) for 'aws_c_event_stream_ep'
-- aws_c_event_stream_ep download command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/aws_c_event_stream_ep-prefix/src/aws_c_event_stream_ep-stamp/aws_c_event_stream_ep-download-*.log
[ 55%] No patch step for 'aws_c_event_stream_ep'
[ 56%] No update step for 'aws_c_event_stream_ep'
[ 57%] Performing configure step for 'aws_c_event_stream_ep'
-- aws_c_event_stream_ep configure command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/aws_c_event_stream_ep-prefix/src/aws_c_event_stream_ep-stamp/aws_c_event_stream_ep-configure-*.log
[ 58%] Performing build step for 'aws_c_event_stream_ep'
-- aws_c_event_stream_ep build command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/aws_c_event_stream_ep-prefix/src/aws_c_event_stream_ep-stamp/aws_c_event_stream_ep-build-*.log
[ 59%] Performing install step for 'aws_c_event_stream_ep'
-- aws_c_event_stream_ep install command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/aws_c_event_stream_ep-prefix/src/aws_c_event_stream_ep-stamp/aws_c_event_stream_ep-install-*.log
[ 60%] Completed 'aws_c_event_stream_ep'
[ 60%] Built target aws_c_event_stream_ep
Scanning dependencies of target awssdk_ep
[ 61%] Creating directories for 'awssdk_ep'
[ 62%] Performing download step (verify and extract) for 'awssdk_ep'
-- awssdk_ep download command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/awssdk_ep-prefix/src/awssdk_ep-stamp/awssdk_ep-download-*.log
[ 63%] No patch step for 'awssdk_ep'
[ 64%] No update step for 'awssdk_ep'
[ 64%] Performing configure step for 'awssdk_ep'
-- awssdk_ep configure command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/awssdk_ep-prefix/src/awssdk_ep-stamp/awssdk_ep-configure-*.log
[ 65%] Performing build step for 'awssdk_ep'
-- thrift_ep build command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-*.log
[ 66%] Performing install step for 'thrift_ep'
-- thrift_ep install command succeeded. See also /tmp/Rtmpz4nE7G/file591d48481e24/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-install-*.log
[ 67%] Completed 'thrift_ep'
[ 67%] Built target thrift_ep
CMake Error at /tmp/Rtmpz4nE7G/file591d48481e24/awssdk_ep-prefix/src/awssdk_ep-stamp/awssdk_ep-build-RELEASE.cmake:37 (message):
Command failed: 2 'make' See also /tmp/Rtmpz4nE7G/file591d48481e24/awssdk_ep-prefix/src/awssdk_ep-stamp/awssdk_ep-build-*.log
-- stdout output is:
Scanning dependencies of target aws-cpp-sdk-core
[ 2%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/ub_core.cpp.o
[ 4%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/external/cjson/cJSON.cpp.o
[ 6%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/http/HttpClient.cpp.o
[ 8%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/http/HttpClientFactory.cpp.o
[ 10%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/http/HttpRequest.cpp.o
[ 12%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/http/HttpTypes.cpp.o
[ 14%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/http/Scheme.cpp.o
[ 16%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/http/URI.cpp.o
[ 18%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/http/curl/CurlHandleContainer.cpp.o
[ 20%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/http/curl/CurlHttpClient.cpp.o
[ 22%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/net/linux-shared/Net.cpp.o
[ 25%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/net/linux-shared/SimpleUDP.cpp.o
[ 27%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/Array.cpp.o
[ 29%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/DNS.cpp.o
[ 31%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/DateTimeCommon.cpp.o
[ 33%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/Directory.cpp.o
[ 35%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/EnumParseOverflowContainer.cpp.o
[ 37%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/FileSystemUtils.cpp.o
[ 39%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/GetTheLights.cpp.o
[ 41%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/HashingUtils.cpp.o
[ 43%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/StringUtils.cpp.o
[ 45%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/TempFile.cpp.o
[ 47%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/UUID.cpp.o
[ 50%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/crypto/factory/Factories.cpp.o
[ 52%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/event/EventDecoderStream.cpp.o
[ 54%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/event/EventEncoderStream.cpp.o
[ 56%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/event/EventHeader.cpp.o
[ 58%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/event/EventMessage.cpp.o
[ 60%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/event/EventStreamBuf.cpp.o
[ 62%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/event/EventStreamDecoder.cpp.o
[ 64%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/event/EventStreamEncoder.cpp.o
[ 66%] Building CXX object aws-cpp-sdk-core/CMakeFiles/aws-cpp-sdk-core.dir/source/utils/event/EventStreamErrors.cpp.o
[ 68%] Linking CXX static library libaws-cpp-sdk-core.a
[ 68%] Built target aws-cpp-sdk-core
Scanning dependencies of target aws-cpp-sdk-config
[ 70%] Building CXX object aws-cpp-sdk-config/CMakeFiles/aws-cpp-sdk-config.dir/ub_CONFIG.cpp.o
Scanning dependencies of target aws-cpp-sdk-s3
[ 72%] Building CXX object aws-cpp-sdk-s3/CMakeFiles/aws-cpp-sdk-s3.dir/ub_S3.cpp.o
[ 75%] Linking CXX static library libaws-cpp-sdk-config.a
[ 75%] Built target aws-cpp-sdk-config-- stderr output is:
g++: fatal error: Killed signal terminated program cc1plus
compilation terminated.
make[5]: *** [aws-cpp-sdk-s3/CMakeFiles/aws-cpp-sdk-s3.dir/build.make:84: aws-cpp-sdk-s3/CMakeFiles/aws-cpp-sdk-s3.dir/ub_S3.cpp.o] Error 1
make[4]: *** [CMakeFiles/Makefile2:295: aws-cpp-sdk-s3/CMakeFiles/aws-cpp-sdk-s3.dir/all] Error 2
make[4]: *** Waiting for unfinished jobs....
make[3]: *** [Makefile:150: all] Error 2CMake Error at /tmp/Rtmpz4nE7G/file591d48481e24/awssdk_ep-prefix/src/awssdk_ep-stamp/awssdk_ep-build-RELEASE.cmake:47 (message):
Stopping after outputting logs.
make[2]: *** [CMakeFiles/awssdk_ep.dir/build.make:134: awssdk_ep-prefix/src/awssdk_ep-stamp/awssdk_ep-build] Error 1
make[1]: *** [CMakeFiles/Makefile2:1048: CMakeFiles/awssdk_ep.dir/all] Error 2
gmake: *** [Makefile:161: all] Error 2
+ popd
/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow
PKG_CFLAGS=-I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW
PKG_LIBS=-larrow_dataset -lparquet -larrow
** libs
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c array.cpp -o array.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c array_from_vector.cpp -o array_from_vector.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c array_to_vector.cpp -o array_to_vector.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c arraydata.cpp -o arraydata.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c arrowExports.cpp -o arrowExports.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c buffer.cpp -o buffer.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c chunkedarray.cpp -o chunkedarray.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c compression.cpp -o compression.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c compute.cpp -o compute.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c csv.cpp -o csv.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c dataset.cpp -o dataset.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c datatype.cpp -o datatype.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c expression.cpp -o expression.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c feather.cpp -o feather.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c field.cpp -o field.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c filesystem.cpp -o filesystem.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c imports.cpp -o imports.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c io.cpp -o io.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c json.cpp -o json.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c memorypool.cpp -o memorypool.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c message.cpp -o message.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c parquet.cpp -o parquet.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c py-to-r.cpp -o py-to-r.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c recordbatch.cpp -o recordbatch.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c recordbatchreader.cpp -o recordbatchreader.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c recordbatchwriter.cpp -o recordbatchwriter.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c scalar.cpp -o scalar.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c schema.cpp -o schema.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c symbols.cpp -o symbols.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c table.cpp -o table.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I/tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW -I"/usr/lib64/R/library/cpp11/include" -I/usr/local/include -fpic -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -c threadpool.cpp -o threadpool.o
g++ -m64 -std=gnu++11 -shared -L/usr/lib64/R/lib -Wl,-z,relro -o arrow.so array.o array_from_vector.o array_to_vector.o arraydata.o arrowExports.o buffer.o chunkedarray.o compression.o compute.o csv.o dataset.o datatype.o expression.o feather.o field.o filesystem.o imports.o io.o json.o memorypool.o message.o parquet.o py-to-r.o recordbatch.o recordbatchreader.o recordbatchwriter.o scalar.o schema.o symbols.o table.o threadpool.o -larrow_dataset -lparquet -larrow -L/usr/lib64/R/lib -lR
installing to /usr/lib64/R/library/00LOCK-arrow/00new/arrow/libs
** R
** inst
** byte-compile and prepare package for lazy loading
** help
*** installing help indices
Warning in file.copy(file.path(R.home("doc"), "html", "R.css"), outman) :
problem copying /usr/share/doc/R-3.6.0/html/R.css to /usr/lib64/R/library/00LOCK-arrow/00new/arrow/html/R.css: No such file or directory
converting help for package ‘arrow’
finding HTML links ... done
ArrayData html
ChunkedArray html
Codec html
CsvReadOptions html
CsvTableReader html
DataType html
Dataset html
DictionaryType html
Expression html
FeatherReader html
Field html
FileFormat html
FileInfo html
FileSelector html
FileSystem html
FileWriteOptions html
FixedWidthType html
InputStream html
MemoryPool html
Message html
MessageReader html
OutputStream html
ParquetArrowReaderProperties html
ParquetFileReader html
ParquetFileWriter html
ParquetWriterProperties html
Partitioning html
RecordBatch html
RecordBatchReader html
RecordBatchWriter html
Scalar html
Scanner html
Schema html
Table html
array html
arrow-package html
arrow_available html
arrow_info html
buffer html
cast_options html
codec_is_available html
compression html
copy_files html
cpu_count html
data-type html
dataset_factory html
default_memory_pool html
dictionary html
enums html
flight_connect html
flight_get html
flight_put html
hive_partition html
install_arrow html
install_pyarrow html
list_flights html
load_flight_server html
make_readable_file html
map_batches html
match_arrow html
mmap_create html
mmap_open html
open_dataset html
read_delim_arrow html
read_feather html
read_ipc_stream html
read_json_arrow html
read_message html
read_parquet html
read_schema html
reexports html
Rd warning: /tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/man/reexports.Rd:26: file link ‘starts_with’ in package ‘tidyselect’ does not exist and so has been treated as a topic
Rd warning: /tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/man/reexports.Rd:26: file link ‘everything’ in package ‘tidyselect’ does not exist and so has been treated as a topic
Rd warning: /tmp/RtmpFGGUfi/R.INSTALL590815733f98/arrow/man/reexports.Rd:26: file link ‘one_of’ in package ‘tidyselect’ does not exist and so has been treated as a topic
s3_bucket html
type html
unify_schemas html
write_dataset html
write_feather html
write_ipc_stream html
write_parquet html
write_to_raw html
** building package indices
** installing vignettes
** testing if installed package can be loaded from temporary location
** checking absolute paths in shared objects and dynamic libraries
** testing if installed package can be loaded from final location
** testing if installed package keeps a record of temporary installation path
* DONE (arrow)
Warning in file.create(f.tg) :
cannot create file '/usr/share/doc/R-3.6.0/html/packages.html', reason 'No such file or directory'
Warning in utils::make.packages.html(.Library, docdir = R.home("doc")) :
cannot update HTML package index
[root@ea90f76f63be app]# cat /tmp/Rtmpz4nE7G/file591d48481e24/awssdk_ep-prefix/src/awssdk_ep-stamp/awssdk_ep-build-RELEASE.cmake
cat: /tmp/Rtmpz4nE7G/file591d48481e24/awssdk_ep-prefix/src/awssdk_ep-stamp/awssdk_ep-build-RELEASE.cmake: No such file or directory
[root@ea90f76f63be app]#Jonathan Keane / @jonkeane: It looks like a get things might actually be failing (or two of our dependencies depend on one common thing that is failing), I see both:
[ 67%] Built target thrift_ep
CMake Error at /tmp/Rtmpz4nE7G/file591d48481e24/awssdk_ep-prefix/src/awssdk_ep-stamp/awssdk_ep-build-RELEASE.cmake:37 (message):
Command failed: 2 'make' See also /tmp/Rtmpz4nE7G/file591d48481e24/awssdk_ep-prefix/src/awssdk_ep-stamp/awssdk_ep-build-*.log
-- stdout output is:
Scanning dependencies of target aws-cpp-sdk-coreAs well as
make[3]: *** [Makefile:150: all] Error 2CMake Error at /tmp/Rtmpz4nE7G/file591d48481e24/awssdk_ep-prefix/src/awssdk_ep-stamp/awssdk_ep-build-RELEASE.cmake:47 (message):
Stopping after outputting logs.
make[2]: *** [CMakeFiles/awssdk_ep.dir/build.make:134: awssdk_ep-prefix/src/awssdk_ep-stamp/awssdk_ep-build] Error 1
make[1]: *** [CMakeFiles/Makefile2:1048: CMakeFiles/awssdk_ep.dir/all] Error 2
gmake: *** [Makefile:161: all] Error 2As you note: the log files referenced are in temp directories that get wiped away as soon as the install finishes (this is the standard behavior from R, and not something that Arrow is doing).
There are a few things that you could do to try and figure out what's blocking this:
Happy to look through those logs if you can get them. Also, would you mind posting how you solved the directory envvars for posterity / to help others who might be in your position? Thanks!
Additionally: I'm not super familiar with centos, so this might be a total red herring, but for reference: we do test that one can build arrow on centos7 + devtoolset 8 and (our latest nightly does pass though that is not the exact same code as the 3.0.0 release you're working on, AFAIK it was passing then too). The way that we enable the devtoolset in that test is https://github.com/apache/arrow/blob/master/ci/scripts/r_test.sh#L57 which might be helpful for you to see/try if that's now how you're enabling it yourself. IIRC there are a number of different ways that can be enabled and I'm not sure if they all will work for this build setup.
asfimport
commented
3 years ago Neal Richardson / @nealrichardson: Yes, a dependency of aws-sdk-cpp is failing to link. You may want to check https://github.com/aws/aws-sdk-cpp/issues for any issues that sound like what you're experiencing.
You can also set -DARROW_VERBOSE_THIRDPARTY_BUILD=ON in the cmake build to print more from these bundled dependency builds. I'm not sure you'll get more useful detail this way in this case since you're already seeing the error and it's not very informative, but you can try.
asfimport
commented
3 years ago Karthikeyan Janakiraman: Thanks both, I dint make any changes to resolve AWS SDK issue however it went through fine on the next run. Which is worrying a bit since I am not sure if I will run into that again.
Directory envvars as requested by you @jonkeane,
ARROW_AWS_C_COMMON_URL=/tmp/arrow-build/aws-c-common-0.4.59.tar.gz
ARROW_AWSSDK_URL=/tmp/arrow-build/aws-sdk-cpp-1.7.160.tar.gz
ARROW_AWS_CHECKSUMS_URL=/tmp/arrow-build/aws-checksums-0.1.5.tar.gz
ARROW_DEPENDENCY_SOURCE=SYSTEM
ARROW_AWS_C_EVENT_STREAM_URL=/tmp/arrow-build/aws-c-event-stream-0.1.5.tar.gz
ARROW_VERBOSE_THIRDPARTY_BUILD=ON
ARROW_JEMALLOC_URL=/tmp/arrow-build/jemalloc-5.2.1.tar.bz2
ARROW_S3=ON
ARROW_THRIFT_URL=/tmp/arrow-build/thrift-0.12.0.tar.gz
ARROW_RAPIDJSON_URL=/tmp/arrow-build/rapidjson-2bbd33b33217ff4a73434ebf10cdac41e2ef5e34.tar.gz
ARROW_BOOST_URL=/tmp/arrow-build/boost_1_75_0.tar.gz
ARROW_RE2_URL=/tmp/arrow-build/re2-2019-08-01.tar.gz
ARROW_USE_PKG_CONFIG=FALSE
ARROW_R_DEV=TRUE
Karthikeyan Janakiraman: I am going through a new issue now, I can raise a separate ticket to track if required. I need to use proxy to connect to AWS S3 from my environment.
I have set the proxy using Sys.setenv in the R terminal however I still couldn't hit the S3, could you please advise ? will read_parquet use the proxy to get connected to S3 ?
> Sys.setenv(http_proxy="http://proxy:9099")
> Sys.setenv(https_proxy="http://proxy:9099")
> Sys.setenv(HTTPS_PROXY="http://proxy:9099")
> Sys.setenv(HTTP_PROXY="http://proxy:9099")
> Sys.getenv("http_proxy")
[1] "http://proxy:9099"
> df <- read_parquet("s3://my_bucket/test-parquet/refinement.parquet?region=eu-west-1")
Error: IOError: When reading information for key 'test-parquet/refinement.parquet' in bucket 'my_bucket': AWS Error [code 99]: Unable to connect to endpoint with address : 52.218.57.8
>Jonathan Keane / @jonkeane: Thanks for posting those steps! It is strange that it suddenly worked, but glad it's working none the less. We've tried to make installing as easy as possible (e.g. binaries for every platform except centos7 have this built in already), but this one of the few corners where we have something a bit more complicated.
As for the proxy issue, yeah that would be better in a separate issue, though it looks like we have one already (ARROW-8900) and it is not yet implemented (it looks like the aws sdk doesn't use those variables so we'll need to do something else in order to pass them like that).
asfimport
commented
3 years ago Neal Richardson / @nealrichardson:
Can you use the endpoint_override instead of HTTP_PROXY? https://arrow.apache.org/docs/r/articles/fs.html#file-systems-that-emulate-s3
asfimport
commented
3 years ago Karthikeyan Janakiraman: Hey @nealrichardson, Thanks for the suggestion. Not sure if I got it right on the syntax, it will be great if you could verify it. I tried it in two different ways and seeing the respective errors below.
> df <- read_parquet("s3://my_bucket/test-parquet/refinement.parquet?scheme=http&endpoint_override=my_proxy.com%3A9099")
Error: IOError: Path does not exist 'my_bucket/test-parquet/refinement.parquet'
> df <- read_parquet("s3://my_bucket/test-parquet/refinement.parquet?region=eu-west-1?scheme=http&endpoint_override=my_proxy.com%3A9099")
Error: IOError: When reading information for key 'test-parquet/refinement.parquet' in bucket 'my_bucket': AWS Error [code 99]: Unable to connect to endpoint with address : 172.22.65.50
>
All I need is the connection to reach out to AWS from my local via the proxy that I specify.
Note - There is a path does not exist error for one of the above command, but I can confirm the path exist in the bucket.
asfimport
commented
3 years ago Karthikeyan Janakiraman: Appreciate any update here please.
asfimport
commented
3 years ago Neal Richardson / @nealrichardson: I think that looks right, though your proxy URL is different from your previous example (maybe that's redacted though).
If endpoint_override doesn't work around the proxy issue, then I'm not sure there's anything else we can do to help beyond wait for ARROW-8900 to get resolved.
asfimport
commented
3 years ago Karthikeyan Janakiraman: How to avoid arrow reaching out to internet please ? I have downloaded the 3rd party dependencies locally and set the env's that were mentioned above on my comments. But at the very beginning of the installation it tries to reach out to internet and hangs there for a while. Is there another env variable that I can set to avoid this behaviour ?
[root@7a5d8565791f app]# R CMD INSTALL arrow_3.0.0.tar.gz
* installing to library ‘/usr/lib64/R/library’
* installing *source* package ‘arrow’ ...
** package ‘arrow’ successfully unpacked and MD5 sums checked
** using staged installation
trying URL 'https://dl.bintray.com/ursalabs/arrow-r/libarrow/src/arrow-3.0.0.zip'
Error in download.file(from_url, to_file, quiet = quietly) :
cannot open URL 'https://dl.bintray.com/ursalabs/arrow-r/libarrow/src/arrow-3.0.0.zip'
trying URL 'https://www.apache.org/dyn/closer.lua?action=download&filename=arrow/arrow-3.0.0/apache-arrow-3.0.0.tar.gz'
Error in download.file(from_url, to_file, quiet = quietly) :
cannot open URL 'https://www.apache.org/dyn/closer.lua?action=download&filename=arrow/arrow-3.0.0/apache-arrow-3.0.0.tar.gz'
trying URL 'https://www.apache.org/dyn/closer.lua?action=download&filename=arrow/arrow-3.0.0/apache-arrow-3.0.0.tar.gz'
Error in download.file(from_url, to_file, quiet = quietly) :
cannot open URL 'https://www.apache.org/dyn/closer.lua?action=download&filename=arrow/arrow-3.0.0/apache-arrow-3.0.0.tar.gz'
trying URL 'https://www.apache.org/dyn/closer.lua?action=download&filename=arrow/arrow-3.0.0/apache-arrow-3.0.0.tar.gz'
Error in download.file(from_url, to_file, quiet = quietly) :
cannot open URL 'https://www.apache.org/dyn/closer.lua?action=download&filename=arrow/arrow-3.0.0/apache-arrow-3.0.0.tar.gz'
trying URL 'https://downloads.apache.org/arrow/arrow-3.0.0/apache-arrow-3.0.0.tar.gz'
Error in download.file(from_url, to_file, quiet = quietly) :
cannot open URL 'https://downloads.apache.org/arrow/arrow-3.0.0/apache-arrow-3.0.0.tar.gz'
*** Proceeding without C++ dependencies
asfimport
commented
3 years ago Karthikeyan Janakiraman: @nealrichardson/ @jonkeane Could you advise on the above error please, we are all set with respect to the third party deps. We can locally download and install them. It will be great if we can avoid above package being downloaded from the Internet.
asfimport
commented
3 years ago Jonathan Keane / @jonkeane:
Have you already tried to set the environment variable LIBARROW_DOWNLOAD to false?
asfimport
commented
3 years ago Karthikeyan Janakiraman: Hey @jonkeane Thanks for getting back, I tried that env just now and seeing warning "Proceeding without C++ dependencies"
Warning in file.create(f.tg) :
cannot create file '/usr/share/doc/R-3.6.0/html/packages.html', reason 'No such file or directory'
Warning in utils::make.packages.html(.Library, docdir = R.home("doc")) :
cannot update HTML package index
* installing to library ‘/usr/lib64/R/library’
* installing *source* package ‘arrow’ ...
** package ‘arrow’ successfully unpacked and MD5 sums checked
** using staged installation
*** Proceeding without C++ dependencies
PKG_CFLAGS=-I/tmp/Rtmp1gBawc/R.INSTALL2d4f3fe6e7/arrow/libarrow/arrow-3.0.0/include -DARROW_R_WITH_ARROW
PKG_LIBS=-larrow_dataset -lparquet -larrow
** libs
Below are the env's I have set, is there another one I am missing which should route it to check local for the dependencies ?
ARROW_AWS_C_COMMON_URL=/tmp/dependencies/aws-c-common-0.4.59.tar.gz \
ARROW_AWSSDK_URL=/tmp/dependencies/aws-sdk-cpp-1.7.160.tar.gz \
ARROW_AWS_CHECKSUMS_URL=/tmp/dependencies/aws-checksums-0.1.5.tar.gz \
ARROW_AWS_C_EVENT_STREAM_URL=/tmp/dependencies/aws-c-event-stream-0.1.5.tar.gz \
ARROW_THRIFT_URL=/tmp/dependencies/thrift-0.12.0.tar.gz \
ARROW_RAPIDJSON_URL=/tmp/dependencies/rapidjson-2bbd33b33217ff4a73434ebf10cdac41e2ef5e34.tar.gz \
ARROW_BOOST_URL=/tmp/dependencies/boost_1_75_0.tar.gz \
ARROW_RE2_URL=/tmp/dependencies/re2-2019-08-01.tar.gz \
ARROW_JEMALLOC_URL=/tmp/dependencies/jemalloc-5.2.1.tar.bz2 \
ARROW_MIMALLOC_URL=/tmp/dependencies/mimalloc-1.6.4.tar.gz \
ARROW_SNAPPY_URL=/tmp/dependencies/snappy-1.1.7.tar.gz \
ARROW_ZSTD_URL=/tmp/dependencies/zstd-v1.4.3.tar.gz \
ARROW_BROTLI_URL=/tmp/dependencies/brotli-v1.0.7.tar.gz \
ARROW_LZ4_URL=/tmp/dependencies/lz4-v1.9.2.tar.gz \
ARROW_ZLIB_URL=/tmp/dependencies/zlib-1.2.11.tar.gz \
ARROW_BZ2_URL=/tmp/dependencies/bzip2-1.0.8.tar.gz \
LIBARROW_MINIMAL=false \
LIBARROW_DOWNLOAD=false \
ARROW_WITH_BZ2=ON \
ARROW_WITH_LZ4=ON \
ARROW_WITH_SNAPPY=ON \
ARROW_WITH_ZLIB=ON \
ARROW_WITH_ZSTD=ON \
ARROW_WITH_BROTLI=ON \
ARROW_DEPENDENCY_SOURCE=SYSTEM \
ARROW_VERBOSE_THIRDPARTY_BUILD=ON \
ARROW_USE_PKG_CONFIG=FALSE \
ARROW_R_DEV=TRUEJonathan Keane / @jonkeane: It looks like the source isn't where the installation is expecting it so it's not being found when you disable the downloading.
The find_local_source()} function is called even if the download is disabled|https://github.com/apache/arrow/blob/81f652102737ea89c30de0cec1e94414b8740666/r/tools/nixlibs.R#L495]. That function will look in the directory given in the {{ARROW_HOME environment variable (which defaults to one directory above the r package to match the layout of our repository). Try making sure you have the cpp source available and setting that environment variable now that you have disabled downloading see: https://github.com/apache/arrow/blob/master/r/tools/nixlibs.R#L264-L272
asfimport
commented
2 years ago Nicola Crane / @thisisnic: I'm going to close this ticket as there hasn't been any discussion in a long time, but feel free to open a new one if needed.
glitt13
I have followed below steps however seeing the error on summary when I try to read parquet from S3.
[root@c1cce557dba3 tmp]# printenv | grep LIBARROW_MINIMAL LIBARROW_MINIMAL=false
Environment: QA Reporter: Karthikeyan Janakiraman
Note: This issue was originally created as ARROW-12026. Please see the migration documentation for further details.