apache / arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
https://arrow.apache.org/
Apache License 2.0
14.61k stars 3.55k forks source link

`pip install pyarrow` with python 3.8 fail with message : Could not build wheels for pyarrow which use PEP 517 and cannot be installed directly #23384

Closed asfimport closed 5 years ago

asfimport commented 5 years ago

When I install pyarrow in python 3.7.5 with pip install pyarrow it works.

However with python 3.8.0 it fails with the following error :


14:06 $ pip install pyarrow
Collecting pyarrow
 Using cached https://files.pythonhosted.org/packages/e0/e6/d14b4a2b54ef065b1a2c576537abe805c1af0c94caef70d365e2d78fc528/pyarrow-0.15.1.tar.gz
 Installing build dependencies ... done
 Getting requirements to build wheel ... done
 Preparing wheel metadata ... done
Collecting numpy>=1.14
 Using cached https://files.pythonhosted.org/packages/3a/8f/f9ee25c0ae608f86180c26a1e35fe7ea9d71b473ea7f54db20759ba2745e/numpy-1.17.3-cp38-cp38-manylinux1_x86_64.whl
Collecting six>=1.0.0
 Using cached https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl
Building wheels for collected packages: pyarrow
 Building wheel for pyarrow (PEP 517) ... error
 ERROR: Command errored out with exit status 1:
 command: /home/fabien/.local/share/virtualenvs/pipenv-_eZlsrLD/bin/python3.8 /home/fabien/.local/share/virtualenvs/pipenv-_eZlsrLD/lib/python3.8/site-packages/pip/_vendor/pep517/_in_process.py build_wheel /tmp/tmp4gpyu82j
 cwd: /tmp/pip-install-cj5ucedq/pyarrow
 Complete output (490 lines):
 running bdist_wheel
 running build
 running build_py
 creating build
 creating build/lib.linux-x86_64-3.8
 creating build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/flight.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/orc.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/jvm.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/util.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/pandas_compat.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/cuda.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/filesystem.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/json.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/feather.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/serialization.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/ipc.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/parquet.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_generated_version.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/benchmark.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/types.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/hdfs.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/fs.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/plasma.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/csv.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/compat.py -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/__init__.py -> build/lib.linux-x86_64-3.8/pyarrow
 creating build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_strategies.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_array.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_tensor.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_json.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_cython.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_deprecations.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/conftest.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_memory.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_io.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/pandas_examples.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_compute.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/util.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_cuda_numba_interop.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_pandas.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_sparse_tensor.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_fs.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_schema.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_extension_type.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_hdfs.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_csv.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_filesystem.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_orc.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_scalars.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_parquet.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_flight.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_builder.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_gandiva.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_cuda.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_types.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_feather.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_plasma.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_plasma_tf_op.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_ipc.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_misc.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_jvm.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_serialization.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_table.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/deserialize_buffer.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/strategies.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/test_convert_builtin.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 copying pyarrow/tests/__init__.py -> build/lib.linux-x86_64-3.8/pyarrow/tests
 running egg_info
 writing pyarrow.egg-info/PKG-INFO
 writing dependency_links to pyarrow.egg-info/dependency_links.txt
 writing entry points to pyarrow.egg-info/entry_points.txt
 writing requirements to pyarrow.egg-info/requires.txt
 writing top-level names to pyarrow.egg-info/top_level.txt
 reading manifest file 'pyarrow.egg-info/SOURCES.txt'
 reading manifest template 'MANIFEST.in'
 warning: no files found matching '../LICENSE.txt'
 warning: no files found matching '../NOTICE.txt'
 warning: no previously-included files matching '*.so' found anywhere in distribution
 warning: no previously-included files matching '*.pyc' found anywhere in distribution
 warning: no previously-included files matching '*~' found anywhere in distribution
 warning: no previously-included files matching '#*' found anywhere in distribution
 warning: no previously-included files matching '.git*' found anywhere in distribution
 warning: no previously-included files matching '.DS_Store' found anywhere in distribution
 no previously-included directories found matching '.asv'
 writing manifest file 'pyarrow.egg-info/SOURCES.txt'
 copying pyarrow/__init__.pxd -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_csv.cpp -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_csv.pyx -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_cuda.pxd -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_cuda.pyx -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_flight.cpp -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_flight.pyx -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_fs.cpp -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_fs.pyx -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_json.cpp -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_json.pyx -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_orc.cpp -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_orc.pxd -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_orc.pyx -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_parquet.cpp -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_parquet.pxd -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_parquet.pyx -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_plasma.cpp -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_plasma.pyx -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_s3.cpp -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/_s3fs.cpp -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/array.pxi -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/benchmark.pxi -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/builder.pxi -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/error.pxi -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/feather.pxi -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/gandiva.cpp -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/gandiva.pyx -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/io-hdfs.pxi -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/io.pxi -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/ipc.pxi -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/lib.cpp -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/lib.pxd -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/lib.pyx -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/lib_api.h -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/memory.pxi -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/pandas-shim.pxi -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/plasma-store-server -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/public-api.pxi -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/scalar.pxi -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/serialization.pxi -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/table.pxi -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/tensor.pxi -> build/lib.linux-x86_64-3.8/pyarrow
 copying pyarrow/types.pxi -> build/lib.linux-x86_64-3.8/pyarrow
 creating build/lib.linux-x86_64-3.8/pyarrow/.pytest_cache
 copying pyarrow/.pytest_cache/CACHEDIR.TAG -> build/lib.linux-x86_64-3.8/pyarrow/.pytest_cache
 copying pyarrow/.pytest_cache/README.md -> build/lib.linux-x86_64-3.8/pyarrow/.pytest_cache
 creating build/lib.linux-x86_64-3.8/pyarrow/.pytest_cache/v
 creating build/lib.linux-x86_64-3.8/pyarrow/.pytest_cache/v/cache
 copying pyarrow/.pytest_cache/v/cache/nodeids -> build/lib.linux-x86_64-3.8/pyarrow/.pytest_cache/v/cache
 copying pyarrow/.pytest_cache/v/cache/stepwise -> build/lib.linux-x86_64-3.8/pyarrow/.pytest_cache/v/cache
 creating build/lib.linux-x86_64-3.8/pyarrow/include
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/api.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/array.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/buffer.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/buffer_builder.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/builder.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/compare.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/extension_type.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/memory_pool.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/memory_pool_test.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/pretty_print.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/record_batch.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/result.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/scalar.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/sparse_tensor.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/status.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/stl.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/table.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/table_builder.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/tensor.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/type.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/type_fwd.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/type_traits.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/visitor.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 copying pyarrow/include/arrow/visitor_inline.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow/adapters
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow/adapters/orc
 copying pyarrow/include/arrow/adapters/orc/adapter.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/adapters/orc
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow/array
 copying pyarrow/include/arrow/array/builder_adaptive.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/array
 copying pyarrow/include/arrow/array/builder_base.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/array
 copying pyarrow/include/arrow/array/builder_binary.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/array
 copying pyarrow/include/arrow/array/builder_decimal.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/array
 copying pyarrow/include/arrow/array/builder_dict.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/array
 copying pyarrow/include/arrow/array/builder_nested.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/array
 copying pyarrow/include/arrow/array/builder_primitive.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/array
 copying pyarrow/include/arrow/array/builder_time.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/array
 copying pyarrow/include/arrow/array/builder_union.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/array
 copying pyarrow/include/arrow/array/concatenate.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/array
 copying pyarrow/include/arrow/array/diff.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/array
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute
 copying pyarrow/include/arrow/compute/api.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute
 copying pyarrow/include/arrow/compute/benchmark_util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute
 copying pyarrow/include/arrow/compute/context.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute
 copying pyarrow/include/arrow/compute/expression.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute
 copying pyarrow/include/arrow/compute/kernel.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute
 copying pyarrow/include/arrow/compute/logical_type.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute
 copying pyarrow/include/arrow/compute/operation.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute
 copying pyarrow/include/arrow/compute/test_util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute
 copying pyarrow/include/arrow/compute/type_fwd.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute/kernels
 copying pyarrow/include/arrow/compute/kernels/aggregate.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute/kernels
 copying pyarrow/include/arrow/compute/kernels/boolean.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute/kernels
 copying pyarrow/include/arrow/compute/kernels/cast.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute/kernels
 copying pyarrow/include/arrow/compute/kernels/compare.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute/kernels
 copying pyarrow/include/arrow/compute/kernels/count.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute/kernels
 copying pyarrow/include/arrow/compute/kernels/filter.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute/kernels
 copying pyarrow/include/arrow/compute/kernels/hash.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute/kernels
 copying pyarrow/include/arrow/compute/kernels/isin.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute/kernels
 copying pyarrow/include/arrow/compute/kernels/mean.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute/kernels
 copying pyarrow/include/arrow/compute/kernels/sort_to_indices.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute/kernels
 copying pyarrow/include/arrow/compute/kernels/sum.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute/kernels
 copying pyarrow/include/arrow/compute/kernels/take.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/compute/kernels
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow/csv
 copying pyarrow/include/arrow/csv/api.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/csv
 copying pyarrow/include/arrow/csv/chunker.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/csv
 copying pyarrow/include/arrow/csv/column_builder.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/csv
 copying pyarrow/include/arrow/csv/converter.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/csv
 copying pyarrow/include/arrow/csv/options.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/csv
 copying pyarrow/include/arrow/csv/parser.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/csv
 copying pyarrow/include/arrow/csv/reader.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/csv
 copying pyarrow/include/arrow/csv/test_common.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/csv
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 copying pyarrow/include/arrow/dataset/api.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 copying pyarrow/include/arrow/dataset/dataset.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 copying pyarrow/include/arrow/dataset/discovery.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 copying pyarrow/include/arrow/dataset/disk_store.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 copying pyarrow/include/arrow/dataset/file_base.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 copying pyarrow/include/arrow/dataset/file_csv.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 copying pyarrow/include/arrow/dataset/file_feather.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 copying pyarrow/include/arrow/dataset/file_json.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 copying pyarrow/include/arrow/dataset/file_parquet.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 copying pyarrow/include/arrow/dataset/filter.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 copying pyarrow/include/arrow/dataset/partition.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 copying pyarrow/include/arrow/dataset/scanner.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 copying pyarrow/include/arrow/dataset/test_util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 copying pyarrow/include/arrow/dataset/transaction.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 copying pyarrow/include/arrow/dataset/type_fwd.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 copying pyarrow/include/arrow/dataset/visibility.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 copying pyarrow/include/arrow/dataset/writer.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/dataset
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow/filesystem
 copying pyarrow/include/arrow/filesystem/api.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/filesystem
 copying pyarrow/include/arrow/filesystem/filesystem.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/filesystem
 copying pyarrow/include/arrow/filesystem/localfs.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/filesystem
 copying pyarrow/include/arrow/filesystem/mockfs.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/filesystem
 copying pyarrow/include/arrow/filesystem/path_tree.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/filesystem
 copying pyarrow/include/arrow/filesystem/path_util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/filesystem
 copying pyarrow/include/arrow/filesystem/s3fs.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/filesystem
 copying pyarrow/include/arrow/filesystem/test_util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/filesystem
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow/flight
 copying pyarrow/include/arrow/flight/api.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/flight
 copying pyarrow/include/arrow/flight/client.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/flight
 copying pyarrow/include/arrow/flight/client_auth.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/flight
 copying pyarrow/include/arrow/flight/client_middleware.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/flight
 copying pyarrow/include/arrow/flight/customize_protobuf.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/flight
 copying pyarrow/include/arrow/flight/middleware.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/flight
 copying pyarrow/include/arrow/flight/platform.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/flight
 copying pyarrow/include/arrow/flight/server.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/flight
 copying pyarrow/include/arrow/flight/server_auth.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/flight
 copying pyarrow/include/arrow/flight/server_middleware.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/flight
 copying pyarrow/include/arrow/flight/test_util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/flight
 copying pyarrow/include/arrow/flight/types.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/flight
 copying pyarrow/include/arrow/flight/visibility.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/flight
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow/io
 copying pyarrow/include/arrow/io/api.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/io
 copying pyarrow/include/arrow/io/buffered.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/io
 copying pyarrow/include/arrow/io/compressed.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/io
 copying pyarrow/include/arrow/io/concurrency.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/io
 copying pyarrow/include/arrow/io/file.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/io
 copying pyarrow/include/arrow/io/hdfs.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/io
 copying pyarrow/include/arrow/io/interfaces.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/io
 copying pyarrow/include/arrow/io/memory.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/io
 copying pyarrow/include/arrow/io/mman.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/io
 copying pyarrow/include/arrow/io/readahead.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/io
 copying pyarrow/include/arrow/io/slow.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/io
 copying pyarrow/include/arrow/io/test_common.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/io
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow/ipc
 copying pyarrow/include/arrow/ipc/api.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/ipc
 copying pyarrow/include/arrow/ipc/dictionary.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/ipc
 copying pyarrow/include/arrow/ipc/feather.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/ipc
 copying pyarrow/include/arrow/ipc/json_integration.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/ipc
 copying pyarrow/include/arrow/ipc/json_simple.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/ipc
 copying pyarrow/include/arrow/ipc/message.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/ipc
 copying pyarrow/include/arrow/ipc/options.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/ipc
 copying pyarrow/include/arrow/ipc/reader.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/ipc
 copying pyarrow/include/arrow/ipc/test_common.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/ipc
 copying pyarrow/include/arrow/ipc/util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/ipc
 copying pyarrow/include/arrow/ipc/writer.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/ipc
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow/json
 copying pyarrow/include/arrow/json/api.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/json
 copying pyarrow/include/arrow/json/chunked_builder.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/json
 copying pyarrow/include/arrow/json/chunker.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/json
 copying pyarrow/include/arrow/json/converter.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/json
 copying pyarrow/include/arrow/json/options.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/json
 copying pyarrow/include/arrow/json/parser.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/json
 copying pyarrow/include/arrow/json/rapidjson_defs.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/json
 copying pyarrow/include/arrow/json/reader.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/json
 copying pyarrow/include/arrow/json/test_common.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/json
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/api.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/arrow_to_pandas.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/benchmark.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/common.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/config.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/datetime.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/decimal.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/deserialize.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/extension_type.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/flight.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/helpers.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/inference.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/init.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/io.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/iterators.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/numpy_convert.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/numpy_interop.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/numpy_to_arrow.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/platform.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/pyarrow.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/pyarrow_api.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/pyarrow_lib.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/python_to_arrow.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/serialize.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/type_traits.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 copying pyarrow/include/arrow/python/visibility.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/python
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow/testing
 copying pyarrow/include/arrow/testing/generator.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/testing
 copying pyarrow/include/arrow/testing/gtest_common.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/testing
 copying pyarrow/include/arrow/testing/gtest_util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/testing
 copying pyarrow/include/arrow/testing/random.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/testing
 copying pyarrow/include/arrow/testing/util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/testing
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/align_util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/atomic_shared_ptr.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/base64.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/basic_decimal.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/bit_stream_utils.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/bit_util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/bpacking.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/checked_cast.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/compare.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/compiler_util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/compression.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/compression_brotli.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/compression_bz2.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/compression_lz4.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/compression_snappy.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/compression_zlib.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/compression_zstd.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/config.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/cpu_info.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/decimal.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/formatting.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/functional.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/hash_util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/hashing.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/int_util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/io_util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/iterator.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/key_value_metadata.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/logging.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/macros.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/memory.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/neon_util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/parallel.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/parsing.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/print.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/range.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/rle_encoding.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/sse_util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/stl.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/stopwatch.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/string.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/string_builder.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/string_view.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/task_group.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/thread_pool.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/trie.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/type_traits.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/ubsan.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/uri.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/utf8.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/variant.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/visibility.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 copying pyarrow/include/arrow/util/windows_compatibility.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/util
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow/vendored
 copying pyarrow/include/arrow/vendored/datetime.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/vendored
 copying pyarrow/include/arrow/vendored/string_view.hpp -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/vendored
 copying pyarrow/include/arrow/vendored/variant.hpp -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/vendored
 copying pyarrow/include/arrow/vendored/xxhash.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/vendored
 creating build/lib.linux-x86_64-3.8/pyarrow/include/arrow/vendored/datetime
 copying pyarrow/include/arrow/vendored/datetime/date.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/vendored/datetime
 copying pyarrow/include/arrow/vendored/datetime/ios.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/vendored/datetime
 copying pyarrow/include/arrow/vendored/datetime/tz.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/vendored/datetime
 copying pyarrow/include/arrow/vendored/datetime/tz_private.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/vendored/datetime
 copying pyarrow/include/arrow/vendored/datetime/visibility.h -> build/lib.linux-x86_64-3.8/pyarrow/include/arrow/vendored/datetime
 creating build/lib.linux-x86_64-3.8/pyarrow/include/plasma
 copying pyarrow/include/plasma/client.h -> build/lib.linux-x86_64-3.8/pyarrow/include/plasma
 copying pyarrow/include/plasma/common.h -> build/lib.linux-x86_64-3.8/pyarrow/include/plasma
 copying pyarrow/include/plasma/compat.h -> build/lib.linux-x86_64-3.8/pyarrow/include/plasma
 copying pyarrow/include/plasma/events.h -> build/lib.linux-x86_64-3.8/pyarrow/include/plasma
 copying pyarrow/include/plasma/test_util.h -> build/lib.linux-x86_64-3.8/pyarrow/include/plasma
 creating build/lib.linux-x86_64-3.8/pyarrow/includes
 copying pyarrow/includes/__init__.pxd -> build/lib.linux-x86_64-3.8/pyarrow/includes
 copying pyarrow/includes/common.pxd -> build/lib.linux-x86_64-3.8/pyarrow/includes
 copying pyarrow/includes/libarrow.pxd -> build/lib.linux-x86_64-3.8/pyarrow/includes
 copying pyarrow/includes/libarrow_cuda.pxd -> build/lib.linux-x86_64-3.8/pyarrow/includes
 copying pyarrow/includes/libarrow_flight.pxd -> build/lib.linux-x86_64-3.8/pyarrow/includes
 copying pyarrow/includes/libarrow_fs.pxd -> build/lib.linux-x86_64-3.8/pyarrow/includes
 copying pyarrow/includes/libgandiva.pxd -> build/lib.linux-x86_64-3.8/pyarrow/includes
 copying pyarrow/includes/libplasma.pxd -> build/lib.linux-x86_64-3.8/pyarrow/includes
 creating build/lib.linux-x86_64-3.8/pyarrow/tensorflow
 copying pyarrow/tensorflow/plasma_op.cc -> build/lib.linux-x86_64-3.8/pyarrow/tensorflow
 creating build/lib.linux-x86_64-3.8/pyarrow/tensorflow/plasma_op.so.dSYM
 creating build/lib.linux-x86_64-3.8/pyarrow/tensorflow/plasma_op.so.dSYM/Contents
 copying pyarrow/tensorflow/plasma_op.so.dSYM/Contents/Info.plist -> build/lib.linux-x86_64-3.8/pyarrow/tensorflow/plasma_op.so.dSYM/Contents
 copying pyarrow/tests/pyarrow_cython_example.pyx -> build/lib.linux-x86_64-3.8/pyarrow/tests
 creating build/lib.linux-x86_64-3.8/pyarrow/tests/data
 creating build/lib.linux-x86_64-3.8/pyarrow/tests/data/orc
 copying pyarrow/tests/data/orc/README.md -> build/lib.linux-x86_64-3.8/pyarrow/tests/data/orc
 copying pyarrow/tests/data/orc/TestOrcFile.emptyFile.jsn.gz -> build/lib.linux-x86_64-3.8/pyarrow/tests/data/orc
 copying pyarrow/tests/data/orc/TestOrcFile.emptyFile.orc -> build/lib.linux-x86_64-3.8/pyarrow/tests/data/orc
 copying pyarrow/tests/data/orc/TestOrcFile.test1.jsn.gz -> build/lib.linux-x86_64-3.8/pyarrow/tests/data/orc
 copying pyarrow/tests/data/orc/TestOrcFile.test1.orc -> build/lib.linux-x86_64-3.8/pyarrow/tests/data/orc
 copying pyarrow/tests/data/orc/TestOrcFile.testDate1900.jsn.gz -> build/lib.linux-x86_64-3.8/pyarrow/tests/data/orc
 copying pyarrow/tests/data/orc/TestOrcFile.testDate1900.orc -> build/lib.linux-x86_64-3.8/pyarrow/tests/data/orc
 copying pyarrow/tests/data/orc/decimal.jsn.gz -> build/lib.linux-x86_64-3.8/pyarrow/tests/data/orc
 copying pyarrow/tests/data/orc/decimal.orc -> build/lib.linux-x86_64-3.8/pyarrow/tests/data/orc
 creating build/lib.linux-x86_64-3.8/pyarrow/tests/data/parquet
 copying pyarrow/tests/data/parquet/v0.7.1.all-named-index.parquet -> build/lib.linux-x86_64-3.8/pyarrow/tests/data/parquet
 copying pyarrow/tests/data/parquet/v0.7.1.column-metadata-handling.parquet -> build/lib.linux-x86_64-3.8/pyarrow/tests/data/parquet
 copying pyarrow/tests/data/parquet/v0.7.1.parquet -> build/lib.linux-x86_64-3.8/pyarrow/tests/data/parquet
 copying pyarrow/tests/data/parquet/v0.7.1.some-named-index.parquet -> build/lib.linux-x86_64-3.8/pyarrow/tests/data/parquet
 warning: build_py: byte-compiling is disabled, skipping.

 running build_ext
 creating build/temp.linux-x86_64-3.8
 -- Running cmake for pyarrow
 cmake -DPYTHON_EXECUTABLE=/home/fabien/.local/share/virtualenvs/pipenv-_eZlsrLD/bin/python3.8 -DPYARROW_BOOST_USE_SHARED=on -DCMAKE_BUILD_TYPE=release /tmp/pip-install-cj5ucedq/pyarrow
 -- The C compiler identification is GNU 9.2.1
 -- The CXX compiler identification is GNU 9.2.1
 -- Check for working C compiler: /usr/bin/cc
 -- Check for working C compiler: /usr/bin/cc -- works
 -- Detecting C compiler ABI info
 -- Detecting C compiler ABI info - done
 -- Detecting C compile features
 -- Detecting C compile features - done
 -- Check for working CXX compiler: /usr/bin/c++
 -- Check for working CXX compiler: /usr/bin/c++ -- works
 -- Detecting CXX compiler ABI info
 -- Detecting CXX compiler ABI info - done
 -- Detecting CXX compile features
 -- Detecting CXX compile features - done
 -- Compiler command: env LANG=C /usr/bin/c++ -v
 -- Compiler version: Using built-in specs.
 COLLECT_GCC=/usr/bin/c++
 COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/9/lto-wrapper
 OFFLOAD_TARGET_NAMES=nvptx-none:hsa
 OFFLOAD_TARGET_DEFAULT=1
 Target: x86_64-linux-gnu
 Configured with: ../src/configure -v --with-pkgversion='Ubuntu 9.2.1-9ubuntu2' --with-bugurl=file:///usr/share/doc/gcc-9/README.Bugs --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --prefix=/usr --with-gcc-major-version-only --program-suffix=-9 --program-prefix=x86_64-linux-gnu- --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --libdir=/usr/lib --enable-nls --enable-bootstrap --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new --enable-gnu-unique-object --disable-vtable-verify --enable-plugin --enable-default-pie --with-system-zlib --with-target-system-zlib=auto --enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64 --with-multilib-list=m32,m64,mx32 --enable-multilib --with-tune=generic --enable-offload-targets=nvptx-none,hsa --without-cuda-driver --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=x86_64-linux-gnu
 Thread model: posix
 gcc version 9.2.1 20191008 (Ubuntu 9.2.1-9ubuntu2)

 -- Compiler id: GNU
 Selected compiler gcc 9.2.1
 -- Performing Test CXX_SUPPORTS_SSE4_2
 -- Performing Test CXX_SUPPORTS_SSE4_2 - Success
 -- Performing Test CXX_SUPPORTS_ALTIVEC
 -- Performing Test CXX_SUPPORTS_ALTIVEC - Failed
 -- Performing Test CXX_SUPPORTS_ARMCRC
 -- Performing Test CXX_SUPPORTS_ARMCRC - Failed
 -- Performing Test CXX_SUPPORTS_ARMV8_CRC_CRYPTO
 -- Performing Test CXX_SUPPORTS_ARMV8_CRC_CRYPTO - Failed
 -- Arrow build warning level: PRODUCTION
 Using ld linker
 Configured for RELEASE build (set with cmake -DCMAKE_BUILD_TYPE={release,debug,...})
 -- Build Type: RELEASE
 -- Build output directory: /tmp/pip-install-cj5ucedq/pyarrow/build/temp.linux-x86_64-3.8/release
 -- Found PythonInterp: /home/fabien/.local/share/virtualenvs/pipenv-_eZlsrLD/bin/python3.8 (found version "3.8")
 -- Searching for Python libs in /home/fabien/.local/share/virtualenvs/pipenv-_eZlsrLD/lib64;/home/fabien/.local/share/virtualenvs/pipenv-_eZlsrLD/lib;/home/fabien/.pyenv/versions/3.8.0/lib/python3.8/config-3.8-x86_64-linux-gnu
 -- Looking for python3.8
 -- Found Python lib /home/fabien/.pyenv/versions/3.8.0/lib/python3.8/config-3.8-x86_64-linux-gnu/libpython3.8.a
 -- Found PythonLibs: /home/fabien/.pyenv/versions/3.8.0/lib/python3.8/config-3.8-x86_64-linux-gnu/libpython3.8.a
 CMake Error at cmake_modules/FindNumPy.cmake:62 (message):
 NumPy import failure:

 Traceback (most recent call last):

 File "<string>", line 1, in <module>

 ModuleNotFoundError: No module named 'numpy'

 Call Stack (most recent call first):
 CMakeLists.txt:189 (find_package)

 -- Configuring incomplete, errors occurred!
 See also "/tmp/pip-install-cj5ucedq/pyarrow/build/temp.linux-x86_64-3.8/CMakeFiles/CMakeOutput.log".
 See also "/tmp/pip-install-cj5ucedq/pyarrow/build/temp.linux-x86_64-3.8/CMakeFiles/CMakeError.log".
 error: command 'cmake' failed with exit status 1
 ----------------------------------------
 ERROR: Failed building wheel for pyarrow
 Running setup.py clean for pyarrow
Failed to build pyarrow
ERROR: Could not build wheels for pyarrow which use PEP 517 and cannot be installed directly

I see  the line "ModuleNotFoundError: No module named 'numpy'" but installing numpy did not change anything.

Environment: Ubuntu 19.10 / Python 3.8.0 Reporter: Fabien / @fabiencelier

Related issues:

Note: This issue was originally created as ARROW-7076. Please see the migration documentation for further details.

asfimport commented 5 years ago

Joris Van den Bossche / @jorisvandenbossche: There are not yet binary wheels available for Python 3.8, so therefore pip is trying to build from source. And then it appears something goes wrong with installing/finding numpy, which seems similar to the error reported in ARROW-5210. As I mentioned there, this is an error in the pyproject.toml that we do not list numpy as a build dependency (pip will create a new environment with all build dependencies, therefore installing numpy before hand does not solve it).

Now, even if the pyproject.toml would correctly list this, it is quite likely that installing from source with just pip install pyarrow is not going to work, as there are a lot of other (non-python) dependencies that you would need to ensure are available. If you do want to install from source, see https://arrow.apache.org/docs/developers/python.html#python-development for detailed instructions), otherwise you will need to wait until there are wheels available, or use Python 3.7 instead of 3.8, or use conda instead (conda-forge already has binary packages of pyarrow for Python 3.8).

asfimport commented 5 years ago

Fabien / @fabiencelier: Hi ! Thanks for the answer !

It's nice to have it on conda but we use pyarrow as a dependency of our library so we cannot ensure that our users will use conda to install. I will still try it and mention it as a workaround for the pip users.

Any idea when a binary version will be available on pypi for 3.8 (and for which version ?)

asfimport commented 5 years ago

Joris Van den Bossche / @jorisvandenbossche: See ARROW-6920 for wheels for Python 3.8 (I suppose they will only get added for the latest pyarrow release, 0.15.1)

asfimport commented 5 years ago

Wes McKinney / @wesm: Duplicate of ARROW-6920

asfimport commented 4 years ago

Manthan Admane: I don't know how and why- it gives me a "ERROR: Could not build wheels for pyarrow which use PEP 517 and cannot be installed directly"

When I am using a virtual env on anaconda BUT succeeds when I am using the (base) default environment. 

asfimport commented 4 years ago

Joris Van den Bossche / @jorisvandenbossche: [~ManthanAdmane] you will need to give more details (the exact commands you ran, the full output, which version you are installing, which platform, ...)

asfimport commented 4 years ago

Manthan Admane: I am using Windows 10,  Anaconda prompt as terminal for running the commands.

Command I used- "pip install pyarrow"

 

My pip freeze: anaconda-client==1.7.2 anaconda-navigator==1.9.7 appdirs==1.4.3 asn1crypto==1.3.0 astropy==2.0.9 atomicwrites==1.3.0 attrs==19.3.0 Automat==20.2.0 autopep8==1.5 backports.shutil-get-terminal-size==1.0.0 beautifulsoup4==4.6.3 bleach==3.1.4 bokeh==2.0.1 Bottleneck==1.2.1 certifi==2020.4.5.1 cffi==1.14.0 chardet==3.0.4 click==7.1.1 cloudpickle==0.7.0 clyent==1.2.2 colorama==0.4.3 conda==4.8.3 conda-build==3.10.9 conda-package-handling==1.3.11 conda-verify==3.0.0 constantly==15.1.0 crypto==1.4.1 cryptography==2.9.2 cssselect==1.1.0 cycler==0.10.0 cytoolz==0.10.0 dask==1.1.1 decorator==4.4.2 dill==0.3.1.1 distributed==1.28.1 dlib==19.7.0 entrypoints==0.3 et-xmlfile==1.0.1 fast-histogram==0.7 filelock==3.0.12 future==0.18.2 glob2==0.7 glue-core==0.13.4 glue-vispy-viewers==0.10 h5py==2.9.0 HeapDict==1.0.1 hyperlink==19.0.0 idna==2.9 imageio==2.8.0 imbalanced-learn==0.5.0 importlib-metadata==1.6.0 imutils==0.5.3 incremental==17.5.0 ipykernel==5.1.4 ipython==5.8.0 ipython-genutils==0.2.0 ipywidgets==7.5.1 jdcal==1.4.1 jedi==0.17.0 Jinja2==2.11.1 joblib==0.14.1 json5==0.9.4 jsonschema==2.6.0 jupyter-client==6.1.2 jupyter-core==4.6.3 jupyterlab==1.2.6 jupyterlab-server==1.0.0 kiwisolver==1.1.0 libarchive-c==2.9 locket==0.2.0 lxml==4.5.0 MarkupSafe==1.1.1 matplotlib==2.2.2 menuinst==1.4.16 mistune==0.8.4 more-itertools==8.2.0 mpl-scatter-density==0.5 msgpack==0.6.1 naked==0.1.31 navigator-updater==0.2.1 nbconvert==5.3.1 nbformat==5.0.4 nbopen==0.6 networkx==2.4 notebook==5.5.0 numpy==1.18.3 olefile==0.46 opencv-python==4.2.0.32 openpyxl==2.5.14 packaging==20.3 pandas==0.23.4 pandocfilters==1.4.2 parsel==1.5.2 parso==0.7.0 partd==1.1.0 pickleshare==0.7.5 Pillow==6.1.0 pkginfo==1.5.0.1 playsound==1.2.2 plotly==3.7.0 pluggy==0.11.0 prompt-toolkit==3.0.5 Protego==0.1.16 protobuf==3.8.0 psutil==5.6.3 ptpython==3.0.2 py==1.8.1 pyarrow==0.15.1 pyasn1==0.4.8 pyasn1-modules==0.2.8 pycosat==0.6.3 pycparser==2.20 pycryptodome==3.9.7 PyDispatcher==2.0.5 Pygments==2.6.1 PyHamcrest==2.0.2 PyOpenGL==3.1.1a1 pyOpenSSL==19.1.0 pyparsing==2.4.6 pyreadline==2.1 PySocks==1.7.1 pytest==4.5.0 python-dateutil==2.8.1 pytz==2019.3 PyWavelets==1.0.3 pywin32==223 pywinpty==0.5.7 PyYAML==5.1.2 pyzmq==18.1.0 QtAwesome==0.5.6 qtconsole==4.7.3 QtPy==1.6.0 queuelib==1.5.0 requests==2.23.0 retrying==1.3.3 ruamel-yaml==0.15.46 scikit-fuzzy==0.4.2 scikit-image==0.15.0 scikit-learn==0.20.3 scipy==1.2.1 Scrapy==2.1.0 Send2Trash==1.5.0 service-identity==18.1.0 shellescape==3.8.1 simplegeneric==0.8.1 six==1.14.0 sortedcontainers==2.1.0 tblib==1.6.0 terminado==0.8.3 testpath==0.4.4 toml==0.10.0 toolz==0.10.0 tornado==6.0.3 tqdm==4.29.1 traitlets==4.3.3 Twisted==20.3.0 typing-extensions==3.7.4.1 urllib3==1.25.8 virtualenv==16.3.0 w3lib==1.21.0 wcwidth==0.1.9 webencodings==0.5.1 widgetsnbextension==3.5.1 win-inet-pton==1.1.0 wincertstore==0.2 wordcloud==1.6.0 xlrd==1.2.0 zict==2.0.0 zipp==3.1.0 zope.interface==5.1.0

 

and it worked without throwing a PEP 517 error.

asfimport commented 4 years ago

Wes McKinney / @wesm: [~ManthanAdmane] the issue you're describing is beyond the scope of this JIRA issue. You can open a new issue but it sounds like there's something amiss with your environment (in general mixing virtualenv and conda is going to create headaches)