search

apache / arrow

Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
https://arrow.apache.org/
Apache License 2.0
14.39k stars 3.5k forks source link

[Python] Can't install pyarrow on MacOS 14.0, Python 3.12 - ErrMsg: Could not build wheels for pyarrow, which is required to install pyproject.toml-based projects #38311

Closed zinyosrim closed 11 months ago

zinyosrim commented 11 months ago

Describe the bug, including details regarding any error messages, version, and platform.

I checked also cmake. It's on my machine V.3.27.7

pip install pyarrow

  Using cached pyarrow-13.0.0.tar.gz (1.0 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: numpy>=1.16.6 in ./.venv/lib/python3.12/site-packages (from pyarrow) (1.26.1)
Building wheels for collected packages: pyarrow
  Building wheel for pyarrow (pyproject.toml) ... error
  error: subprocess-exited-with-error

  × Building wheel for pyarrow (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [291 lines of output]
      <string>:34: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
      WARNING setuptools_scm.pyproject_reading toml section missing 'pyproject.toml does not contain a tool.setuptools_scm section'
      running bdist_wheel
      running build
      running build_py
      creating build
      creating build/lib.macosx-14-arm64-cpython-312
      creating build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/orc.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/conftest.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_generated_version.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/benchmark.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_compute_docstrings.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/ipc.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/util.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/flight.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/cffi.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/substrait.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/filesystem.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/__init__.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/types.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/dataset.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/cuda.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/feather.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/pandas_compat.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/fs.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/acero.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/csv.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/jvm.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/hdfs.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/json.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/compute.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      creating build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_tensor.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_ipc.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/conftest.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_convert_builtin.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_misc.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/arrow_16597.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_acero.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_gandiva.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/strategies.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_adhoc_memory_leak.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/arrow_7980.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/util.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_orc.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_table.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_array.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_deprecations.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/__init__.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_io.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_util.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_cuda_numba_interop.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_cpp_internals.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_cffi.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_schema.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_jvm.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_fs.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_udf.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_filesystem.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/pandas_threaded_import.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/pandas_examples.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_cython.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_sparse_tensor.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_dataset.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_builder.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_cuda.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_extension_type.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_feather.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_pandas.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_memory.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_exec_plan.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_flight.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/read_record_batch.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_json.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_compute.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_hdfs.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_strategies.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_csv.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_scalars.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_gdb.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_types.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/test_substrait.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      creating build/lib.macosx-14-arm64-cpython-312/pyarrow/interchange
      copying pyarrow/interchange/from_dataframe.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/interchange
      copying pyarrow/interchange/dataframe.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/interchange
      copying pyarrow/interchange/__init__.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/interchange
      copying pyarrow/interchange/buffer.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/interchange
      copying pyarrow/interchange/column.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/interchange
      creating build/lib.macosx-14-arm64-cpython-312/pyarrow/vendored
      copying pyarrow/vendored/version.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/vendored
      copying pyarrow/vendored/__init__.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/vendored
      copying pyarrow/vendored/docscrape.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/vendored
      creating build/lib.macosx-14-arm64-cpython-312/pyarrow/parquet
      copying pyarrow/parquet/encryption.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/parquet
      copying pyarrow/parquet/__init__.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/parquet
      copying pyarrow/parquet/core.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/parquet
      creating build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/interchange
      copying pyarrow/tests/interchange/__init__.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/interchange
      copying pyarrow/tests/interchange/test_conversion.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/interchange
      copying pyarrow/tests/interchange/test_interchange_spec.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/interchange
      creating build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/parquet
      copying pyarrow/tests/parquet/test_basic.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/parquet
      copying pyarrow/tests/parquet/conftest.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/parquet
      copying pyarrow/tests/parquet/encryption.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/parquet
      copying pyarrow/tests/parquet/test_parquet_writer.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/parquet
      copying pyarrow/tests/parquet/test_metadata.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/parquet
      copying pyarrow/tests/parquet/__init__.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/parquet
      copying pyarrow/tests/parquet/test_datetime.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/parquet
      copying pyarrow/tests/parquet/common.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/parquet
      copying pyarrow/tests/parquet/test_dataset.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/parquet
      copying pyarrow/tests/parquet/test_data_types.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/parquet
      copying pyarrow/tests/parquet/test_pandas.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/parquet
      copying pyarrow/tests/parquet/test_parquet_file.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/parquet
      copying pyarrow/tests/parquet/test_compliant_nested_type.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/parquet
      copying pyarrow/tests/parquet/test_encryption.py -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/parquet
      running egg_info
      writing pyarrow.egg-info/PKG-INFO
      writing dependency_links to pyarrow.egg-info/dependency_links.txt
      writing requirements to pyarrow.egg-info/requires.txt
      writing top-level names to pyarrow.egg-info/top_level.txt
      ERROR setuptools_scm._file_finders.git listing git files failed - pretending there aren't any
      reading manifest file 'pyarrow.egg-info/SOURCES.txt'
      reading manifest template 'MANIFEST.in'
      warning: no files found matching '../LICENSE.txt'
      warning: no files found matching '../NOTICE.txt'
      warning: no previously-included files matching '*.so' found anywhere in distribution
      warning: no previously-included files matching '*.pyc' found anywhere in distribution
      warning: no previously-included files matching '*~' found anywhere in distribution
      warning: no previously-included files matching '#*' found anywhere in distribution
      warning: no previously-included files matching '.git*' found anywhere in distribution
      warning: no previously-included files matching '.DS_Store' found anywhere in distribution
      no previously-included directories found matching '.asv'
      writing manifest file 'pyarrow.egg-info/SOURCES.txt'
      copying pyarrow/__init__.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_acero.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_acero.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_compute.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_compute.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_csv.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_csv.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_cuda.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_cuda.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_dataset.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_dataset.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_dataset_orc.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_dataset_parquet.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_feather.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_flight.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_fs.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_fs.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_gcsfs.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_hdfs.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_hdfsio.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_json.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_json.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_orc.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_orc.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_parquet.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_parquet.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_parquet_encryption.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_parquet_encryption.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_pyarrow_cpp_tests.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_pyarrow_cpp_tests.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_s3fs.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/_substrait.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/array.pxi -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/benchmark.pxi -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/builder.pxi -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/compat.pxi -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/config.pxi -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/error.pxi -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/gandiva.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/io.pxi -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/ipc.pxi -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/lib.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/lib.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/memory.pxi -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/pandas-shim.pxi -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/public-api.pxi -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/scalar.pxi -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/table.pxi -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/tensor.pxi -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      copying pyarrow/types.pxi -> build/lib.macosx-14-arm64-cpython-312/pyarrow
      creating build/lib.macosx-14-arm64-cpython-312/pyarrow/includes
      copying pyarrow/includes/common.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow/includes
      copying pyarrow/includes/libarrow_feather.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow/includes
      copying pyarrow/includes/libarrow_acero.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow/includes
      copying pyarrow/includes/__init__.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow/includes
      copying pyarrow/includes/libgandiva.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow/includes
      copying pyarrow/includes/libarrow_python.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow/includes
      copying pyarrow/includes/libarrow_flight.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow/includes
      copying pyarrow/includes/libarrow_dataset_parquet.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow/includes
      copying pyarrow/includes/libarrow_dataset.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow/includes
      copying pyarrow/includes/libarrow_substrait.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow/includes
      copying pyarrow/includes/libarrow.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow/includes
      copying pyarrow/includes/libarrow_cuda.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow/includes
      copying pyarrow/includes/libarrow_fs.pxd -> build/lib.macosx-14-arm64-cpython-312/pyarrow/includes
      copying pyarrow/tests/bound_function_visit_strings.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/extensions.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      copying pyarrow/tests/pyarrow_cython_example.pyx -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests
      creating build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data
      creating build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data/feather
      copying pyarrow/tests/data/feather/v0.17.0.version.2-compression.lz4.feather -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data/feather
      creating build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data/orc
      copying pyarrow/tests/data/orc/README.md -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data/orc
      copying pyarrow/tests/data/orc/TestOrcFile.emptyFile.jsn.gz -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data/orc
      copying pyarrow/tests/data/orc/TestOrcFile.emptyFile.orc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data/orc
      copying pyarrow/tests/data/orc/TestOrcFile.test1.jsn.gz -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data/orc
      copying pyarrow/tests/data/orc/TestOrcFile.test1.orc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data/orc
      copying pyarrow/tests/data/orc/TestOrcFile.testDate1900.jsn.gz -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data/orc
      copying pyarrow/tests/data/orc/TestOrcFile.testDate1900.orc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data/orc
      copying pyarrow/tests/data/orc/decimal.jsn.gz -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data/orc
      copying pyarrow/tests/data/orc/decimal.orc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data/orc
      creating build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data/parquet
      copying pyarrow/tests/data/parquet/v0.7.1.all-named-index.parquet -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data/parquet
      copying pyarrow/tests/data/parquet/v0.7.1.column-metadata-handling.parquet -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data/parquet
      copying pyarrow/tests/data/parquet/v0.7.1.parquet -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data/parquet
      copying pyarrow/tests/data/parquet/v0.7.1.some-named-index.parquet -> build/lib.macosx-14-arm64-cpython-312/pyarrow/tests/data/parquet
      creating build/lib.macosx-14-arm64-cpython-312/pyarrow/src
      creating build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow
      creating build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/CMakeLists.txt -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/api.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/arrow_to_pandas.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/arrow_to_pandas.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/arrow_to_python_internal.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/benchmark.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/benchmark.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/common.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/common.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/csv.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/csv.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/datetime.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/datetime.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/decimal.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/decimal.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/deserialize.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/deserialize.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/extension_type.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/extension_type.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/filesystem.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/filesystem.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/flight.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/flight.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/gdb.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/gdb.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/helpers.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/helpers.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/inference.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/inference.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/init.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/init.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/io.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/io.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/ipc.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/ipc.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/iterators.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/numpy_convert.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/numpy_convert.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/numpy_internal.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/numpy_interop.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/numpy_to_arrow.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/numpy_to_arrow.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/parquet_encryption.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/parquet_encryption.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/pch.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/platform.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/pyarrow.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/pyarrow.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/pyarrow_api.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/pyarrow_lib.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/python_test.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/python_test.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/python_to_arrow.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/python_to_arrow.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/serialize.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/serialize.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/type_traits.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/udf.cc -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/udf.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      copying pyarrow/src/arrow/python/visibility.h -> build/lib.macosx-14-arm64-cpython-312/pyarrow/src/arrow/python
      running build_ext
      creating /private/var/folders/yl/p4gfd0yn4g1ff0c92zyh1xt80000gn/T/pip-install-z99mkwmn/pyarrow_61cca4b2a0824ab5b276de9036fe05d6/build/temp.macosx-14-arm64-cpython-312
      -- Running cmake for PyArrow
      cmake -DCMAKE_INSTALL_PREFIX=/private/var/folders/yl/p4gfd0yn4g1ff0c92zyh1xt80000gn/T/pip-install-z99mkwmn/pyarrow_61cca4b2a0824ab5b276de9036fe05d6/build/lib.macosx-14-arm64-cpython-312/pyarrow -DPYTHON_EXECUTABLE=/Users/deniz/Dev/dccloudapi/.venv/bin/python -DPython3_EXECUTABLE=/Users/deniz/Dev/dccloudapi/.venv/bin/python -DPYARROW_CXXFLAGS= -DPYARROW_BUILD_CUDA=off -DPYARROW_BUILD_SUBSTRAIT=off -DPYARROW_BUILD_FLIGHT=off -DPYARROW_BUILD_GANDIVA=off -DPYARROW_BUILD_ACERO=off -DPYARROW_BUILD_DATASET=off -DPYARROW_BUILD_ORC=off -DPYARROW_BUILD_PARQUET=off -DPYARROW_BUILD_PARQUET_ENCRYPTION=off -DPYARROW_BUILD_GCS=off -DPYARROW_BUILD_S3=off -DPYARROW_BUILD_HDFS=off -DPYARROW_BUNDLE_ARROW_CPP=off -DPYARROW_BUNDLE_CYTHON_CPP=off -DPYARROW_GENERATE_COVERAGE=off -DCMAKE_BUILD_TYPE=release /private/var/folders/yl/p4gfd0yn4g1ff0c92zyh1xt80000gn/T/pip-install-z99mkwmn/pyarrow_61cca4b2a0824ab5b276de9036fe05d6
      Traceback (most recent call last):
        File "/Users/deniz/Dev/dccloudapi/.venv/bin/cmake", line 5, in <module>
          from cmake import cmake
      ModuleNotFoundError: No module named 'cmake'
      error: command '/Users/deniz/Dev/dccloudapi/.venv/bin/cmake' failed with exit code 1
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for pyarrow
Failed to build pyarrow
ERROR: Could not build wheels for pyarrow, which is required to install pyproject.toml-based projects

Component(s)

Python

raulcd commented 11 months ago

We are in the process of releasing Arrow 14.0.0 and pyarrow. Currently there are no wheels built for Arrow for Python 3.12 available on PyPI. They will be available once we release.

At the moment your system is trying to build from source and is currently failing to build due to missing cmake. You can try to build from source but you will require to have Arrow CPP installed (or build it yourself). The Python development guide can help you on that: https://arrow.apache.org/docs/developers/python.html#python-development Due to our Release process and the Apache voting mechanism the wheels will take some days to be available, and depending on the number of Release Candidates required might take slightly longer.

You can also use temporary the wheels available on our nightly packages: https://arrow.apache.org/docs/developers/python.html#installing-nightly-packages Those are not official releases so use them at your own risk.

raulcd commented 11 months ago

Of course another temporary option is to use Python 3.11 until the wheels for 3.12 are available but I am not sure if this is possible in your case.

assignUser commented 11 months ago

I will close this as all relevant information is here. If you have issues with building from source please open a new issue or write to the user@arrow.apache.org mailing list.

joaomcarlos commented 10 months ago

Still having this error on Python 3.12 on Windows.

assignUser commented 10 months ago

We have windows wheels for 3.12, must be on your end (probably platform identification going wrong or not amd64?) image

raulcd commented 10 months ago

@joaomcarlos what version of pyarrow are you trying to install? could you share more details?

joaomcarlos commented 10 months ago

Hi, I am trying to pip install taipy, it fails on trying to build the wheel for pyarrow.

Using cached zipp-3.17.0-py3-none-any.whl (7.4 kB)
Building wheels for collected packages: pyarrow
  Building wheel for pyarrow (pyproject.toml) ... error
  error: subprocess-exited-with-error

  × Building wheel for pyarrow (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [294 lines of output]
      <string>:36: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
      WARNING setuptools_scm.pyproject_reading toml section missing 'pyproject.toml does not contain a tool.setuptools_scm section'
      running bdist_wheel
      running build

[.......]

      copying pyarrow\tests\data\orc\decimal.jsn.gz -> build\lib.win-amd64-cpython-312\pyarrow\tests\data\orc
      copying pyarrow\tests\data\orc\decimal.orc -> build\lib.win-amd64-cpython-312\pyarrow\tests\data\orc
xe -DPython3_EXECUTABLE=C:\Python312\python.exe -DPYARROW_CXXFLAGS= -DPYARROW_WITH_DATASET=off -DPYARROW_WITH_PARQUET_ENCRYPTION=off -DPYARROW_WITH_HDFS=off -DPYARROW_WITH_FLIGHT=off -G "Visual Studio 15 2017 Win64" C:\Users\silent\AppData\Local\Temp\pip-install-g2jnuue7\pyarrow_f1db6fdf243144d392a111672e0bb11d\pyarrow/src
      Traceback (most recent call last):
        File "<frozen runpy>", line 198, in _run_module_as_main
        File "<frozen runpy>", line 88, in _run_code
        File "C:\Python312\Scripts\cmake.exe\__main__.py", line 4, in <module>
      ModuleNotFoundError: No module named 'cmake'
      error: command 'C:\\Python312\\Scripts\\cmake.exe' failed with exit code 1
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for pyarrow
Failed to build pyarrow
ERROR: Could not build wheels for pyarrow, which is required to install pyproject.toml-based projects

Strangely enough, if I do pip install pyarrow it says its already installed at 14.0.1

assignUser commented 10 months ago

taipy pins pyarrow to <11: "arrow": ["pyarrow>=10.0.1,<11.0"], and for that no 3.12 wheels exist (as it was not out at the time) so your only choice is to downgrade to 3.11 for which a windows wheels exists. Or of course modify the setup.py of taipy/ask them to unpin.

joaomcarlos commented 10 months ago

Thank you. I hadnt noticed that :/ my bad

joaomcarlos commented 9 months ago

Quick update: Did ask them to unpin at the time. They just updated the issue to "completed".

I am still having the same issue atm, probably they havent released yet. Just adding the note here for future ref.