srinify
commented
2 years ago @helix-loop Arrow is unfortunately a requirement for Superset. If you find any workarounds / suggestions on how to get Arrow working on ppc64 let us know!
Closed helix-loop closed 9 months ago
srinify
commented
2 years ago @helix-loop Arrow is unfortunately a requirement for Superset. If you find any workarounds / suggestions on how to get Arrow working on ppc64 let us know!
helix-loop
commented
2 years ago I got further building Superset by building Arrow and Arrow Python as described at https://arrow.apache.org/docs/developers/python.html
Build is now failing at another step and it seems to me that it could be incompatibilities with the compiled version of Arrow?:
Collecting apache-superset
Using cached apache_superset-1.4.0-py3-none-any.whl
Collecting markdown>=3.0
Using cached Markdown-3.3.6-py3-none-any.whl (97 kB)
Collecting requests==2.26.0
Using cached requests-2.26.0-py2.py3-none-any.whl (62 kB)
Collecting cachelib<0.2,>=0.1.1
Using cached cachelib-0.1.1-py3-none-any.whl (13 kB)
Collecting python-dotenv
Using cached python_dotenv-0.19.2-py2.py3-none-any.whl (17 kB)
Collecting PyJWT<2,>=1.7.1
Using cached PyJWT-1.7.1-py2.py3-none-any.whl (18 kB)
Collecting celery!=4.4.1,<5.0.0,>=4.3.0
Using cached celery-4.4.7-py2.py3-none-any.whl (427 kB)
Collecting msgpack<1.1,>=1.0.0
Using cached msgpack-1.0.3-cp39-cp39-linux_ppc64le.whl
Collecting croniter>=0.3.28
Using cached croniter-1.2.0-py2.py3-none-any.whl (17 kB)
Collecting pyparsing<3.0.0,>=2.4.7
Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting sqlparse==0.3.0
Using cached sqlparse-0.3.0-py2.py3-none-any.whl (39 kB)
Collecting slackclient==2.5.0
Using cached slackclient-2.5.0-py2.py3-none-any.whl (54 kB)
Collecting colorama
Using cached colorama-0.4.4-py2.py3-none-any.whl (16 kB)
Collecting polyline
Using cached polyline-1.4.0-py2.py3-none-any.whl (4.4 kB)
Collecting sqlalchemy!=1.3.21,<1.4,>=1.3.16
Using cached SQLAlchemy-1.3.24-cp39-cp39-linux_ppc64le.whl
Collecting bleach<4.0.0,>=3.0.2
Using cached bleach-3.3.1-py2.py3-none-any.whl (146 kB)
Collecting flask-migrate
Using cached Flask_Migrate-3.1.0-py3-none-any.whl (20 kB)
Collecting flask-talisman
Using cached flask_talisman-0.8.1-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: python-dateutil in ./lib/python3.9/site-packages (from apache-superset) (2.8.2)
Collecting pyyaml>=5.4
Using cached PyYAML-6.0-cp39-cp39-linux_ppc64le.whl
Collecting isodate
Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB)
Collecting sqlalchemy-utils<0.38,>=0.37.8
Using cached SQLAlchemy_Utils-0.37.9-py3-none-any.whl (100 kB)
Collecting pyarrow<4.1,>=4.0.1
Using cached pyarrow-4.0.1.tar.gz (711 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting flask-appbuilder<4.0.0,>=3.4.3
Using cached Flask_AppBuilder-3.4.4-py3-none-any.whl (1.9 MB)
Collecting click<8
Using cached click-7.1.2-py2.py3-none-any.whl (82 kB)
Collecting simplejson>=3.15.0
Using cached simplejson-3.17.6-cp39-cp39-linux_ppc64le.whl
Collecting flask<2.0.0,>=1.1.0
Using cached Flask-1.1.4-py2.py3-none-any.whl (94 kB)
Collecting pandas<1.3,>=1.2.2
Using cached pandas-1.2.5-cp39-cp39-linux_ppc64le.whl
Collecting flask-wtf
Using cached Flask_WTF-1.0.0-py3-none-any.whl (12 kB)
Collecting deprecation<2.2.0,>=2.1.0
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting backoff>=1.8.0
Using cached backoff-1.11.1-py2.py3-none-any.whl (13 kB)
Collecting redis
Using cached redis-4.1.2-py3-none-any.whl (173 kB)
Collecting wtforms-json
Using cached WTForms_JSON-0.3.3-py3-none-any.whl
Collecting gunicorn>=20.1.0
Using cached gunicorn-20.1.0-py3-none-any.whl (79 kB)
Collecting selenium>=3.141.0
Using cached selenium-4.1.0-py3-none-any.whl (958 kB)
Collecting tabulate==0.8.9
Using cached tabulate-0.8.9-py3-none-any.whl (25 kB)
Collecting pgsanity
Using cached pgsanity-0.2.9-py3-none-any.whl
Collecting typing-extensions<4,>=3.10
Using cached typing_extensions-3.10.0.2-py3-none-any.whl (26 kB)
Collecting parsedatetime
Using cached parsedatetime-2.6-py3-none-any.whl (42 kB)
Collecting flask-compress
Using cached Flask_Compress-1.10.1-py3-none-any.whl (7.9 kB)
Collecting python-geohash
Using cached python_geohash-0.8.5-cp39-cp39-linux_ppc64le.whl
Collecting holidays==0.10.3
Using cached holidays-0.10.3-py3-none-any.whl
Collecting cron-descriptor
Using cached cron_descriptor-1.2.24-py3-none-any.whl
Collecting graphlib-backport
Using cached graphlib_backport-1.0.3-py3-none-any.whl (5.1 kB)
Collecting cryptography>=3.3.2
Using cached cryptography-36.0.1-cp39-cp39-linux_ppc64le.whl
Collecting humanize
Using cached humanize-3.14.0-py3-none-any.whl (98 kB)
Collecting geopy
Using cached geopy-2.2.0-py3-none-any.whl (118 kB)
Collecting flask-caching>=1.10.0
Using cached Flask_Caching-1.10.1-py3-none-any.whl (34 kB)
Collecting itsdangerous<2.0.0,>=1.0.0
Using cached itsdangerous-1.1.0-py2.py3-none-any.whl (16 kB)
Requirement already satisfied: six in ./lib/python3.9/site-packages (from holidays==0.10.3->apache-superset) (1.16.0)
Collecting korean-lunar-calendar
Using cached korean_lunar_calendar-0.2.1-py3-none-any.whl (8.0 kB)
Collecting convertdate
Using cached convertdate-2.4.0-py3-none-any.whl (47 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.11-py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.3-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
Using cached urllib3-1.26.8-py2.py3-none-any.whl (138 kB)
Collecting aiohttp>3.5.2
Using cached aiohttp-3.8.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (1.2 MB)
Collecting webencodings
Using cached webencodings-0.5.1-py2.py3-none-any.whl (11 kB)
Collecting packaging
Using cached packaging-21.3-py3-none-any.whl (40 kB)
Collecting pytz>dev
Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB)
Collecting vine==1.3.0
Using cached vine-1.3.0-py2.py3-none-any.whl (14 kB)
Collecting kombu<4.7,>=4.6.10
Using cached kombu-4.6.11-py2.py3-none-any.whl (184 kB)
Collecting billiard<4.0,>=3.6.3.0
Using cached billiard-3.6.4.0-py3-none-any.whl (89 kB)
Collecting cffi>=1.12
Using cached cffi-1.15.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (465 kB)
Collecting Werkzeug<2.0,>=0.15
Using cached Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB)
Collecting Jinja2<3.0,>=2.10.1
Using cached Jinja2-2.11.3-py2.py3-none-any.whl (125 kB)
Collecting prison<1.0.0,>=0.2.1
Using cached prison-0.2.1-py2.py3-none-any.whl (5.8 kB)
Collecting Flask-OpenID<2,>=1.2.5
Using cached Flask_OpenID-1.3.0-py3-none-any.whl (9.3 kB)
Collecting Flask-Login<0.5,>=0.3
Using cached Flask_Login-0.4.1-py2.py3-none-any.whl
Collecting WTForms<3.0.0
Using cached WTForms-2.3.3-py2.py3-none-any.whl (169 kB)
Collecting marshmallow-sqlalchemy<0.27.0,>=0.22.0
Using cached marshmallow_sqlalchemy-0.26.1-py2.py3-none-any.whl (15 kB)
Collecting Flask-Babel<3,>=1
Using cached Flask_Babel-2.0.0-py3-none-any.whl (9.3 kB)
Collecting apispec[yaml]<4,>=3.3
Using cached apispec-3.3.2-py2.py3-none-any.whl (27 kB)
Collecting marshmallow-enum<2,>=1.5.1
Using cached marshmallow_enum-1.5.1-py2.py3-none-any.whl (4.2 kB)
Collecting marshmallow<4,>=3
Using cached marshmallow-3.14.1-py3-none-any.whl (47 kB)
Collecting Flask-JWT-Extended<4,>=3.18
Using cached Flask_JWT_Extended-3.25.1-py2.py3-none-any.whl
Collecting Flask-SQLAlchemy<3,>=2.4
Using cached Flask_SQLAlchemy-2.5.1-py2.py3-none-any.whl (17 kB)
Collecting email-validator<2,>=1.0.5
Using cached email_validator-1.1.3-py2.py3-none-any.whl (18 kB)
Collecting flask-wtf
Using cached Flask_WTF-0.14.3-py2.py3-none-any.whl (13 kB)
Collecting jsonschema<5,>=3
Using cached jsonschema-4.4.0-py3-none-any.whl (72 kB)
Requirement already satisfied: setuptools>=3.0 in ./lib/python3.9/site-packages (from gunicorn>=20.1.0->apache-superset) (44.1.1)
Collecting importlib-metadata>=4.4
Using cached importlib_metadata-4.10.1-py3-none-any.whl (17 kB)
Requirement already satisfied: numpy>=1.16.5 in ./lib/python3.9/site-packages (from pandas<1.3,>=1.2.2->apache-superset) (1.22.1)
Collecting trio~=0.17
Using cached trio-0.19.0-py3-none-any.whl (356 kB)
Collecting trio-websocket~=0.9
Using cached trio_websocket-0.9.2-py3-none-any.whl (16 kB)
Collecting brotli
Using cached Brotli-1.0.9-cp39-cp39-linux_ppc64le.whl
Collecting alembic>=0.7
Using cached alembic-1.7.6-py3-none-any.whl (210 kB)
Collecting geographiclib<2,>=1.49
Using cached geographiclib-1.52-py3-none-any.whl (38 kB)
Collecting deprecated>=1.2.3
Using cached Deprecated-1.2.13-py2.py3-none-any.whl (9.6 kB)
Collecting multidict<7.0,>=4.5
Using cached multidict-6.0.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (121 kB)
Collecting frozenlist>=1.1.1
Using cached frozenlist-1.3.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (163 kB)
Collecting yarl<2.0,>=1.0
Using cached yarl-1.7.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (330 kB)
Collecting attrs>=17.3.0
Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting async-timeout<5.0,>=4.0.0a3
Using cached async_timeout-4.0.2-py3-none-any.whl (5.8 kB)
Collecting aiosignal>=1.1.2
Using cached aiosignal-1.2.0-py3-none-any.whl (8.2 kB)
Collecting Mako
Using cached Mako-1.1.6-py2.py3-none-any.whl (75 kB)
Collecting pycparser
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting wrapt<2,>=1.10
Using cached wrapt-1.13.3-cp39-cp39-linux_ppc64le.whl
Collecting dnspython>=1.15.0
Using cached dnspython-2.2.0-py3-none-any.whl (266 kB)
Collecting Babel>=2.3
Using cached Babel-2.9.1-py2.py3-none-any.whl (8.8 MB)
Collecting python3-openid>=2.0
Using cached python3_openid-3.2.0-py3-none-any.whl (133 kB)
Collecting zipp>=0.5
Using cached zipp-3.7.0-py3-none-any.whl (5.3 kB)
Collecting MarkupSafe>=0.23
Using cached MarkupSafe-2.0.1-cp39-cp39-linux_ppc64le.whl
Collecting pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0
Using cached pyrsistent-0.18.1-cp39-cp39-linux_ppc64le.whl
Collecting amqp<2.7,>=2.6.0
Using cached amqp-2.6.1-py2.py3-none-any.whl (48 kB)
Collecting sortedcontainers
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting outcome
Using cached outcome-1.1.0-py2.py3-none-any.whl (9.7 kB)
Collecting sniffio
Using cached sniffio-1.2.0-py3-none-any.whl (10 kB)
Collecting async-generator>=1.9
Using cached async_generator-1.10-py3-none-any.whl (18 kB)
Collecting wsproto>=0.14
Using cached wsproto-1.0.0-py3-none-any.whl (24 kB)
Collecting pyOpenSSL>=0.14
Using cached pyOpenSSL-22.0.0-py2.py3-none-any.whl (55 kB)
Collecting pymeeus<=1,>=0.3.13
Using cached PyMeeus-0.5.11-py3-none-any.whl
Collecting defusedxml
Using cached defusedxml-0.7.1-py2.py3-none-any.whl (25 kB)
Collecting h11<1,>=0.9.0
Using cached h11-0.13.0-py3-none-any.whl (58 kB)
Building wheels for collected packages: pyarrow
Building wheel for pyarrow (pyproject.toml) ... error
error: subprocess-exited-with-error
× Building wheel for pyarrow (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [142 lines of output]
running bdist_wheel
running build
running build_py
running egg_info
writing pyarrow.egg-info/PKG-INFO
writing dependency_links to pyarrow.egg-info/dependency_links.txt
writing entry points to pyarrow.egg-info/entry_points.txt
writing requirements to pyarrow.egg-info/requires.txt
writing top-level names to pyarrow.egg-info/top_level.txt
listing git files failed - pretending there aren't any
reading manifest file 'pyarrow.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching '../LICENSE.txt'
warning: no files found matching '../NOTICE.txt'
warning: no previously-included files matching '*.so' found anywhere in distribution
warning: no previously-included files matching '*.pyc' found anywhere in distribution
warning: no previously-included files matching '*~' found anywhere in distribution
warning: no previously-included files matching '#*' found anywhere in distribution
warning: no previously-included files matching '.git*' found anywhere in distribution
warning: no previously-included files matching '.DS_Store' found anywhere in distribution
no previously-included directories found matching '.asv'
running build_ext
-- The C compiler identification is GNU 10.2.1
-- The CXX compiler identification is GNU 10.2.1
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/bin/cc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- System processor: ppc64le
-- Performing Test CXX_SUPPORTS_ALTIVEC
-- Performing Test CXX_SUPPORTS_ALTIVEC - Success
-- Arrow build warning level: PRODUCTION
Using ld linker
Configured for RELEASE build (set with cmake -DCMAKE_BUILD_TYPE={release,debug,...})
-- Build Type: RELEASE
-- Generator: Unix Makefiles
-- Build output directory: /tmp/user/1000/pip-install-wclvqiry/pyarrow_0a8760f971b34919a51d0a19718454e7/build/temp.linux-ppc64le-3.9/release
-- Found Python3: /path/abc/venv/bin/python3 (found version "3.9.2") found components: Interpreter Development.Module NumPy
-- Found Python3Alt: /path/abc/venv/bin/python3
CMake Warning (dev) at /usr/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:273 (message):
The package name passed to `find_package_handle_standard_args` (PkgConfig)
does not match the name of the calling package (Arrow). This can lead to
problems in calling code that expects `find_package` result variables
(e.g., `_FOUND`) to follow a certain pattern.
Call Stack (most recent call first):
/usr/share/cmake-3.18/Modules/FindPkgConfig.cmake:59 (find_package_handle_standard_args)
cmake_modules/FindArrow.cmake:39 (include)
cmake_modules/FindArrowPython.cmake:46 (find_package)
CMakeLists.txt:218 (find_package)
This warning is for project developers. Use -Wno-dev to suppress it.
-- Found PkgConfig: /usr/bin/pkg-config (found version "0.29.2")
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Check if compiler accepts -pthread
-- Check if compiler accepts -pthread - yes
-- Found Threads: TRUE
-- Found ZLIB: /usr/lib/powerpc64le-linux-gnu/libz.so (found version "1.2.11")
-- Found Arrow: /include (found version "7.0.0-SNAPSHOT")
-- Arrow version: 7.0.0-SNAPSHOT (CMake package configuration: Arrow)
-- Arrow SO and ABI version: 700
-- Arrow full SO version: 700.0.0
-- Found the Arrow core shared library: /lib/libarrow.so
-- Found the Arrow core import library:
-- Found the Arrow core static library: /lib/libarrow.a
-- Could NOT find ArrowPython (missing: ArrowPython_DIR)
-- Checking for module 'arrow-python'
-- Found arrow-python, version 7.0.0-SNAPSHOT
-- Found ArrowPython: /include (found version "7.0.0-SNAPSHOT")
-- Found the Arrow Python by pkg-config: arrow-python
-- Found the Arrow Python shared library: /usr/lib/libarrow_python.so
-- Found the Arrow Python import library:
-- Found the Arrow Python static library: /lib/libarrow_python.a
-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/user/1000/pip-install-wclvqiry/pyarrow_0a8760f971b34919a51d0a19718454e7/build/temp.linux-ppc64le-3.9
Scanning dependencies of target _csv_pyx
[ 6%] Compiling Cython CXX source for _csv...
[ 6%] Built target _csv_pyx
Scanning dependencies of target _csv
[ 13%] Building CXX object CMakeFiles/_csv.dir/_csv.cpp.o
/tmp/user/1000/pip-install-wclvqiry/pyarrow_0a8760f971b34919a51d0a19718454e7/build/temp.linux-ppc64le-3.9/_csv.cpp: In function ‘PyObject* __pyx_pf_7pyarrow_4_csv_4write_csv(PyObject*, PyObject*, PyObject*, PyObject*, __pyx_obj_7pyarrow_3lib_MemoryPool*)’:
/tmp/user/1000/pip-install-wclvqiry/pyarrow_0a8760f971b34919a51d0a19718454e7/build/temp.linux-ppc64le-3.9/_csv.cpp:15529:165: error: no matching function for call to ‘WriteCSV(arrow::RecordBatch&, arrow::csv::WriteOptions&, arrow::MemoryPool*&, std::__shared_ptr<arrow::io::OutputStream, __gnu_cxx::_S_atomic>::element_type*)’
15529 | __pyx_t_4 = __pyx_f_7pyarrow_3lib_check_status(arrow::csv::WriteCSV((*__pyx_v_batch), __pyx_v_c_write_options, __pyx_v_c_memory_pool, __pyx_v_stream.get())); if (unlikely(__pyx_t_4 == ((int)-1))) __PYX_ERR(0, 944, __pyx_L5_error)
| ^
In file included from /include/arrow/csv/api.h:26,
from /tmp/user/1000/pip-install-wclvqiry/pyarrow_0a8760f971b34919a51d0a19718454e7/build/temp.linux-ppc64le-3.9/_csv.cpp:766:
/include/arrow/csv/writer.h:45:21: note: candidate: ‘arrow::Status arrow::csv::WriteCSV(const arrow::Table&, const arrow::csv::WriteOptions&, arrow::io::OutputStream*)’
45 | ARROW_EXPORT Status WriteCSV(const Table& table, const WriteOptions& options,
| ^~~~~~~~
/include/arrow/csv/writer.h:45:21: note: candidate expects 3 arguments, 4 provided
/include/arrow/csv/writer.h:49:21: note: candidate: ‘arrow::Status arrow::csv::WriteCSV(const arrow::RecordBatch&, const arrow::csv::WriteOptions&, arrow::io::OutputStream*)’
49 | ARROW_EXPORT Status WriteCSV(const RecordBatch& batch, const WriteOptions& options,
| ^~~~~~~~
/include/arrow/csv/writer.h:49:21: note: candidate expects 3 arguments, 4 provided
/include/arrow/csv/writer.h:54:21: note: candidate: ‘arrow::Status arrow::csv::WriteCSV(const std::shared_ptr<arrow::RecordBatchReader>&, const arrow::csv::WriteOptions&, arrow::io::OutputStream*)’
54 | ARROW_EXPORT Status WriteCSV(const std::shared_ptr<RecordBatchReader>& reader,
| ^~~~~~~~
/include/arrow/csv/writer.h:54:21: note: candidate expects 3 arguments, 4 provided
/tmp/user/1000/pip-install-wclvqiry/pyarrow_0a8760f971b34919a51d0a19718454e7/build/temp.linux-ppc64le-3.9/_csv.cpp:15610:165: error: no matching function for call to ‘WriteCSV(arrow::Table&, arrow::csv::WriteOptions&, arrow::MemoryPool*&, std::__shared_ptr<arrow::io::OutputStream, __gnu_cxx::_S_atomic>::element_type*)’
15610 | __pyx_t_4 = __pyx_f_7pyarrow_3lib_check_status(arrow::csv::WriteCSV((*__pyx_v_table), __pyx_v_c_write_options, __pyx_v_c_memory_pool, __pyx_v_stream.get())); if (unlikely(__pyx_t_4 == ((int)-1))) __PYX_ERR(0, 949, __pyx_L8_error)
| ^
In file included from /include/arrow/csv/api.h:26,
from /tmp/user/1000/pip-install-wclvqiry/pyarrow_0a8760f971b34919a51d0a19718454e7/build/temp.linux-ppc64le-3.9/_csv.cpp:766:
/include/arrow/csv/writer.h:45:21: note: candidate: ‘arrow::Status arrow::csv::WriteCSV(const arrow::Table&, const arrow::csv::WriteOptions&, arrow::io::OutputStream*)’
45 | ARROW_EXPORT Status WriteCSV(const Table& table, const WriteOptions& options,
| ^~~~~~~~
/include/arrow/csv/writer.h:45:21: note: candidate expects 3 arguments, 4 provided
/include/arrow/csv/writer.h:49:21: note: candidate: ‘arrow::Status arrow::csv::WriteCSV(const arrow::RecordBatch&, const arrow::csv::WriteOptions&, arrow::io::OutputStream*)’
49 | ARROW_EXPORT Status WriteCSV(const RecordBatch& batch, const WriteOptions& options,
| ^~~~~~~~
/include/arrow/csv/writer.h:49:21: note: candidate expects 3 arguments, 4 provided
/include/arrow/csv/writer.h:54:21: note: candidate: ‘arrow::Status arrow::csv::WriteCSV(const std::shared_ptr<arrow::RecordBatchReader>&, const arrow::csv::WriteOptions&, arrow::io::OutputStream*)’
54 | ARROW_EXPORT Status WriteCSV(const std::shared_ptr<RecordBatchReader>& reader,
| ^~~~~~~~
/include/arrow/csv/writer.h:54:21: note: candidate expects 3 arguments, 4 provided
In file included from /usr/include/powerpc64le-linux-gnu/bits/types/stack_t.h:23,
from /usr/include/signal.h:303,
from /include/arrow/util/io_util.h:30,
from /include/arrow/util/async_generator.h:30,
from /include/arrow/ipc/reader.h:35,
from /include/arrow/ipc/api.h:24,
from /tmp/user/1000/pip-install-wclvqiry/pyarrow_0a8760f971b34919a51d0a19718454e7/build/temp.linux-ppc64le-3.9/_csv.cpp:764:
/tmp/user/1000/pip-install-wclvqiry/pyarrow_0a8760f971b34919a51d0a19718454e7/build/temp.linux-ppc64le-3.9/_csv.cpp: In function ‘int __Pyx_modinit_type_init_code()’:
/tmp/user/1000/pip-install-wclvqiry/pyarrow_0a8760f971b34919a51d0a19718454e7/build/temp.linux-ppc64le-3.9/_csv.cpp:19159:138: warning: ‘offsetof’ within non-standard-layout type ‘__pyx_obj_7pyarrow_4_csv_ParseOptions’ is conditionally-supported [-Winvalid-offsetof]
19159 | if (__pyx_type_7pyarrow_4_csv_ParseOptions.tp_weaklistoffset == 0) __pyx_type_7pyarrow_4_csv_ParseOptions.tp_weaklistoffset = offsetof(struct __pyx_obj_7pyarrow_4_csv_ParseOptions, __pyx_base.__weakref__);
| ^
gmake[2]: *** [CMakeFiles/_csv.dir/build.make:82: CMakeFiles/_csv.dir/_csv.cpp.o] error 1
gmake[1]: *** [CMakeFiles/Makefile2:135: CMakeFiles/_csv.dir/all] error 2
gmake: *** [Makefile:103: all] error 2
-- Running cmake for pyarrow
-- Finished cmake for pyarrow
-- Running cmake --build for pyarrow
error: command '/usr/bin/cmake' failed with exit code 2
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for pyarrow
Failed to build pyarrow
ERROR: Could not build wheels for pyarrow, which is required to install pyproject.toml-based projectsIs there a specific Arrow version I could try with that should work with the specific Superset version or is there another thing to try?
stale[bot]
commented
2 years ago This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. For admin, please label this issue .pinned to prevent stale bot from closing the issue.
rusackas
commented
1 year ago Hi @helix-loop - just wondering if you've been able to take a look at this lately to see if there have been any updates that might make Arrow work on your setup, of if anything has been (by unlikely magic) fixed in newer versions of Superset (particularly 2.0+). Let us know if you think we should keep this issue open, as we no longer officially support versions of Superset prior to 1.5.x.
Trying to install superset (https://superset.apache.org/docs/installation/installing-superset-from-scratch) fails with the following errors, indicating a build error with pyarrow:
How to reproduce the bug
pip3 install apache-superset-- Could NOT find Arrow (missing: Arrow_DIR) -- Checking for module 'arrow' -- No package 'arrow' found CMake Error at /usr/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:165 (message): Could NOT find Arrow (missing: ARROW_INCLUDE_DIR ARROW_LIB_DIR ARROW_FULL_SO_VERSION ARROW_SO_VERSION) Call Stack (most recent call first): /usr/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:458 (_FPHSA_FAILURE_MESSAGE) cmake_modules/FindArrow.cmake:419 (find_package_handle_standard_args) cmake_modules/FindArrowPython.cmake:46 (find_package) CMakeLists.txt:218 (find_package)
Collecting apache-superset Using cached apache-superset-1.4.0.tar.gz (32.9 MB) Preparing metadata (setup.py) ... done Collecting PyJWT<2,>=1.7.1 Using cached PyJWT-1.7.1-py2.py3-none-any.whl (18 kB) Collecting backoff>=1.8.0 Using cached backoff-1.11.1-py2.py3-none-any.whl (13 kB) Collecting bleach<4.0.0,>=3.0.2 Using cached bleach-3.3.1-py2.py3-none-any.whl (146 kB) Collecting cachelib<0.2,>=0.1.1 Using cached cachelib-0.1.1-py3-none-any.whl (13 kB) Collecting celery!=4.4.1,<5.0.0,>=4.3.0 Using cached celery-4.4.7-py2.py3-none-any.whl (427 kB) Collecting click<8 Using cached click-7.1.2-py2.py3-none-any.whl (82 kB) Collecting colorama Using cached colorama-0.4.4-py2.py3-none-any.whl (16 kB) Collecting cron-descriptor Using cached cron_descriptor-1.2.24.tar.gz (22 kB) Preparing metadata (setup.py) ... done Collecting croniter>=0.3.28 Using cached croniter-1.2.0-py2.py3-none-any.whl (17 kB) Collecting cryptography>=3.3.2 Using cached cryptography-36.0.1-cp39-cp39-linux_ppc64le.whl Collecting deprecation<2.2.0,>=2.1.0 Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB) Collecting flask-appbuilder<4.0.0,>=3.4.3 Using cached Flask_AppBuilder-3.4.4-py3-none-any.whl (1.9 MB) Collecting flask-caching>=1.10.0 Using cached Flask_Caching-1.10.1-py3-none-any.whl (34 kB) Collecting flask-compress Using cached Flask_Compress-1.10.1-py3-none-any.whl (7.9 kB) Collecting flask-migrate Using cached Flask_Migrate-3.1.0-py3-none-any.whl (20 kB) Collecting flask-talisman Using cached flask_talisman-0.8.1-py2.py3-none-any.whl (18 kB) Collecting flask-wtf Using cached Flask_WTF-1.0.0-py3-none-any.whl (12 kB) Collecting flask<2.0.0,>=1.1.0 Using cached Flask-1.1.4-py2.py3-none-any.whl (94 kB) Collecting geopy Using cached geopy-2.2.0-py3-none-any.whl (118 kB) Collecting graphlib-backport Using cached graphlib_backport-1.0.3-py3-none-any.whl (5.1 kB) Collecting gunicorn>=20.1.0 Using cached gunicorn-20.1.0-py3-none-any.whl (79 kB) Collecting holidays==0.10.3 Using cached holidays-0.10.3.tar.gz (114 kB) Preparing metadata (setup.py) ... done Collecting humanize Using cached humanize-3.14.0-py3-none-any.whl (98 kB) Collecting isodate Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB) Collecting itsdangerous<2.0.0,>=1.0.0 Using cached itsdangerous-1.1.0-py2.py3-none-any.whl (16 kB) Collecting markdown>=3.0 Using cached Markdown-3.3.6-py3-none-any.whl (97 kB) Collecting msgpack<1.1,>=1.0.0 Using cached msgpack-1.0.3.tar.gz (123 kB) Preparing metadata (setup.py) ... done Collecting pandas<1.3,>=1.2.2 Using cached pandas-1.2.5-cp39-cp39-linux_ppc64le.whl Collecting parsedatetime Using cached parsedatetime-2.6-py3-none-any.whl (42 kB) Collecting pgsanity Using cached pgsanity-0.2.9.tar.gz (7.5 kB) Preparing metadata (setup.py) ... done Collecting polyline Using cached polyline-1.4.0-py2.py3-none-any.whl (4.4 kB) Collecting pyarrow<4.1,>=4.0.1 Using cached pyarrow-4.0.1.tar.gz (711 kB) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Collecting pyparsing<3.0.0,>=2.4.7 Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB) Requirement already satisfied: python-dateutil in ./venv/lib/python3.9/site-packages (from apache-superset) (2.8.2) Collecting python-dotenv Using cached python_dotenv-0.19.2-py2.py3-none-any.whl (17 kB) Collecting python-geohash Using cached python-geohash-0.8.5.tar.gz (17 kB) Preparing metadata (setup.py) ... done Collecting pyyaml>=5.4 Using cached PyYAML-6.0-cp39-cp39-linux_ppc64le.whl Collecting redis Using cached redis-4.1.2-py3-none-any.whl (173 kB) Collecting requests==2.26.0 Using cached requests-2.26.0-py2.py3-none-any.whl (62 kB) Collecting selenium>=3.141.0 Using cached selenium-4.1.0-py3-none-any.whl (958 kB) Collecting simplejson>=3.15.0 Using cached simplejson-3.17.6.tar.gz (83 kB) Preparing metadata (setup.py) ... done Collecting slackclient==2.5.0 Using cached slackclient-2.5.0-py2.py3-none-any.whl (54 kB) Collecting sqlalchemy!=1.3.21,<1.4,>=1.3.16 Using cached SQLAlchemy-1.3.24.tar.gz (6.4 MB) Preparing metadata (setup.py) ... done Collecting sqlalchemy-utils<0.38,>=0.37.8 Using cached SQLAlchemy_Utils-0.37.9-py3-none-any.whl (100 kB) Collecting sqlparse==0.3.0 Using cached sqlparse-0.3.0-py2.py3-none-any.whl (39 kB) Collecting tabulate==0.8.9 Using cached tabulate-0.8.9-py3-none-any.whl (25 kB) Collecting typing-extensions<4,>=3.10 Using cached typing_extensions-3.10.0.2-py3-none-any.whl (26 kB) Collecting wtforms-json Using cached WTForms-JSON-0.3.3.tar.gz (11 kB) Preparing metadata (setup.py) ... done Collecting convertdate Using cached convertdate-2.4.0-py3-none-any.whl (47 kB) Collecting korean_lunar_calendar Using cached korean_lunar_calendar-0.2.1-py3-none-any.whl (8.0 kB) Requirement already satisfied: six in ./venv/lib/python3.9/site-packages (from holidays==0.10.3->apache-superset) (1.16.0) Collecting idna<4,>=2.5 Using cached idna-3.3-py3-none-any.whl (61 kB) Collecting urllib3<1.27,>=1.21.1 Using cached urllib3-1.26.8-py2.py3-none-any.whl (138 kB) Collecting certifi>=2017.4.17 Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB) Collecting charset-normalizer~=2.0.0 Using cached charset_normalizer-2.0.11-py3-none-any.whl (39 kB) Collecting aiohttp>3.5.2 Using cached aiohttp-3.8.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (1.2 MB) Collecting webencodings Using cached webencodings-0.5.1-py2.py3-none-any.whl (11 kB) Collecting packaging Using cached packaging-21.3-py3-none-any.whl (40 kB) Collecting vine==1.3.0 Using cached vine-1.3.0-py2.py3-none-any.whl (14 kB) Collecting billiard<4.0,>=3.6.3.0 Using cached billiard-3.6.4.0-py3-none-any.whl (89 kB) Collecting pytz>dev Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB) Collecting kombu<4.7,>=4.6.10 Using cached kombu-4.6.11-py2.py3-none-any.whl (184 kB) Collecting cffi>=1.12 Using cached cffi-1.15.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (465 kB) Collecting Werkzeug<2.0,>=0.15 Using cached Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB) Collecting Jinja2<3.0,>=2.10.1 Using cached Jinja2-2.11.3-py2.py3-none-any.whl (125 kB) Collecting flask-wtf Using cached Flask_WTF-0.14.3-py2.py3-none-any.whl (13 kB) Collecting marshmallow-sqlalchemy<0.27.0,>=0.22.0 Using cached marshmallow_sqlalchemy-0.26.1-py2.py3-none-any.whl (15 kB) Collecting Flask-JWT-Extended<4,>=3.18 Using cached Flask-JWT-Extended-3.25.1.tar.gz (32 kB) Preparing metadata (setup.py) ... done Collecting apispec[yaml]<4,>=3.3 Using cached apispec-3.3.2-py2.py3-none-any.whl (27 kB) Collecting Flask-Login<0.5,>=0.3 Using cached Flask-Login-0.4.1.tar.gz (14 kB) Preparing metadata (setup.py) ... done Collecting email-validator<2,>=1.0.5 Using cached email_validator-1.1.3-py2.py3-none-any.whl (18 kB) Collecting jsonschema<5,>=3 Using cached jsonschema-4.4.0-py3-none-any.whl (72 kB) Collecting Flask-SQLAlchemy<3,>=2.4 Using cached Flask_SQLAlchemy-2.5.1-py2.py3-none-any.whl (17 kB) Collecting marshmallow-enum<2,>=1.5.1 Using cached marshmallow_enum-1.5.1-py2.py3-none-any.whl (4.2 kB) Collecting prison<1.0.0,>=0.2.1 Using cached prison-0.2.1-py2.py3-none-any.whl (5.8 kB) Collecting marshmallow<4,>=3 Using cached marshmallow-3.14.1-py3-none-any.whl (47 kB) Collecting Flask-OpenID<2,>=1.2.5 Using cached Flask_OpenID-1.3.0-py3-none-any.whl (9.3 kB) Collecting WTForms<3.0.0 Using cached WTForms-2.3.3-py2.py3-none-any.whl (169 kB) Collecting Flask-Babel<3,>=1 Using cached Flask_Babel-2.0.0-py3-none-any.whl (9.3 kB) Requirement already satisfied: setuptools>=3.0 in ./venv/lib/python3.9/site-packages (from gunicorn>=20.1.0->apache-superset) (44.1.1) Collecting importlib-metadata>=4.4 Using cached importlib_metadata-4.10.1-py3-none-any.whl (17 kB) Collecting numpy>=1.16.5 Using cached numpy-1.22.1-cp39-cp39-linux_ppc64le.whl Collecting trio~=0.17 Using cached trio-0.19.0-py3-none-any.whl (356 kB) Collecting trio-websocket~=0.9 Using cached trio_websocket-0.9.2-py3-none-any.whl (16 kB) Collecting brotli Using cached Brotli-1.0.9.zip (510 kB) Preparing metadata (setup.py) ... done Collecting alembic>=0.7 Using cached alembic-1.7.5-py3-none-any.whl (209 kB) Collecting geographiclib<2,>=1.49 Using cached geographiclib-1.52-py3-none-any.whl (38 kB) Collecting deprecated>=1.2.3 Using cached Deprecated-1.2.13-py2.py3-none-any.whl (9.6 kB) Collecting yarl<2.0,>=1.0 Using cached yarl-1.7.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (330 kB) Collecting async-timeout<5.0,>=4.0.0a3 Using cached async_timeout-4.0.2-py3-none-any.whl (5.8 kB) Collecting aiosignal>=1.1.2 Using cached aiosignal-1.2.0-py3-none-any.whl (8.2 kB) Collecting multidict<7.0,>=4.5 Using cached multidict-6.0.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (121 kB) Collecting frozenlist>=1.1.1 Using cached frozenlist-1.3.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (163 kB) Collecting attrs>=17.3.0 Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB) Collecting Mako Using cached Mako-1.1.6-py2.py3-none-any.whl (75 kB) Collecting pycparser Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB) Collecting wrapt<2,>=1.10 Using cached wrapt-1.13.3.tar.gz (48 kB) Preparing metadata (setup.py) ... done Collecting dnspython>=1.15.0 Using cached dnspython-2.2.0-py3-none-any.whl (266 kB) Collecting Babel>=2.3 Using cached Babel-2.9.1-py2.py3-none-any.whl (8.8 MB) Collecting python3-openid>=2.0 Using cached python3_openid-3.2.0-py3-none-any.whl (133 kB) Collecting zipp>=0.5 Using cached zipp-3.7.0-py3-none-any.whl (5.3 kB) Collecting MarkupSafe>=0.23 Using cached MarkupSafe-2.0.1.tar.gz (18 kB) Preparing metadata (setup.py) ... done Collecting pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 Using cached pyrsistent-0.18.1-cp39-cp39-linux_ppc64le.whl Collecting amqp<2.7,>=2.6.0 Using cached amqp-2.6.1-py2.py3-none-any.whl (48 kB) Collecting sortedcontainers Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting async-generator>=1.9 Using cached async_generator-1.10-py3-none-any.whl (18 kB) Collecting outcome Using cached outcome-1.1.0-py2.py3-none-any.whl (9.7 kB) Collecting sniffio Using cached sniffio-1.2.0-py3-none-any.whl (10 kB) Collecting wsproto>=0.14 Using cached wsproto-1.0.0-py3-none-any.whl (24 kB) Collecting pyOpenSSL>=0.14 Using cached pyOpenSSL-22.0.0-py2.py3-none-any.whl (55 kB) Collecting pymeeus<=1,>=0.3.13 Using cached PyMeeus-0.5.11.tar.gz (5.4 MB) Preparing metadata (setup.py) ... done Collecting defusedxml Using cached defusedxml-0.7.1-py2.py3-none-any.whl (25 kB) Collecting h11<1,>=0.9.0 Using cached h11-0.13.0-py3-none-any.whl (58 kB) Building wheels for collected packages: apache-superset, holidays, msgpack, pyarrow, simplejson, sqlalchemy, cron-descriptor, pgsanity, python-geohash, wtforms-json, Flask-JWT-Extended, Flask-Login, brotli, MarkupSafe, pymeeus, wrapt Building wheel for apache-superset (setup.py) ... done Created wheel for apache-superset: filename=apache_superset-1.4.0-py3-none-any.whl size=33847789 sha256=4df836e7a842c995bf6acc0eca948b47787f58f7d72345101f42bd1e0b3ceb37 Stored in directory: /path/abc/.cache/pip/wheels/8b/4a/9b/3e561ce0ba37b2de083ab07619ec9bf26462c5f4246f327b25 Building wheel for holidays (setup.py) ... done Created wheel for holidays: filename=holidays-0.10.3-py3-none-any.whl size=115853 sha256=905eaa1de5fcd2440d58c769125e5a8735b9af9e7913b282ab1c5454623951f4 Stored in directory: /path/abc/.cache/pip/wheels/90/74/7d/7c969133a4597e0a11496ec8aacc385778490b614465cb3404 Building wheel for msgpack (setup.py) ... done Created wheel for msgpack: filename=msgpack-1.0.3-cp39-cp39-linux_ppc64le.whl size=302518 sha256=94c3fafe4446df2c8bbd30fe8088048af4abf79ec854b83d07842e1ed00fd491 Stored in directory: /path/abc/.cache/pip/wheels/4d/a1/f8/5c0e1e277305cf63ca39b0ffee58ba988b689272a093d36cc1 Building wheel for pyarrow (pyproject.toml) ... error error: subprocess-exited-with-error
× Building wheel for pyarrow (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [231 lines of output] running bdist_wheel running build running build_py creating build creating build/lib.linux-ppc64le-3.9 creating build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/cffi.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/csv.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/flight.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/compat.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/plasma.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/compute.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/benchmark.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/parquet.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/types.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/orc.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/filesystem.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/jvm.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/pandas_compat.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/hdfs.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/dataset.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/init.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_generated_version.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/util.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/ipc.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/fs.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/cuda.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/serialization.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/json.py -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/feather.py -> build/lib.linux-ppc64le-3.9/pyarrow creating build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_dataset.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/deserialize_buffer.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_gandiva.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_array.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_types.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_flight.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_deprecations.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_schema.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_memory.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_io.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_csv.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_plasma_tf_op.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/pandas_examples.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_pandas.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_extension_type.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_ipc.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_tensor.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_cuda_numba_interop.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_plasma.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_serialization_deprecated.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_misc.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_sparse_tensor.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/strategies.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_fs.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_filesystem.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/pandas_threaded_import.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_builder.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_cuda.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_hdfs.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_compute.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/init.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_cython.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_scalars.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_orc.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/util.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_serialization.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_table.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_convert_builtin.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/conftest.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_cffi.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_adhoc_memory_leak.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_feather.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/arrow_7980.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_strategies.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_json.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests copying pyarrow/tests/test_jvm.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests running egg_info listing git files failed - pretending there aren't any warning: no files found matching '../LICENSE.txt' warning: no files found matching '../NOTICE.txt' warning: no previously-included files matching '.so' found anywhere in distribution warning: no previously-included files matching '.pyc' found anywhere in distribution warning: no previously-included files matching '~' found anywhere in distribution warning: no previously-included files matching '#' found anywhere in distribution warning: no previously-included files matching '.git*' found anywhere in distribution warning: no previously-included files matching '.DS_Store' found anywhere in distribution no previously-included directories found matching '.asv' writing manifest file 'pyarrow.egg-info/SOURCES.txt' copying pyarrow/init.pxd -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_compute.pxd -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_compute.pyx -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_csv.pxd -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_csv.pyx -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_cuda.pxd -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_cuda.pyx -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_dataset.pyx -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_flight.pyx -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_fs.pxd -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_fs.pyx -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_hdfs.pyx -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_json.pyx -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_orc.pxd -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_orc.pyx -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_parquet.pxd -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_parquet.pyx -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_plasma.pyx -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/_s3fs.pyx -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/array.pxi -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/benchmark.pxi -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/builder.pxi -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/compat.pxi -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/config.pxi -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/error.pxi -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/feather.pxi -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/gandiva.pyx -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/io-hdfs.pxi -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/io.pxi -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/ipc.pxi -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/lib.pxd -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/lib.pyx -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/memory.pxi -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/pandas-shim.pxi -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/public-api.pxi -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/scalar.pxi -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/serialization.pxi -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/table.pxi -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/tensor.pxi -> build/lib.linux-ppc64le-3.9/pyarrow copying pyarrow/types.pxi -> build/lib.linux-ppc64le-3.9/pyarrow creating build/lib.linux-ppc64le-3.9/pyarrow/includes copying pyarrow/includes/init.pxd -> build/lib.linux-ppc64le-3.9/pyarrow/includes copying pyarrow/includes/common.pxd -> build/lib.linux-ppc64le-3.9/pyarrow/includes copying pyarrow/includes/libarrow.pxd -> build/lib.linux-ppc64le-3.9/pyarrow/includes copying pyarrow/includes/libarrow_cuda.pxd -> build/lib.linux-ppc64le-3.9/pyarrow/includes copying pyarrow/includes/libarrow_dataset.pxd -> build/lib.linux-ppc64le-3.9/pyarrow/includes copying pyarrow/includes/libarrow_flight.pxd -> build/lib.linux-ppc64le-3.9/pyarrow/includes copying pyarrow/includes/libarrow_fs.pxd -> build/lib.linux-ppc64le-3.9/pyarrow/includes copying pyarrow/includes/libgandiva.pxd -> build/lib.linux-ppc64le-3.9/pyarrow/includes copying pyarrow/includes/libplasma.pxd -> build/lib.linux-ppc64le-3.9/pyarrow/includes creating build/lib.linux-ppc64le-3.9/pyarrow/tensorflow copying pyarrow/tensorflow/plasma_op.cc -> build/lib.linux-ppc64le-3.9/pyarrow/tensorflow creating build/lib.linux-ppc64le-3.9/pyarrow/vendored copying pyarrow/vendored/init.py -> build/lib.linux-ppc64le-3.9/pyarrow/vendored copying pyarrow/vendored/version.py -> build/lib.linux-ppc64le-3.9/pyarrow/vendored copying pyarrow/tests/pyarrow_cython_example.pyx -> build/lib.linux-ppc64le-3.9/pyarrow/tests creating build/lib.linux-ppc64le-3.9/pyarrow/tests/data creating build/lib.linux-ppc64le-3.9/pyarrow/tests/data/feather copying pyarrow/tests/data/feather/v0.17.0.version=2-compression=lz4.feather -> build/lib.linux-ppc64le-3.9/pyarrow/tests/data/feather creating build/lib.linux-ppc64le-3.9/pyarrow/tests/data/orc copying pyarrow/tests/data/orc/README.md -> build/lib.linux-ppc64le-3.9/pyarrow/tests/data/orc copying pyarrow/tests/data/orc/TestOrcFile.emptyFile.jsn.gz -> build/lib.linux-ppc64le-3.9/pyarrow/tests/data/orc copying pyarrow/tests/data/orc/TestOrcFile.emptyFile.orc -> build/lib.linux-ppc64le-3.9/pyarrow/tests/data/orc copying pyarrow/tests/data/orc/TestOrcFile.test1.jsn.gz -> build/lib.linux-ppc64le-3.9/pyarrow/tests/data/orc copying pyarrow/tests/data/orc/TestOrcFile.test1.orc -> build/lib.linux-ppc64le-3.9/pyarrow/tests/data/orc copying pyarrow/tests/data/orc/TestOrcFile.testDate1900.jsn.gz -> build/lib.linux-ppc64le-3.9/pyarrow/tests/data/orc copying pyarrow/tests/data/orc/TestOrcFile.testDate1900.orc -> build/lib.linux-ppc64le-3.9/pyarrow/tests/data/orc copying pyarrow/tests/data/orc/decimal.jsn.gz -> build/lib.linux-ppc64le-3.9/pyarrow/tests/data/orc copying pyarrow/tests/data/orc/decimal.orc -> build/lib.linux-ppc64le-3.9/pyarrow/tests/data/orc creating build/lib.linux-ppc64le-3.9/pyarrow/tests/data/parquet copying pyarrow/tests/data/parquet/v0.7.1.all-named-index.parquet -> build/lib.linux-ppc64le-3.9/pyarrow/tests/data/parquet copying pyarrow/tests/data/parquet/v0.7.1.column-metadata-handling.parquet -> build/lib.linux-ppc64le-3.9/pyarrow/tests/data/parquet copying pyarrow/tests/data/parquet/v0.7.1.parquet -> build/lib.linux-ppc64le-3.9/pyarrow/tests/data/parquet copying pyarrow/tests/data/parquet/v0.7.1.some-named-index.parquet -> build/lib.linux-ppc64le-3.9/pyarrow/tests/data/parquet creating build/lib.linux-ppc64le-3.9/pyarrow/tests/parquet copying pyarrow/tests/parquet/common.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests/parquet copying pyarrow/tests/parquet/conftest.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests/parquet copying pyarrow/tests/parquet/test_basic.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests/parquet copying pyarrow/tests/parquet/test_compliant_nested_type.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests/parquet copying pyarrow/tests/parquet/test_data_types.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests/parquet copying pyarrow/tests/parquet/test_dataset.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests/parquet copying pyarrow/tests/parquet/test_datetime.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests/parquet copying pyarrow/tests/parquet/test_metadata.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests/parquet copying pyarrow/tests/parquet/test_pandas.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests/parquet copying pyarrow/tests/parquet/test_parquet_file.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests/parquet copying pyarrow/tests/parquet/test_parquet_writer.py -> build/lib.linux-ppc64le-3.9/pyarrow/tests/parquet running build_ext creating /tmp/user/1000/pip-install-9n7xw0m8/pyarrow_002a74e354d44a00bb1f1b4e4620d460/build/temp.linux-ppc64le-3.9 -- Running cmake for pyarrow cmake -DPYTHON_EXECUTABLE=/path/abc/venv/bin/python3 -DPython3_EXECUTABLE=/path/abc/venv/bin/python3 "" -DPYARROW_BUILD_CUDA=off -DPYARROW_BUILD_FLIGHT=off -DPYARROW_BUILD_GANDIVA=off -DPYARROW_BUILD_DATASET=off -DPYARROW_BUILD_ORC=off -DPYARROW_BUILD_PARQUET=off -DPYARROW_BUILD_PLASMA=off -DPYARROW_BUILD_S3=off -DPYARROW_BUILD_HDFS=off -DPYARROW_USE_TENSORFLOW=off -DPYARROW_BUNDLE_ARROW_CPP=off -DPYARROW_BUNDLE_BOOST=off -DPYARROW_GENERATE_COVERAGE=off -DPYARROW_BOOST_USE_SHARED=on -DPYARROW_PARQUET_USE_SHARED=on -DCMAKE_BUILD_TYPE=release /tmp/user/1000/pip-install-9n7xw0m8/pyarrow_002a74e354d44a00bb1f1b4e4620d460 -- The C compiler identification is GNU 10.2.1 -- The CXX compiler identification is GNU 10.2.1 -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /usr/bin/cc - skipped -- Detecting C compile features -- Detecting C compile features - done -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /usr/bin/c++ - skipped -- Detecting CXX compile features -- Detecting CXX compile features - done -- System processor: ppc64le -- Performing Test CXX_SUPPORTS_ALTIVEC -- Performing Test CXX_SUPPORTS_ALTIVEC - Success -- Arrow build warning level: PRODUCTION Using ld linker Configured for RELEASE build (set with cmake -DCMAKE_BUILD_TYPE={release,debug,...}) -- Build Type: RELEASE -- Generator: Unix Makefiles -- Build output directory: /tmp/user/1000/pip-install-9n7xw0m8/pyarrow_002a74e354d44a00bb1f1b4e4620d460/build/temp.linux-ppc64le-3.9/release -- Found Python3: /path/abc/venv/bin/python3 (found version "3.9.2") found components: Interpreter Development.Module NumPy -- Found Python3Alt: /path/abc/venv/bin/python3 CMake Warning (dev) at /usr/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:273 (message): The package name passed to
find_package_handle_standard_args(PkgConfig) does not match the name of the calling package (Arrow). This can lead to problems in calling code that expectsfind_packageresult variables (e.g.,_FOUND) to follow a certain pattern. Call Stack (most recent call first): /usr/share/cmake-3.18/Modules/FindPkgConfig.cmake:59 (find_package_handle_standard_args) cmake_modules/FindArrow.cmake:39 (include) cmake_modules/FindArrowPython.cmake:46 (find_package) CMakeLists.txt:218 (find_package) This warning is for project developers. Use -Wno-dev to suppress it.note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for pyarrow Building wheel for simplejson (setup.py) ... done Created wheel for simplejson: filename=simplejson-3.17.6-cp39-cp39-linux_ppc64le.whl size=129588 sha256=64045ed77ffbcf6c34c333cd0a68b885b13a13150ab09ad247917cab89a0e8e6 Stored in directory: /path/abc/.cache/pip/wheels/0e/d0/0d/478f289794fbd5b0f6ea528d427941e1d8e65cb2358f7031a4 Building wheel for sqlalchemy (setup.py) ... done Created wheel for sqlalchemy: filename=SQLAlchemy-1.3.24-cp39-cp39-linux_ppc64le.whl size=1256422 sha256=98bc3e56c2d1fe7ed52b09b28cf370b0baaab4ed6479359bd7fcdf5a02543e3e Stored in directory: /path/abc/.cache/pip/wheels/17/80/a4/49869e85becd4c05a166bd07dbfc983ed5d51b36dedf07d783 Building wheel for cron-descriptor (setup.py) ... done Created wheel for cron-descriptor: filename=cron_descriptor-1.2.24-py3-none-any.whl size=37774 sha256=a7cbe203be63ed63cb8feda98d04f888bf5e4ef41139379341d8e5a7812e95cb Stored in directory: /path/abc/.cache/pip/wheels/0d/d1/e7/4442702da1320037576d20456a6adb7abb2acf2eeb7f9f075d Building wheel for pgsanity (setup.py) ... done Created wheel for pgsanity: filename=pgsanity-0.2.9-py3-none-any.whl size=5626 sha256=6f3df9be5a9f4491bcc7667ac0d11e7122e3acaa265864d630617ab3b4a753e9 Stored in directory: /path/abc/.cache/pip/wheels/09/54/81/e4e07e89838fbe148c0759fc62aca697d89d0317c3cb7a4462 Building wheel for python-geohash (setup.py) ... done Created wheel for python-geohash: filename=python_geohash-0.8.5-cp39-cp39-linux_ppc64le.whl size=46464 sha256=2e5f427c73f299d5849ed812223db8776d93765f5e674404c88c2a0b60bf6603 Stored in directory: /path/abc/.cache/pip/wheels/71/30/cd/0b5a80443cd2621f619cd5725e758eeeb0160c6210f2a74527 Building wheel for wtforms-json (setup.py) ... done Created wheel for wtforms-json: filename=WTForms_JSON-0.3.3-py3-none-any.whl size=4731 sha256=5b0f18be5b5c328cf2654b4ed2b1780561ef1f8d2e1c6f72d3ea1a300410f9cb Stored in directory: /path/abc/.cache/pip/wheels/e9/9c/d6/e38a31b1920c9160ac721b206f6941702b865f4193d7991aaa Building wheel for Flask-JWT-Extended (setup.py) ... done Created wheel for Flask-JWT-Extended: filename=Flask_JWT_Extended-3.25.1-py2.py3-none-any.whl size=21599 sha256=c40d8d5331f97c02e0ad8a01d98027ae324cea34068a26da8c4d754773eba117 Stored in directory: /path/abc/.cache/pip/wheels/89/29/80/cacbcaec7c90fb2c53b5b385a3bbef89de3df159f097b26012 Building wheel for Flask-Login (setup.py) ... done Created wheel for Flask-Login: filename=Flask_Login-0.4.1-py2.py3-none-any.whl size=15936 sha256=7e077d74701028d478260674c522aa18e1ef1975ceec0c85fc851a0de4ce31e7 Stored in directory: /path/abc/.cache/pip/wheels/0a/95/f9/1b9375cf1e05631591d41a65a730b7ec1f8e05af6db29bb271 Building wheel for brotli (setup.py) ... done Created wheel for brotli: filename=Brotli-1.0.9-cp39-cp39-linux_ppc64le.whl size=2623796 sha256=e37745446784f76c4932bb30754457242dc12ba9790eea5a83b3cad692eb8042 Stored in directory: /path/abc/.cache/pip/wheels/fc/64/ad/723809ab7a5b321a3e5997a75e00f388547f49f73b3192a32a Building wheel for MarkupSafe (setup.py) ... done Created wheel for MarkupSafe: filename=MarkupSafe-2.0.1-cp39-cp39-linux_ppc64le.whl size=27825 sha256=7c60a39323da51878a75e355fafd881b8787baeb44fa67f0ac3ed9adafbabdff Stored in directory: /path/abc/.cache/pip/wheels/9f/6d/c8/1f59b07cf85ae842908006ec28f4477f7e4578df72c3eb0e46 Building wheel for pymeeus (setup.py) ... done Created wheel for pymeeus: filename=PyMeeus-0.5.11-py3-none-any.whl size=730974 sha256=038a58c0b5e2e140f47dfcd61af75935ee8f07b13f1cc5d9f82dd58190fc5ea2 Stored in directory: /path/abc/.cache/pip/wheels/33/3d/82/4579e9cca41ff991140b2e050bc6df3a38292f26e4fa06b15d Building wheel for wrapt (setup.py) ... done Created wheel for wrapt: filename=wrapt-1.13.3-cp39-cp39-linux_ppc64le.whl size=77457 sha256=06bb06fb37cb7ad221f09f0b8a98efcc497f63e92a4c518e44dd692af139d176 Stored in directory: /path/abc/.cache/pip/wheels/f9/6e/ed/b9a64c8281ff2ee42402497ff3c67f4abd39f552efecc309a9 Successfully built apache-superset holidays msgpack simplejson sqlalchemy cron-descriptor pgsanity python-geohash wtforms-json Flask-JWT-Extended Flask-Login brotli MarkupSafe pymeeus wrapt Failed to build pyarrow ERROR: Could not build wheels for pyarrow, which is required to install pyproject.toml-based projects