conda-forge / arrow-cpp-feedstock

A conda-smithy repository for arrow-cpp.
BSD 3-Clause "New" or "Revised" License
10 stars 62 forks source link

Error on systems with a pagesize > 16KB #1115

Closed benfred closed 1 year ago

benfred commented 1 year ago

Solution to issue cannot be found in the documentation.

Issue

Importing pyarrow on systems with a pagesize bigger than 16K causes an issue on importing pyarrow:

In [2]: import pyarrow
<jemalloc>: Unsupported system page size

This is on a system with a pagesize of 64K.

# getconf -a |  grep PAGESIZE
PAGESIZE                           65536

The jemalloc in arrow is compiled with --with-lg-page=14 in this feedstock, which corresponds to a maximum pagesize of 16K.

The 16K pagesize was added for support to M1 Macs by @xhochy, as detailed in this post: https://uwekorn.com/2021/01/11/apache-arrow-on-the-apple-m1.html , and corresponding PR https://github.com/conda-forge/arrow-cpp-feedstock/pull/253

Changing to --with-lg-page=16 here would allow systems with a 64K pagesize to use the arrow from this conda feedstock without error, and will still work correctly for systems with a smaller pagesize.

### Installed packages ```shell # packages in environment at /opt/conda/envs/rapids: # # Name Version Build Channel _openmp_mutex 4.5 2_gnu conda-forge _sysroot_linux-aarch64_curr_repodata_hack 4 h57d6b7b_13 conda-forge aiobotocore 2.5.0 pyhd8ed1ab_0 conda-forge aiohttp 3.8.4 py310hb299538_1 conda-forge aioitertools 0.11.0 pyhd8ed1ab_0 conda-forge aiosignal 1.3.1 pyhd8ed1ab_0 conda-forge anyio 3.7.0 pyhd8ed1ab_1 conda-forge aom 3.5.0 headf329_0 conda-forge appdirs 1.4.4 pyh9f0ad1d_0 conda-forge argon2-cffi 21.3.0 pyhd8ed1ab_0 conda-forge argon2-cffi-bindings 21.2.0 py310h761cc84_3 conda-forge asvdb 0.4.2 g90e8f2c_40 rapidsai async-timeout 4.0.2 pyhd8ed1ab_0 conda-forge atk-1.0 2.38.0 hf4e84e4_1 conda-forge attrs 23.1.0 pyh71513ae_1 conda-forge autoconf 2.71 pl5321h2148fe1_1 conda-forge automake 1.16.5 pl5321h8af1aa0_0 conda-forge aws-c-auth 0.6.28 hc766df3_5 conda-forge aws-c-cal 0.5.27 h5058e3b_0 conda-forge aws-c-common 0.8.20 h31becfc_0 conda-forge aws-c-compression 0.2.17 hd0ac993_0 conda-forge aws-c-event-stream 0.3.0 h8f1563f_6 conda-forge aws-c-http 0.7.8 hb3fd0bf_4 conda-forge aws-c-io 0.13.26 h8e8bc99_0 conda-forge aws-c-mqtt 0.8.13 hdd0228f_2 conda-forge aws-c-s3 0.3.4 hb607707_5 conda-forge aws-c-sdkutils 0.1.10 hd0ac993_0 conda-forge aws-checksums 0.1.16 hd0ac993_0 conda-forge aws-crt-cpp 0.20.2 h6606d28_9 conda-forge aws-sam-translator 1.55.0 pyhd8ed1ab_0 conda-forge aws-sdk-cpp 1.10.57 h4eeedb6_14 conda-forge aws-xray-sdk 2.12.0 pyhd8ed1ab_0 conda-forge babel 2.12.1 pyhd8ed1ab_1 conda-forge backcall 0.2.0 pyh9f0ad1d_0 conda-forge backports 1.0 pyhd8ed1ab_3 conda-forge backports.functools_lru_cache 1.6.5 pyhd8ed1ab_0 conda-forge backports.zoneinfo 0.2.1 py310h4c7bcd0_7 conda-forge bcrypt 3.2.2 py310h761cc84_1 conda-forge beautifulsoup4 4.12.2 pyha770c72_0 conda-forge benchmark 1.5.1 he1b5a44_2 conda-forge binutils 2.40 h64c2a2e_0 conda-forge binutils_impl_linux-aarch64 2.40 h870a726_0 conda-forge binutils_linux-aarch64 2.40 h94bbfa1_0 conda-forge black 22.3.0 pyhd8ed1ab_0 conda-forge blas 1.1 openblas conda-forge bleach 6.0.0 pyhd8ed1ab_0 conda-forge blinker 1.6.2 pyhd8ed1ab_0 conda-forge blosc 1.21.4 h2f3a684_0 conda-forge bokeh 2.4.3 pyhd8ed1ab_3 conda-forge boost 1.74.0 py310h5bdf259_5 conda-forge boost-cpp 1.74.0 ha1c1135_8 conda-forge boto3 1.26.76 pyhd8ed1ab_0 conda-forge botocore 1.29.76 pyhd8ed1ab_0 conda-forge branca 0.6.0 pyhd8ed1ab_0 conda-forge brotli 1.0.9 h4e544f5_9 conda-forge brotli-bin 1.0.9 h4e544f5_9 conda-forge brotlipy 0.7.0 py310h761cc84_1005 conda-forge brunsli 0.1 h01db608_0 conda-forge bzip2 1.0.8 hf897c2e_4 conda-forge c-ares 1.19.1 h31becfc_0 conda-forge c-blosc2 2.9.3 h1a8d543_0 conda-forge c-compiler 1.5.2 hb4cce97_0 conda-forge ca-certificates 2023.5.7 hcefe29a_0 conda-forge cached-property 1.5.2 hd8ed1ab_1 conda-forge cached_property 1.5.2 pyha770c72_1 conda-forge cachetools 5.3.0 pyhd8ed1ab_0 conda-forge cairo 1.16.0 hd19fb6e_1014 conda-forge certifi 2023.5.7 pyhd8ed1ab_0 conda-forge cffi 1.15.1 py310hf0c4615_3 conda-forge cfgv 3.3.1 pyhd8ed1ab_0 conda-forge cfitsio 4.1.0 h8b262d6_0 conda-forge cfn-lint 0.75.1 pyhd8ed1ab_0 conda-forge chardet 5.1.0 py310hbbe02a8_0 conda-forge charls 2.3.4 h01db608_0 conda-forge charset-normalizer 3.1.0 pyhd8ed1ab_0 conda-forge click 8.1.3 unix_pyhd8ed1ab_2 conda-forge click-plugins 1.1.1 py_0 conda-forge cligj 0.7.2 pyhd8ed1ab_1 conda-forge cloudpickle 2.2.1 pyhd8ed1ab_0 conda-forge cmake 3.26.4 hef020d8_0 conda-forge cmake_setuptools 0.1.3 py_0 rapidsai cmakelang 0.6.13 pyhd8ed1ab_0 conda-forge cmarkgfm 0.8.0 py310h761cc84_2 conda-forge colorama 0.4.6 pyhd8ed1ab_0 conda-forge colorcet 3.0.1 pyhd8ed1ab_0 conda-forge comm 0.1.3 pyhd8ed1ab_0 conda-forge conda 4.12.0 py310h4c7bcd0_0 conda-forge conda-build 3.22.0 py310h4c7bcd0_3 conda-forge conda-package-handling 2.0.2 pyh38be061_0 conda-forge conda-package-streaming 0.8.0 pyhd8ed1ab_0 conda-forge conda-verify 3.1.1 py310hbbe02a8_1006 conda-forge contourpy 1.1.0 py310h586407a_0 conda-forge coverage 7.2.7 py310h7c1f4a2_0 conda-forge cryptography 41.0.1 py310h34e2850_0 conda-forge cubinlinker 0.3.0 py310h4873805_0 rapidsai cuda-profiler-api 11.8.86 0 nvidia cuda-python 11.8.2 py310he18ae9e_0 conda-forge cuda-version 11.8 h70ddcb2_2 conda-forge cudatoolkit 11.8.0 h46baab3_11 conda-forge cudf 23.8.0 pypi_0 pypi cudf-kafka 23.8.0 pypi_0 pypi cugraph 23.8.0 pypi_0 pypi cugraph-dgl 23.8.0 pypi_0 pypi cugraph-pyg 23.8.0 pypi_0 pypi cugraph-service-client 23.8.0 pypi_0 pypi cugraph-service-server 23.8.0 pypi_0 pypi cuml 23.8.0 pypi_0 pypi cupy 12.1.0 py310h0280e8f_0 conda-forge curl 8.1.2 hc34909b_0 conda-forge cusignal 23.8.0a0+ge3a960c pypi_0 pypi cuspatial 23.8.0 pypi_0 pypi cuxfilter 23.8.0a0+g924d855 pypi_0 pypi cxx-compiler 1.5.2 h4c384f3_0 conda-forge cycler 0.11.0 pyhd8ed1ab_0 conda-forge cyrus-sasl 2.1.27 h16127bb_6 conda-forge cython 0.29.35 py310hbb3657e_0 conda-forge cytoolz 0.12.0 py310hdc54845_1 conda-forge dask 2023.7.0 pypi_0 pypi dask-core 2023.3.2 pyhd8ed1ab_0 conda-forge dask-cudf 23.8.0 pypi_0 pypi dask-glm 0.2.0 py_1 conda-forge dask-labextension 6.1.0 pyhd8ed1ab_0 conda-forge dask-ml 2023.3.24 pyhd8ed1ab_1 conda-forge dataclasses 0.8 pyhc8e2a94_3 conda-forge datashader 0.15.0 pyhd8ed1ab_0 conda-forge datashape 0.5.4 py_1 conda-forge dav1d 1.2.1 h31becfc_0 conda-forge dbus 1.13.6 h12b9eeb_3 conda-forge debugpy 1.6.7 py310hbc44c02_0 conda-forge decopatch 1.4.10 pyhd8ed1ab_0 conda-forge decorator 5.1.1 pyhd8ed1ab_0 conda-forge defusedxml 0.7.1 pyhd8ed1ab_0 conda-forge distlib 0.3.6 pyhd8ed1ab_0 conda-forge distributed 2023.7.0 pypi_0 pypi distro 1.8.0 pyhd8ed1ab_0 conda-forge dlpack 0.5 h01db608_0 conda-forge docker-py 6.1.0 pyhd8ed1ab_0 conda-forge docutils 0.20.1 py310hbbe02a8_0 conda-forge double-conversion 3.1.5 h01db608_2 conda-forge ecdsa 0.18.0 pyhd8ed1ab_1 conda-forge entrypoints 0.4 pyhd8ed1ab_0 conda-forge exceptiongroup 1.1.1 pyhd8ed1ab_0 conda-forge execnet 1.9.0 pyhd8ed1ab_0 conda-forge expat 2.5.0 hd600fc2_1 conda-forge faiss-proc 1.0.0 cuda rapidsai fastavro 1.7.4 py310h7c1f4a2_0 conda-forge fastrlock 0.8 py310h16c9dca_3 conda-forge feather-format 0.4.1 pyh9f0ad1d_0 conda-forge filelock 3.12.2 pyhd8ed1ab_0 conda-forge filterpy 1.4.5 py_1 conda-forge fiona 1.8.22 py310hdf00071_0 conda-forge flake8 3.8.4 py_0 conda-forge flask 2.1.3 pyhd8ed1ab_0 conda-forge flask_cors 3.0.10 pyhd3deb0d_0 conda-forge flit-core 3.9.0 pyhd8ed1ab_0 conda-forge fmt 9.1.0 hdd96247_0 conda-forge folium 0.14.0 pyhd8ed1ab_0 conda-forge font-ttf-dejavu-sans-mono 2.37 hab24e00_0 conda-forge font-ttf-inconsolata 3.000 h77eed37_0 conda-forge font-ttf-source-code-pro 2.038 h77eed37_0 conda-forge font-ttf-ubuntu 0.83 hab24e00_0 conda-forge fontconfig 2.14.2 ha9a116f_0 conda-forge fonts-conda-ecosystem 1 0 conda-forge fonts-conda-forge 1 0 conda-forge fonttools 4.40.0 py310hb299538_0 conda-forge freetype 2.12.1 hbbbf32d_1 conda-forge freexl 1.0.6 h4e544f5_1 conda-forge fribidi 1.0.10 hb9de7d4_0 conda-forge frozenlist 1.3.3 py310h761cc84_0 conda-forge fsspec 2023.6.0 pyh1a96a4e_0 conda-forge future 0.18.3 pyhd8ed1ab_0 conda-forge gcc 11.4.0 h13ac8a1_0 conda-forge gcc_impl_linux-aarch64 11.4.0 h0207d0b_0 conda-forge gcc_linux-aarch64 11.4.0 h2fab22c_0 conda-forge gcsfs 2023.6.0 pyhd8ed1ab_0 conda-forge gdal 3.5.2 py310h0b22832_3 conda-forge gdk-pixbuf 2.42.8 hb98dc3c_0 conda-forge geopandas 0.13.2 pyhd8ed1ab_1 conda-forge geopandas-base 0.13.2 pyha770c72_1 conda-forge geos 3.11.0 h4de3ea5_0 conda-forge geotiff 1.7.1 h17a4d75_3 conda-forge gettext 0.21.1 ha18d298_0 conda-forge gflags 2.2.2 h54f1f3f_1004 conda-forge giflib 5.2.1 hb4cce97_3 conda-forge git 2.41.0 pl5321h0d979e1_0 conda-forge git-lfs 3.3.0 h8af1aa0_0 conda-forge glib 2.76.3 hd84c7bf_0 conda-forge glib-tools 2.76.3 hd84c7bf_0 conda-forge glob2 0.7 py_0 conda-forge glog 0.6.0 h8ab10f1_0 conda-forge gmock 1.13.0 h8af1aa0_1 conda-forge gmp 6.2.1 h7fd3ca4_0 conda-forge gmpy2 2.1.2 py310h9f74ea4_1 conda-forge google-api-core 2.11.1 pyhd8ed1ab_0 conda-forge google-auth 2.21.0 pyh1a96a4e_0 conda-forge google-auth-oauthlib 1.0.0 pyhd8ed1ab_0 conda-forge google-cloud-core 2.3.2 pyhd8ed1ab_0 conda-forge google-cloud-storage 2.10.0 pyh1a96a4e_0 conda-forge google-crc32c 1.1.2 py310h3051e68_4 conda-forge google-resumable-media 2.5.0 pyhd8ed1ab_0 conda-forge googleapis-common-protos 1.59.1 pyhd8ed1ab_0 conda-forge graphite2 1.3.13 h7fd3ca4_1001 conda-forge graphql-core 3.2.3 pyhd8ed1ab_0 conda-forge graphviz 7.0.5 h4b7b8df_0 conda-forge grpcio 1.54.2 py310hbc44c02_2 conda-forge gtest 1.13.0 h2a328a1_1 conda-forge gtk2 2.24.33 h49e3f37_2 conda-forge gts 0.7.6 he293c15_4 conda-forge gxx 11.4.0 h13ac8a1_0 conda-forge gxx_impl_linux-aarch64 11.4.0 h0207d0b_0 conda-forge gxx_linux-aarch64 11.4.0 hd6b6b29_0 conda-forge h5py 3.8.0 nompi_py310hff48a5f_100 conda-forge harfbuzz 6.0.0 hbcb8a4f_0 conda-forge hdbscan 0.8.29 py310h0654a89_2 conda-forge hdf4 4.2.15 hb6731fe_5 conda-forge hdf5 1.12.2 nompi_h3900512_101 conda-forge holoviews 1.15.3 pyhd8ed1ab_0 conda-forge httpretty 1.1.4 pyhd8ed1ab_0 conda-forge hypothesis 6.80.0 pyha770c72_0 conda-forge icu 70.1 ha18d298_0 conda-forge identify 2.5.24 pyhd8ed1ab_0 conda-forge idna 3.4 pyhd8ed1ab_0 conda-forge imagecodecs 2022.9.26 py310hd246ef8_3 conda-forge imageio 2.31.1 pyh24c5eb1_0 conda-forge importlib-metadata 6.7.0 pyha770c72_0 conda-forge importlib_metadata 6.7.0 hd8ed1ab_0 conda-forge iniconfig 2.0.0 pyhd8ed1ab_0 conda-forge ipykernel 6.23.3 pyh71e2992_0 conda-forge ipython 7.31.1 py310hbbe02a8_0 conda-forge ipython_genutils 0.2.0 py_1 conda-forge ipywidgets 8.0.6 pyhd8ed1ab_0 conda-forge isort 5.12.0 pyhd8ed1ab_1 conda-forge itsdangerous 2.1.2 pyhd8ed1ab_0 conda-forge jaraco.classes 3.2.3 pyhd8ed1ab_0 conda-forge jedi 0.18.2 pyhd8ed1ab_0 conda-forge jeepney 0.8.0 pyhd8ed1ab_0 conda-forge jinja2 3.1.2 pyhd8ed1ab_1 conda-forge jmespath 1.0.1 pyhd8ed1ab_0 conda-forge joblib 1.3.0 pyhd8ed1ab_0 conda-forge jpeg 9e h2a766a3_3 conda-forge jschema-to-python 1.2.3 pyhd8ed1ab_0 conda-forge json-c 0.16 hcc5b78b_0 conda-forge json5 0.9.5 pyh9f0ad1d_0 conda-forge jsondiff 2.0.0 pyhd8ed1ab_0 conda-forge jsonpatch 1.32 pyhd8ed1ab_0 conda-forge jsonpickle 2.2.0 pyhd8ed1ab_0 conda-forge jsonpointer 2.0 py_0 conda-forge jsonschema 3.2.0 pyhd8ed1ab_3 conda-forge junit-xml 1.9 pyh9f0ad1d_0 conda-forge jupyter-packaging 0.7.12 pyhd8ed1ab_0 conda-forge jupyter-server-proxy 4.0.0 pyhd8ed1ab_0 conda-forge jupyter_client 8.3.0 pyhd8ed1ab_0 conda-forge jupyter_core 5.3.1 py310h4c7bcd0_0 conda-forge jupyter_events 0.6.3 pyhd8ed1ab_0 conda-forge jupyter_server 2.7.0 pyhd8ed1ab_0 conda-forge jupyter_server_terminals 0.4.4 pyhd8ed1ab_1 conda-forge jupyterlab 3.5.3 pyhd8ed1ab_0 conda-forge jupyterlab-favorites 3.1.1 pyhd8ed1ab_0 conda-forge jupyterlab-nvdashboard 0.8.0 py_230412_g8ed1064_0 rapidsai jupyterlab_pygments 0.2.2 pyhd8ed1ab_0 conda-forge jupyterlab_server 2.16.6 pyhd8ed1ab_0 conda-forge jupyterlab_widgets 3.0.7 pyhd8ed1ab_1 conda-forge jxrlib 1.1 hf897c2e_2 conda-forge kealib 1.4.15 hf95f5c2_1 conda-forge kernel-headers_linux-aarch64 4.18.0 h5b4a56d_13 conda-forge keyring 24.2.0 py310h4c7bcd0_0 conda-forge keyutils 1.6.1 h4e544f5_0 conda-forge kiwisolver 1.4.4 py310h9ceb0a0_1 conda-forge krb5 1.20.1 h113d92e_0 conda-forge lapack 3.9.0 netlib conda-forge lazy_loader 0.2 pyhd8ed1ab_0 conda-forge lcms2 2.14 h5246980_0 conda-forge ld_impl_linux-aarch64 2.40 h2d8c526_0 conda-forge lerc 4.0.0 h4de3ea5_0 conda-forge libabseil 20230125.3 cxx17_h2f0025b_0 conda-forge libaec 1.0.6 hd600fc2_1 conda-forge libarchive 3.6.2 hc81d4a0_0 conda-forge libarrow 11.0.0 hefbe673_26_cpu conda-forge libavif 0.11.1 hb8409af_2 conda-forge libblas 3.9.0 17_linuxaarch64_openblas conda-forge libbrotlicommon 1.0.9 h4e544f5_9 conda-forge libbrotlidec 1.0.9 h4e544f5_9 conda-forge libbrotlienc 1.0.9 h4e544f5_9 conda-forge libcblas 3.9.0 17_linuxaarch64_openblas conda-forge libcrc32c 1.1.2 h01db608_0 conda-forge libcublas 11.11.3.6 0 nvidia libcublas-dev 11.11.3.6 0 nvidia libcugraphops 23.08.00a cuda11_230710_gf44ac7d1_13 rapidsai-nightly libcumlprims 23.08.00a cuda11_230519_g1751dc9_0 rapidsai-nightly libcurand 10.3.0.86 0 nvidia libcurand-dev 10.3.0.86 0 nvidia libcurl 8.1.2 hc34909b_0 conda-forge libcusolver 11.4.1.48 0 nvidia libcusolver-dev 11.4.1.48 0 nvidia libcusparse 11.7.5.86 0 nvidia libcusparse-dev 11.7.5.86 0 nvidia libcypher-parser 0.6.2 h920789f_1 rapidsai libdap4 3.20.6 hf7f982d_2 conda-forge libdeflate 1.14 h4e544f5_0 conda-forge libedit 3.1.20191231 he28a2e2_2 conda-forge libev 4.33 h516909a_1 conda-forge libevent 2.1.12 h4ba1bb4_1 conda-forge libexpat 2.5.0 hd600fc2_1 conda-forge libfaiss 1.7.2 cuda118h1234567_4_cuda rapidsai libffi 3.4.2 h3557bc0_5 conda-forge libgcc-devel_linux-aarch64 11.4.0 h7ce4923_0 conda-forge libgcc-ng 13.1.0 h2b4548d_0 conda-forge libgd 2.3.3 h1aa4b80_3 conda-forge libgdal 3.5.2 h8bc38f5_3 conda-forge libgfortran-ng 13.1.0 he9431aa_0 conda-forge libgfortran5 13.1.0 h24e4805_0 conda-forge libglib 2.76.3 h0464669_0 conda-forge libgomp 13.1.0 h2b4548d_0 conda-forge libgoogle-cloud 2.12.0 h48e691c_0 conda-forge libgrpc 1.54.2 h53d6f9f_2 conda-forge libhwloc 2.9.1 h21e8147_0 conda-forge libiconv 1.17 h9cdd2b7_0 conda-forge libkml 1.3.0 h019b1a7_1014 conda-forge liblapack 3.9.0 17_linuxaarch64_openblas conda-forge liblief 0.12.3 h4de3ea5_0 conda-forge libllvm14 14.0.6 h966f666_3 conda-forge libnetcdf 4.8.1 nompi_h88e613c_106 conda-forge libnghttp2 1.52.0 h250e5c5_0 conda-forge libnsl 2.0.0 hf897c2e_0 conda-forge libntlm 1.4 hf897c2e_1002 conda-forge libnuma 2.0.16 hb4cce97_1 conda-forge libopenblas 0.3.23 pthreads_hd703e6f_0 conda-forge libpng 1.6.39 hf9034f9_0 conda-forge libpq 14.5 hd21d9e6_5 conda-forge libprotobuf 3.21.12 h7fe2111_0 conda-forge libraft-headers 23.08.00a cuda11_230710_gf34cdbd7_55 rapidsai-nightly libraft-headers-only 23.08.00a cuda11_230710_gf34cdbd7_55 rapidsai-nightly librdkafka 1.9.2 h70cd987_2 conda-forge librmm 23.08.00a cuda11_230710_g00599267_20 rapidsai-nightly librsvg 2.54.4 h3ad45c2_0 conda-forge librttopo 1.1.0 h31eec0c_11 conda-forge libsanitizer 11.4.0 h6bfd624_0 conda-forge libsodium 1.0.18 hb9de7d4_1 conda-forge libspatialindex 1.9.3 h01db608_4 conda-forge libspatialite 5.0.1 h44d26a7_19 conda-forge libsqlite 3.42.0 h194ca79_0 conda-forge libssh2 1.11.0 h492db2e_0 conda-forge libstdcxx-devel_linux-aarch64 11.4.0 h7ce4923_0 conda-forge libstdcxx-ng 13.1.0 h452befe_0 conda-forge libthrift 0.18.1 h0035360_2 conda-forge libtiff 4.4.0 hfcd36d1_5 conda-forge libtool 2.4.7 h4de3ea5_0 conda-forge libutf8proc 2.8.0 h4e544f5_0 conda-forge libuuid 2.38.1 hb4cce97_0 conda-forge libuv 1.44.2 h4e544f5_0 conda-forge libwebp 1.2.4 hef792ef_0 conda-forge libwebp-base 1.2.4 h4e544f5_0 conda-forge libxcb 1.13 h3557bc0_1004 conda-forge libxml2 2.10.3 habe54e3_4 conda-forge libzip 1.9.2 heb2ba21_1 conda-forge libzlib 1.2.13 h31becfc_5 conda-forge libzopfli 1.0.3 h01db608_0 conda-forge lightgbm 3.3.5 py310hbc44c02_0 conda-forge llvmlite 0.40.1 py310h20b6881_0 conda-forge locket 1.0.0 pyhd8ed1ab_0 conda-forge lz4 4.3.2 py310hd9cca14_0 conda-forge lz4-c 1.9.4 hd600fc2_0 conda-forge lzo 2.10 h516909a_1000 conda-forge m4 1.4.18 h516909a_1001 conda-forge make 4.3 h309ac5b_1 conda-forge makefun 1.15.1 pyhd8ed1ab_0 conda-forge mapclassify 2.5.0 pyhd8ed1ab_1 conda-forge markdown 3.4.3 pyhd8ed1ab_0 conda-forge markdown-it-py 3.0.0 pyhd8ed1ab_0 conda-forge markupsafe 2.1.3 py310h7c1f4a2_0 conda-forge matplotlib-base 3.7.1 py310hc90fa2b_0 conda-forge matplotlib-inline 0.1.6 pyhd8ed1ab_0 conda-forge mccabe 0.6.1 py_1 conda-forge mdurl 0.1.0 pyhd8ed1ab_0 conda-forge mimesis 10.1.0 pyhd8ed1ab_0 conda-forge mistune 3.0.0 pyhd8ed1ab_0 conda-forge mock 5.0.2 pyhd8ed1ab_0 conda-forge more-itertools 9.1.0 pyhd8ed1ab_0 conda-forge moto 4.1.12 pyhd8ed1ab_0 conda-forge mpc 1.3.1 hf4c8f4c_0 conda-forge mpfr 4.2.0 h96f194b_0 conda-forge msgpack-python 1.0.5 py310hb43b7d6_0 conda-forge multidict 6.0.4 py310hb89b984_0 conda-forge multipledispatch 0.6.0 py_0 conda-forge munch 3.0.0 pyhd8ed1ab_0 conda-forge munkres 1.1.4 pyh9f0ad1d_0 conda-forge mypy 0.971 py310h761cc84_0 conda-forge mypy_extensions 1.0.0 pyha770c72_0 conda-forge nbclassic 1.0.0 pyhb4ecaf3_1 conda-forge nbclient 0.8.0 pyhd8ed1ab_0 conda-forge nbconvert 7.6.0 pyhd8ed1ab_0 conda-forge nbconvert-core 7.6.0 pyhd8ed1ab_0 conda-forge nbconvert-pandoc 7.6.0 pyhd8ed1ab_0 conda-forge nbformat 5.9.0 pyhd8ed1ab_0 conda-forge nccl 2.18.3.1 h1212f3d_0 conda-forge ncurses 6.4 h2e1726e_0 conda-forge nest-asyncio 1.5.6 pyhd8ed1ab_0 conda-forge networkx 2.8.8 pyhd8ed1ab_0 conda-forge ninja 1.11.1 hdd96247_0 conda-forge nltk 3.8.1 pyhd8ed1ab_0 conda-forge nodeenv 1.8.0 pyhd8ed1ab_0 conda-forge nodejs 18.15.0 h1eaeb9c_0 conda-forge notebook 6.5.4 pyha770c72_0 conda-forge notebook-shim 0.2.3 pyhd8ed1ab_0 conda-forge nspr 4.35 h4de3ea5_0 conda-forge nss 3.89 hf608148_0 conda-forge numba 0.57.1 py310h16a1930_0 conda-forge numpy 1.24.4 py310h7f380f4_0 conda-forge nvtx 0.2.5 py310h734f5e8_0 conda-forge oauthlib 3.2.2 pyhd8ed1ab_0 conda-forge openapi-schema-validator 0.2.3 pyhd8ed1ab_0 conda-forge openapi-spec-validator 0.4.0 pyhd8ed1ab_1 conda-forge openblas 0.3.23 pthreads_hef96516_0 conda-forge openjpeg 2.5.0 h9b6de37_1 conda-forge openslide 3.4.1 h4d8a784_5 conda-forge openssl 3.1.1 h31becfc_1 conda-forge orc 1.8.4 h4e271f3_0 conda-forge overrides 7.3.1 pyhd8ed1ab_0 conda-forge packaging 23.1 pyhd8ed1ab_0 conda-forge pandas 1.5.3 py310hc3d6b01_1 conda-forge pandoc 3.1.3 h8af1aa0_0 conda-forge pandocfilters 1.5.0 pyhd8ed1ab_0 conda-forge panel 0.14.1 pyhd8ed1ab_0 conda-forge pango 1.50.14 h1f1e9b3_0 conda-forge param 1.13.0 pyh1a96a4e_0 conda-forge paramiko 3.2.0 pyhd8ed1ab_0 conda-forge parso 0.8.3 pyhd8ed1ab_0 conda-forge partd 1.4.0 pyhd8ed1ab_0 conda-forge patch 2.7.6 hf897c2e_1002 conda-forge patchelf 0.17.2 h884eca8_0 conda-forge pathspec 0.11.1 pyhd8ed1ab_0 conda-forge patsy 0.5.3 pyhd8ed1ab_0 conda-forge pbr 5.11.1 pyhd8ed1ab_0 conda-forge pcre 8.45 h01db608_0 conda-forge pcre2 10.40 he7b27c6_0 conda-forge perl 5.32.1 2_hf897c2e_perl5 conda-forge pexpect 4.8.0 pyh1a96a4e_2 conda-forge pickleshare 0.7.5 py_1003 conda-forge pillow 9.2.0 py310hd6d4ca1_3 conda-forge pip 23.1.2 pyhd8ed1ab_0 conda-forge pixman 0.40.0 hb9de7d4_0 conda-forge pkg-config 0.29.2 hb9de7d4_1008 conda-forge pkginfo 1.9.6 pyhd8ed1ab_0 conda-forge platformdirs 3.8.0 pyhd8ed1ab_0 conda-forge pluggy 1.2.0 pyhd8ed1ab_0 conda-forge ply 3.11 py_1 conda-forge pooch 1.7.0 pyha770c72_3 conda-forge poppler 22.04.0 h420a178_2 conda-forge poppler-data 0.4.12 hd8ed1ab_0 conda-forge postgresql 14.5 hd1047a9_5 conda-forge pre-commit 3.3.3 pyha770c72_0 conda-forge proj 9.0.1 h92d5b9d_1 conda-forge prometheus_client 0.17.0 pyhd8ed1ab_0 conda-forge prompt-toolkit 3.0.38 pyha770c72_0 conda-forge protobuf 4.21.12 py310hbc44c02_0 conda-forge psutil 5.9.5 py310hb89b984_0 conda-forge pthread-stubs 0.4 hb9de7d4_1001 conda-forge ptxcompiler 0.8.1 py310he18ae9e_0 conda-forge ptyprocess 0.7.0 pyhd3deb0d_0 conda-forge py-cpuinfo 9.0.0 pyhd8ed1ab_0 conda-forge py-lief 0.12.3 py310h130cc07_0 conda-forge pyarrow 11.0.0 py310h8863885_26_cpu conda-forge pyasn1 0.4.8 py_0 conda-forge pyasn1-modules 0.2.7 py_0 conda-forge pycodestyle 2.6.0 pyh9f0ad1d_0 conda-forge pycosat 0.6.4 py310h761cc84_1 conda-forge pycparser 2.21 pyhd8ed1ab_0 conda-forge pyct 0.4.6 py_0 conda-forge pyct-core 0.4.6 py_0 conda-forge pydeck 0.5.0 pyh9f0ad1d_0 conda-forge pydocstyle 6.3.0 pyhd8ed1ab_0 conda-forge pyee 8.1.0 pyhd8ed1ab_0 conda-forge pyflakes 2.2.0 pyh9f0ad1d_0 conda-forge pygments 2.15.1 pyhd8ed1ab_0 conda-forge pyjwt 2.7.0 pyhd8ed1ab_0 conda-forge pylibcugraph 23.8.0 pypi_0 pypi pylibraft 23.8.0 pypi_0 pypi pynacl 1.5.0 py310h761cc84_2 conda-forge pynndescent 0.5.10 pyh1a96a4e_0 conda-forge pynvml 11.4.1 pypi_0 pypi pyopenssl 23.2.0 pyhd8ed1ab_1 conda-forge pyorc 0.8.0 py310h19eefbe_5 conda-forge pyparsing 3.1.0 pyhd8ed1ab_0 conda-forge pyppeteer 1.0.2 pyhd8ed1ab_0 conda-forge pyproj 3.4.0 py310h813ff50_0 conda-forge pyrsistent 0.19.3 py310h734f5e8_0 conda-forge pysocks 1.7.1 pyha2e5f31_6 conda-forge pytest 7.4.0 pyhd8ed1ab_0 conda-forge pytest-asyncio 0.20.3 pyhd8ed1ab_0 conda-forge pytest-benchmark 4.0.0 pyhd8ed1ab_0 conda-forge pytest-cases 3.6.14 pyhd8ed1ab_0 conda-forge pytest-cov 4.1.0 pyhd8ed1ab_0 conda-forge pytest-timeout 2.1.0 pyhd8ed1ab_0 conda-forge pytest-xdist 3.3.1 pyhd8ed1ab_0 conda-forge python 3.10.12 hbbe8eec_0_cpython conda-forge python-confluent-kafka 1.9.2 py310h761cc84_2 conda-forge python-dateutil 2.8.2 pyhd8ed1ab_0 conda-forge python-fastjsonschema 2.17.1 pyhd8ed1ab_0 conda-forge python-jose 3.3.0 pyh6c4a22f_1 conda-forge python-json-logger 2.0.7 pyhd8ed1ab_0 conda-forge python-libarchive-c 4.0 py310h4c7bcd0_2 conda-forge python-louvain 0.16 pyhd8ed1ab_0 conda-forge python-snappy 0.6.1 py310habe2118_0 conda-forge python_abi 3.10 3_cp310 conda-forge pytz 2023.3 pyhd8ed1ab_0 conda-forge pyu2f 0.1.5 pyhd8ed1ab_0 conda-forge pyviz_comms 2.3.2 pyhd8ed1ab_0 conda-forge pywavelets 1.4.1 py310h0654a89_0 conda-forge pywin32-on-windows 0.1.0 pyh1179c8e_3 conda-forge pyyaml 6.0 py310h761cc84_5 conda-forge pyzmq 25.1.0 py310hdaec954_0 conda-forge raft-dask 23.8.0 pypi_0 pypi rapidjson 1.1.0 h54f1f3f_1002 conda-forge re2 2023.03.02 hdc0ed08_0 conda-forge readline 8.2 h8fc344f_1 conda-forge readme_renderer 40.0 pyhd8ed1ab_0 conda-forge regex 2023.6.3 py310hb299538_0 conda-forge requests 2.31.0 pyhd8ed1ab_0 conda-forge requests-oauthlib 1.3.1 pyhd8ed1ab_0 conda-forge requests-toolbelt 1.0.0 pyhd8ed1ab_0 conda-forge responses 0.23.1 pyhd8ed1ab_0 conda-forge rfc3339-validator 0.1.4 pyhd8ed1ab_0 conda-forge rfc3986 2.0.0 pyhd8ed1ab_0 conda-forge rfc3986-validator 0.1.1 pyh9f0ad1d_0 conda-forge rhash 1.4.3 h4e544f5_0 conda-forge rich 13.4.2 pyhd8ed1ab_0 conda-forge ripgrep 13.0.0 hc770f70_2 conda-forge rmm 23.8.0 pypi_0 pypi rsa 4.9 pyhd8ed1ab_0 conda-forge rtree 1.0.1 py310h4cd121a_1 conda-forge ruamel_yaml 0.15.80 py310h761cc84_1008 conda-forge s2n 1.3.45 h5a25046_0 conda-forge s3fs 2023.6.0 pyhd8ed1ab_0 conda-forge s3transfer 0.6.1 pyhd8ed1ab_0 conda-forge sacremoses 0.0.53 pyhd8ed1ab_0 conda-forge sarif-om 1.0.4 pyhd8ed1ab_0 conda-forge scikit-build 0.13.1 pyhca92ed8_0 conda-forge scikit-image 0.20.0 py310hc3d6b01_1 conda-forge scikit-learn 1.2.2 py310he221099_2 conda-forge scipy 1.11.1 py310h7f380f4_0 conda-forge seaborn 0.12.2 hd8ed1ab_0 conda-forge seaborn-base 0.12.2 pyhd8ed1ab_0 conda-forge secretstorage 3.3.3 py310hbbe02a8_1 conda-forge send2trash 1.8.2 pyh41d4057_0 conda-forge setuptools 65.6.3 pyhd8ed1ab_0 conda-forge shapely 1.8.5 py310h11ae89d_1 conda-forge shellcheck 0.9.0 h8af1aa0_0 conda-forge simpervisor 1.0.0 pyhd8ed1ab_0 conda-forge six 1.16.0 pyh6c4a22f_0 conda-forge snappy 1.1.10 he8610fa_0 conda-forge sniffio 1.3.0 pyhd8ed1ab_0 conda-forge snowballstemmer 2.2.0 pyhd8ed1ab_0 conda-forge sortedcontainers 2.4.0 pyhd8ed1ab_0 conda-forge soupsieve 2.3.2.post1 pyhd8ed1ab_0 conda-forge spdlog 1.11.0 hf0e50c9_1 conda-forge sqlite 3.42.0 h3b3482f_0 conda-forge sshpubkeys 3.3.1 pyhd8ed1ab_0 conda-forge statsmodels 0.14.0 py310h55b1ad0_1 conda-forge streamz 0.6.4 pyh6c4a22f_0 conda-forge sysroot_linux-aarch64 2.17 h5b4a56d_13 conda-forge tbb 2021.9.0 h4c384f3_0 conda-forge tblib 1.7.0 pyhd8ed1ab_0 conda-forge terminado 0.17.1 pyh41d4057_0 conda-forge threadpoolctl 3.1.0 pyh8a188c0_0 conda-forge thriftpy2 0.4.16 py310hdc54845_0 conda-forge tifffile 2022.10.10 pyhd8ed1ab_0 conda-forge tiledb 2.11.3 h6866cf4_1 conda-forge tinycss2 1.2.1 pyhd8ed1ab_0 conda-forge tk 8.6.12 hd8af866_0 conda-forge toml 0.10.2 pyhd8ed1ab_0 conda-forge tomli 2.0.1 pyhd8ed1ab_0 conda-forge toolz 0.12.0 pyhd8ed1ab_0 conda-forge tornado 6.3.2 py310h7c1f4a2_0 conda-forge tqdm 4.65.0 pyhd8ed1ab_1 conda-forge traitlets 5.9.0 pyhd8ed1ab_0 conda-forge transformers 2.1.1 py_0 conda-forge treelite 3.2.0 py310h0878bc3_0 conda-forge treelite-runtime 3.2.0 pypi_0 pypi twine 4.0.2 pyhd8ed1ab_0 conda-forge typed-ast 1.5.4 py310hdc54845_1 conda-forge types-cachetools 5.3.0.5 pyhd8ed1ab_0 conda-forge types-pyyaml 6.0.12.10 pyhd8ed1ab_0 conda-forge typing-extensions 4.7.0 hd8ed1ab_0 conda-forge typing_extensions 4.7.0 pyha770c72_0 conda-forge typing_utils 0.1.0 pyhd8ed1ab_0 conda-forge tzcode 2023c hb4cce97_0 conda-forge tzdata 2023c h71feb2d_0 conda-forge ucx 1.14.1 hcd45e03_2 conda-forge ucx-proc 1.0.0 gpu rapidsai ucx-py 0.33.00a py310_230710_gc371b5d_16 rapidsai-nightly ukkonen 1.0.1 py310hb15e014_3 conda-forge umap-learn 0.5.3 py310h4c7bcd0_1 conda-forge unicodedata2 15.0.0 py310h761cc84_0 conda-forge urllib3 1.26.15 pyhd8ed1ab_0 conda-forge versioneer 0.28 pyhd8ed1ab_0 conda-forge virtualenv 20.23.1 pyhd8ed1ab_0 conda-forge wcwidth 0.2.6 pyhd8ed1ab_0 conda-forge webencodings 0.5.1 py_1 conda-forge websocket-client 1.6.1 pyhd8ed1ab_0 conda-forge websockets 10.4 py310h761cc84_1 conda-forge werkzeug 2.1.2 pyhd8ed1ab_1 conda-forge wheel 0.40.0 pyhd8ed1ab_0 conda-forge widgetsnbextension 4.0.7 pyhd8ed1ab_0 conda-forge wrapt 1.15.0 py310hb89b984_0 conda-forge xarray 2023.6.0 pyhd8ed1ab_0 conda-forge xerces-c 3.2.4 hb872fcc_1 conda-forge xgboost 1.7.5 pypi_0 pypi xmltodict 0.13.0 pyhd8ed1ab_0 conda-forge xorg-kbproto 1.0.7 h3557bc0_1002 conda-forge xorg-libice 1.1.1 h7935292_0 conda-forge xorg-libsm 1.2.4 h5a01bc2_0 conda-forge xorg-libx11 1.8.4 h2a766a3_0 conda-forge xorg-libxau 1.0.11 h31becfc_0 conda-forge xorg-libxdmcp 1.1.3 h3557bc0_0 conda-forge xorg-libxext 1.3.4 h2a766a3_2 conda-forge xorg-libxrender 0.9.10 h3557bc0_1003 conda-forge xorg-renderproto 0.11.1 h3557bc0_1002 conda-forge xorg-xextproto 7.3.0 h2a766a3_1003 conda-forge xorg-xproto 7.0.31 h3557bc0_1007 conda-forge xyzservices 2023.5.0 pyhd8ed1ab_1 conda-forge xz 5.2.6 h9cdd2b7_0 conda-forge yaml 0.2.5 hf897c2e_2 conda-forge yarl 1.9.2 py310hb299538_0 conda-forge zeromq 4.3.4 h01db608_1 conda-forge zfp 1.0.0 h4de3ea5_3 conda-forge zict 3.0.0 pyhd8ed1ab_0 conda-forge zipp 3.15.0 pyhd8ed1ab_0 conda-forge zlib 1.2.13 h31becfc_5 conda-forge zlib-ng 2.0.7 hb4cce97_0 conda-forge zstandard 0.19.0 py310h468e293_2 conda-forge zstd 1.5.2 h44f6412_6 conda-forge ```

Environment info

```shell active environment : rapids active env location : /opt/conda/envs/rapids shell level : 1 user config file : /root/.condarc populated config files : /opt/conda/.condarc conda version : 22.11.1 conda-build version : not installed python version : 3.10.12.final.0 virtual packages : __archspec=1=aarch64 __cuda=12.2=0 __glibc=2.35=0 __linux=6.2.0=0 __unix=0=0 base environment : /opt/conda (writable) conda av data dir : /opt/conda/etc/conda conda av metadata url : None channel URLs : https://conda.anaconda.org/rapidsai/linux-aarch64 https://conda.anaconda.org/rapidsai/noarch https://conda.anaconda.org/rapidsai-nightly/linux-aarch64 https://conda.anaconda.org/rapidsai-nightly/noarch https://conda.anaconda.org/dask/label/dev/linux-aarch64 https://conda.anaconda.org/dask/label/dev/noarch https://conda.anaconda.org/pytorch/linux-aarch64 https://conda.anaconda.org/pytorch/noarch https://conda.anaconda.org/conda-forge/linux-aarch64 https://conda.anaconda.org/conda-forge/noarch https://conda.anaconda.org/nvidia/linux-aarch64 https://conda.anaconda.org/nvidia/noarch https://conda.anaconda.org/gpuci/linux-aarch64 https://conda.anaconda.org/gpuci/noarch package cache : /opt/conda/pkgs /root/.conda/pkgs envs directories : /opt/conda/envs /root/.conda/envs platform : linux-aarch64 user-agent : conda/22.11.1 requests/2.31.0 CPython/3.10.12 Linux/6.2.0-dev-main-6.2.y-1+87884a3f312b5-generic-64k ubuntu/22.04.2 glibc/2.35 UID:GID : 0:0 netrc file : None offline mode : False ```
jakirkham commented 1 year ago

(collapsed some of the longer debug info sections with <details>...</details> to improve readability)

h-vetinari commented 1 year ago

Could you open a PR?