rapidsai / cuspatial

CUDA-accelerated GIS and spatiotemporal algorithms
https://docs.rapids.ai/api/cuspatial/stable/
Apache License 2.0
600 stars 152 forks source link

[BUG]: ZipCodes_Stops_PiP_cuSpatial failing: "geo_columns.index must equal data_columns.index" #1437

Closed jameslamb closed 1 month ago

jameslamb commented 1 month ago

Version

24.10

On which installation method(s) does this occur?

Conda

Describe the issue

The ZipCodes_Stops_PiP_cuSpatial notebook is failing on 24.10, with the most recent nightlies of cuspatial and all its dependencies for those versions.

Condensed stacktrace:

ValueError                                Traceback (most recent call last)
File /tmp/tmp.wVCpnDUG6u/ZipCodes_Stops_PiP_cuSpatial-test.py:336
    330 stop_by_zipcode = stop_quadtree.point_left_join_polygon(["x", "y"], ["ZCTA5CE10"])
    333 # In[13]:
--> 336 stop_by_zipcode.head()
...
File cudf/utils/performance_tracking.py:51, in _performance_tracking.<locals>.wrapper(*args, **kwargs)
File cudf/core/indexed_frame.py:1255, in IndexedFrame.head(self, n)
File cudf/core/dataframe.py:503, in _DataFrameIlocIndexer.__getitem__(self, arg)
File cuspatial/core/geodataframe.py:195, in GeoDataFrame._slice(self, arg)
File cuspatial/core/geodataframe.py:172, in GeoDataFrame._recombine_columns(self, geo_columns, data_columns)
ValueError: geo_columns.index must equal data_columns.index
full stacktrace (click me) ```text --------------------------------------------------------------------------- ValueError Traceback (most recent call last) File /tmp/tmp.wVCpnDUG6u/ZipCodes_Stops_PiP_cuSpatial-test.py:336 330 stop_by_zipcode = stop_quadtree.point_left_join_polygon(["x", "y"], ["ZCTA5CE10"]) 333 # In[13]: --> 336 stop_by_zipcode.head() 339 # ## Zipcode counting with cuDF 340 # 341 # The below uses [cuDF](https://docs.rapids.ai/api/cudf/stable/index.html) to count the number of stop signs per zip code. Then merge the geometry information from the zipcode dataset. (...) 345 346 # Count the Stop Signs by California Zip Codes 347 stop_counts = stop_by_zipcode.groupby("ZCTA5CE10").x.count().rename("stop_count") File /opt/conda/envs/test/lib/python3.11/site-packages/cudf/utils/performance_tracking.py:51, in _performance_tracking..wrapper(*args, **kwargs) 43 if nvtx.enabled(): 44 stack.enter_context( 45 nvtx.annotate( 46 message=func.__qualname__, (...) 49 ) 50 ) ---> 51 return func(*args, **kwargs) File /opt/conda/envs/test/lib/python3.11/site-packages/cudf/core/indexed_frame.py:1255, in IndexedFrame.head(self, n) 1178 @_performance_tracking 1179 def head(self, n=5): 1180 """ 1181 Return the first `n` rows. 1182 This function returns the first `n` rows for the object based (...) 1253 1 1 11.0 1254 """ -> 1255 return self.iloc[:n] File /opt/conda/envs/test/lib/python3.11/site-packages/cudf/core/dataframe.py:503, in _DataFrameIlocIndexer.__getitem__(self, arg) 501 return frame._apply_boolean_mask(row_spec.key, keep_index=True) 502 elif isinstance(row_spec, indexing_utils.SliceIndexer): --> 503 return frame._slice(row_spec.key) 504 elif isinstance(row_spec, indexing_utils.ScalarIndexer): 505 result = frame._gather(row_spec.key, keep_index=True) File /opt/conda/envs/test/lib/python3.11/site-packages/cuspatial/core/geodataframe.py:195, in GeoDataFrame._slice(self, arg) 190 sliced_geo_columns = GeoDataFrame( 191 {name: geo_columns[name].iloc[arg] for name in geo_columns.columns} 192 ) 193 sliced_data_columns = data_columns._slice(arg) 194 return self._from_data( --> 195 self._recombine_columns(sliced_geo_columns, sliced_data_columns), 196 index=sliced_data_columns.index, 197 ) File /opt/conda/envs/test/lib/python3.11/site-packages/cuspatial/core/geodataframe.py:172, in GeoDataFrame._recombine_columns(self, geo_columns, data_columns) 165 """ 166 Combine a GeoDataFrame of only geometry columns with a DataFrame 167 of non-geometry columns in the same order as the columns in `self` 168 169 The output is meant for GeoDataFrame._from_data. 170 """ 171 if not geo_columns.index.equals(data_columns.index): --> 172 raise ValueError("geo_columns.index must equal data_columns.index") 174 columns_mask = self.columns 175 col_is_geo = (isinstance(self[col], GeoSeries) for col in columns_mask) ValueError: geo_columns.index must equal data_columns.index --------------------------------------------------------------- ```

Minimum reproducible example

Observing this in the conda-notebook-tests job on all PRs targeting 24.10.

Relevant log output

No response

Environment details

output from 'print_env.sh' (click me) ```text AWS_ACCESS_KEY_ID=*** AWS_DEFAULT_REGION=us-east-2 AWS_REGION=us-east-2 AWS_SECRET_ACCESS_KEY=*** AWS_SESSION_TOKEN=*** CI=true CONDA_DEFAULT_ENV=test CONDA_EXE=/opt/conda/bin/conda CONDA_PREFIX=/opt/conda/envs/test CONDA_PROMPT_MODIFIER=(test) CONDA_PYTHON_EXE=/opt/conda/bin/python CONDA_SHLVL=1 CPL_ZIP_ENCODING=UTF-8 CUDA_VERSION=12.2.2 GDAL_DATA=/opt/conda/envs/test/share/gdal GDAL_DRIVER_PATH=/opt/conda/envs/test/lib/gdalplugins GH_TOKEN=*** GITHUB_ACTION=__run_3 GITHUB_ACTIONS=true GITHUB_ACTION_REF= GITHUB_ACTION_REPOSITORY= GITHUB_ACTOR=copy-pr-bot[bot] GITHUB_ACTOR_ID=138252374 GITHUB_API_URL=https://api.github.com GITHUB_BASE_REF= GITHUB_ENV=/__w/_temp/_runner_file_commands/set_env_cba6e0db-91ea-4d55-a05b-135fb3ef4631 GITHUB_EVENT_NAME=push GITHUB_EVENT_PATH=/github/workflow/event.json GITHUB_GRAPHQL_URL=https://api.github.com/graphql GITHUB_HEAD_REF= GITHUB_JOB=build GITHUB_OUTPUT=/__w/_temp/_runner_file_commands/set_output_cba6e0db-91ea-4d55-a05b-135fb3ef4631 GITHUB_PATH=/__w/_temp/_runner_file_commands/add_path_cba6e0db-91ea-4d55-a05b-135fb3ef4631 GITHUB_REF=refs/heads/pull-request/1430 GITHUB_REF_NAME=pull-request/1430 GITHUB_REF_PROTECTED=false GITHUB_REF_TYPE=branch GITHUB_REPOSITORY=rapidsai/cuspatial GITHUB_REPOSITORY_ID=199666905 GITHUB_REPOSITORY_OWNER=rapidsai GITHUB_REPOSITORY_OWNER_ID=43887749 GITHUB_RETENTION_DAYS=90 GITHUB_RUN_ATTEMPT=1 GITHUB_RUN_ID=10321935884 GITHUB_RUN_NUMBER=1992 GITHUB_SERVER_URL=https://github.com GITHUB_SHA=9d7b73823e1e4588c60b02878778fe9bfbd02120 GITHUB_STATE=/__w/_temp/_runner_file_commands/save_state_cba6e0db-91ea-4d55-a05b-135fb3ef4631 GITHUB_STEP_SUMMARY=/__w/_temp/_runner_file_commands/step_summary_cba6e0db-91ea-4d55-a05b-135fb3ef4631 GITHUB_TRIGGERING_ACTOR=copy-pr-bot[bot] GITHUB_WORKFLOW=pr GITHUB_WORKFLOW_REF=rapidsai/cuspatial/.github/workflows/pr.yaml@refs/heads/pull-request/1430 GITHUB_WORKFLOW_SHA=9d7b73823e1e4588c60b02878778fe9bfbd02120 GITHUB_WORKSPACE=/__w/cuspatial/cuspatial GSETTINGS_SCHEMA_DIR=/opt/conda/envs/test/share/glib-2.0/schemas GSETTINGS_SCHEMA_DIR_CONDA_BACKUP= HOME=/github/home HOSTNAME=e069a8f1cf3a LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 NVARCH=x86_64 NVIDIA_DRIVER_CAPABILITIES=compute,utility NVIDIA_REQUIRE_CUDA=cuda>=12.2 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 NVIDIA_VISIBLE_DEVICES=GPU-f243c8e5-7f90-bbe2-319d-25231849054e NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-2 NV_CUDA_CUDART_VERSION=12.2.140-1 PATH=/opt/conda/envs/test/bin:/opt/conda/condabin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin PROJ_DATA=/opt/conda/envs/test/share/proj PROJ_NETWORK=ON *** PYTHON_VERSION=3.11 RAPIDS_BASE_BRANCH=branch-24.10 RAPIDS_BUILD_TYPE=pull-request RAPIDS_CONDA_BLD_OUTPUT_DIR=/tmp/conda-bld-output RAPIDS_CONDA_BLD_ROOT_DIR=/tmp/conda-bld-workspace RAPIDS_CUDA_VERSION=12.2.2 RAPIDS_NIGHTLY_DATE= RAPIDS_PY_VERSION=3.11 RAPIDS_REF_NAME=pull-request/1430 RAPIDS_REPOSITORY=rapidsai/cuspatial RAPIDS_SHA=9d7b73823e1e4588c60b02878778fe9bfbd02120 RUNNER_ARCH=X64 RUNNER_ENVIRONMENT=self-hosted RUNNER_NAME=linux-amd64-gpu-v100-latest-1-56xmt-runner-wqwws RUNNER_OS=Linux RUNNER_TEMP=/__w/_temp RUNNER_TOOL_CACHE=/__w/_tool RUNNER_WORKSPACE=/__w/cuspatial SHLVL=2 XML_CATALOG_FILES=file:///opt/conda/envs/test/etc/xml/catalog file:///etc/xml/catalog _=/usr/bin/env _CE_CONDA= _CE_M= RAPIDS logger » [08/09/24 16:11:47] ┌──────────────────┐ | Print arch | └──────────────────┘ x86_64 RAPIDS logger » [08/09/24 16:11:47] ┌────────────────────────────┐ | Check python version | └────────────────────────────┘ Python 3.11.9 RAPIDS logger » [08/09/24 16:11:47] ┌───────────────────────────────┐ | Check conda environment | └───────────────────────────────┘ active environment : test active env location : /opt/conda/envs/test shell level : 1 user config file : /github/home/.condarc populated config files : /opt/conda/.condarc conda version : 24.7.1 conda-build version : 24.5.1 python version : 3.11.9.final.0 solver : libmamba (default) virtual packages : __archspec=1=broadwell __conda=24.7.1=0 __cuda=12.4=0 __glibc=2.35=0 __linux=5.4.0=0 __unix=0=0 base environment : /opt/conda (writable) conda av data dir : /opt/conda/etc/conda conda av metadata url : None channel URLs : https://conda.anaconda.org/rapidsai/linux-64 https://conda.anaconda.org/rapidsai/noarch https://conda.anaconda.org/rapidsai-nightly/linux-64 https://conda.anaconda.org/rapidsai-nightly/noarch https://conda.anaconda.org/dask/label/dev/linux-64 https://conda.anaconda.org/dask/label/dev/noarch https://conda.anaconda.org/pytorch/linux-64 https://conda.anaconda.org/pytorch/noarch https://conda.anaconda.org/conda-forge/linux-64 https://conda.anaconda.org/conda-forge/noarch https://conda.anaconda.org/nvidia/linux-64 https://conda.anaconda.org/nvidia/noarch package cache : /opt/conda/pkgs /github/home/.conda/pkgs envs directories : /opt/conda/envs /github/home/.conda/envs platform : linux-64 user-agent : conda/24.7.1 requests/2.32.3 CPython/3.11.9 Linux/5.4.0-189-generic ubuntu/22.04.4 glibc/2.35 solver/libmamba conda-libmamba-solver/24.7.0 libmambapy/1.5.8 UID:GID : 0:0 netrc file : None offline mode : False ==> /opt/conda/.condarc <== auto_update_conda: False channels: - rapidsai - rapidsai-nightly - dask/label/dev - pytorch - conda-forge - nvidia always_yes: True number_channel_notices: 0 conda-build: set_build_id: False root_dir: /tmp/conda-bld-workspace output_folder: /tmp/conda-bld-output ==> envvars <== allow_softlinks: False # packages in environment at /opt/conda/envs/test: # # Name Version Build Channel _libgcc_mutex 0.1 conda_forge conda-forge _openmp_mutex 4.5 2_gnu conda-forge affine 2.4.0 pyhd8ed1ab_0 conda-forge anyio 4.4.0 pyhd8ed1ab_0 conda-forge argon2-cffi 23.1.0 pyhd8ed1ab_0 conda-forge argon2-cffi-bindings 21.2.0 py311h459d7ec_4 conda-forge arrow 1.3.0 pyhd8ed1ab_0 conda-forge asttokens 2.4.1 pyhd8ed1ab_0 conda-forge async-lru 2.0.4 pyhd8ed1ab_0 conda-forge attrs 24.2.0 pyh71513ae_0 conda-forge aws-c-auth 0.7.25 hdfe1943_2 conda-forge aws-c-cal 0.7.2 h87b94db_0 conda-forge aws-c-common 0.9.23 h4ab18f5_0 conda-forge aws-c-compression 0.2.18 he027950_7 conda-forge aws-c-event-stream 0.4.2 h29f85be_19 conda-forge aws-c-http 0.8.7 h45b8271_1 conda-forge aws-c-io 0.14.18 h6ea103f_1 conda-forge aws-c-mqtt 0.10.4 h7eb77b2_15 conda-forge aws-c-s3 0.6.4 hd923058_5 conda-forge aws-c-sdkutils 0.1.16 he027950_3 conda-forge aws-checksums 0.1.18 he027950_7 conda-forge aws-crt-cpp 0.27.5 hdd22b19_3 conda-forge aws-sdk-cpp 1.11.379 h82708ae_1 conda-forge azure-core-cpp 1.13.0 h935415a_0 conda-forge azure-identity-cpp 1.8.0 hd126650_2 conda-forge azure-storage-blobs-cpp 12.12.0 hd2e3451_0 conda-forge azure-storage-common-cpp 12.7.0 h10ac4d7_1 conda-forge azure-storage-files-datalake-cpp 12.11.0 h325d260_1 conda-forge babel 2.14.0 pyhd8ed1ab_0 conda-forge beautifulsoup4 4.12.3 pyha770c72_0 conda-forge bleach 6.1.0 pyhd8ed1ab_0 conda-forge blosc 1.21.6 hef167b5_0 conda-forge bokeh 3.5.1 pyhd8ed1ab_0 conda-forge branca 0.7.2 pyhd8ed1ab_0 conda-forge brotli 1.1.0 hd590300_1 conda-forge brotli-bin 1.1.0 hd590300_1 conda-forge brotli-python 1.1.0 py311hb755f60_1 conda-forge bzip2 1.0.8 h4bc722e_7 conda-forge c-ares 1.32.3 h4bc722e_0 conda-forge ca-certificates 2024.7.4 hbcca054_0 conda-forge cached-property 1.5.2 hd8ed1ab_1 conda-forge cached_property 1.5.2 pyha770c72_1 conda-forge cachetools 5.4.0 pyhd8ed1ab_0 conda-forge cairo 1.18.0 h3faef2a_0 conda-forge certifi 2024.7.4 pyhd8ed1ab_0 conda-forge cffi 1.17.0 py311ha8e6434_0 conda-forge cfitsio 4.3.1 hbdc6101_0 conda-forge charset-normalizer 3.3.2 pyhd8ed1ab_0 conda-forge click 8.1.7 unix_pyh707e725_0 conda-forge click-plugins 1.1.1 py_0 conda-forge cligj 0.7.2 pyhd8ed1ab_1 conda-forge cloudpickle 3.0.0 pyhd8ed1ab_0 conda-forge comm 0.2.2 pyhd8ed1ab_0 conda-forge contourpy 1.2.1 py311h9547e67_0 conda-forge cuda-cccl_linux-64 12.2.140 ha770c72_0 conda-forge cuda-crt-dev_linux-64 12.2.140 ha770c72_1 conda-forge cuda-crt-tools 12.2.140 ha770c72_1 conda-forge cuda-cudart 12.2.140 hd3aeb46_0 conda-forge cuda-cudart-dev 12.2.140 hd3aeb46_0 conda-forge cuda-cudart-dev_linux-64 12.2.140 h59595ed_0 conda-forge cuda-cudart-static 12.2.140 hd3aeb46_0 conda-forge cuda-cudart-static_linux-64 12.2.140 h59595ed_0 conda-forge cuda-cudart_linux-64 12.2.140 h59595ed_0 conda-forge cuda-nvcc-dev_linux-64 12.2.140 ha770c72_1 conda-forge cuda-nvcc-impl 12.2.140 hd3aeb46_1 conda-forge cuda-nvcc-tools 12.2.140 hd3aeb46_1 conda-forge cuda-nvrtc 12.2.140 hd3aeb46_0 conda-forge cuda-nvvm-dev_linux-64 12.2.140 ha770c72_1 conda-forge cuda-nvvm-impl 12.2.140 h59595ed_1 conda-forge cuda-nvvm-tools 12.2.140 h59595ed_1 conda-forge cuda-profiler-api 12.2.140 ha770c72_0 conda-forge cuda-python 12.6.0 py311h817de4b_0 conda-forge cuda-version 12.2 he2b69de_3 conda-forge cudf 24.10.00a160 cuda12_py311_240809_g1bbe440ee7_160 rapidsai-nightly cuml 24.10.00a33 cuda12_py311_240809_g0def703b4_33 rapidsai-nightly cuproj 24.10.00a27 cuda12_py311_240809_g9d7b7382_27 file:///tmp/python_channel cupy 13.2.0 py311he5a987b_1 conda-forge cupy-core 13.2.0 py311h3bdf873_1 conda-forge curl 8.9.1 h18eb788_0 conda-forge cuspatial 24.10.00a27 cuda12_py311_240809_g9d7b7382_27 file:///tmp/python_channel cycler 0.12.1 pyhd8ed1ab_0 conda-forge cytoolz 0.12.3 py311h459d7ec_0 conda-forge dask 2024.7.1 pyhd8ed1ab_0 conda-forge dask-core 2024.7.1 pyhd8ed1ab_0 conda-forge dask-cuda 24.10.00a12 py311_240809_g00c37dc_12 rapidsai-nightly dask-cudf 24.10.00a160 cuda12_py311_240809_g1bbe440ee7_160 rapidsai-nightly dask-expr 1.1.9 pyhd8ed1ab_0 conda-forge debugpy 1.8.5 py311hf86e51f_0 conda-forge decorator 5.1.1 pyhd8ed1ab_0 conda-forge defusedxml 0.7.1 pyhd8ed1ab_0 conda-forge distributed 2024.7.1 pyhd8ed1ab_0 conda-forge distributed-ucxx 0.40.00a py3.11_240809_g021ab84_17 rapidsai-nightly dlpack 0.8 h59595ed_3 conda-forge entrypoints 0.4 pyhd8ed1ab_0 conda-forge exceptiongroup 1.2.2 pyhd8ed1ab_0 conda-forge executing 2.0.1 pyhd8ed1ab_0 conda-forge expat 2.6.2 h59595ed_0 conda-forge fastrlock 0.8.2 py311hb755f60_2 conda-forge fiona 1.9.5 py311hbac4ec9_0 conda-forge fmt 10.2.1 h00ab1b0_0 conda-forge folium 0.17.0 pyhd8ed1ab_0 conda-forge font-ttf-dejavu-sans-mono 2.37 hab24e00_0 conda-forge font-ttf-inconsolata 3.000 h77eed37_0 conda-forge font-ttf-source-code-pro 2.038 h77eed37_0 conda-forge font-ttf-ubuntu 0.83 h77eed37_2 conda-forge fontconfig 2.14.2 h14ed4e7_0 conda-forge fonts-conda-ecosystem 1 0 conda-forge fonts-conda-forge 1 0 conda-forge fonttools 4.53.1 py311h61187de_0 conda-forge fqdn 1.5.1 pyhd8ed1ab_0 conda-forge freetype 2.12.1 h267a509_2 conda-forge freexl 2.0.0 h743c826_0 conda-forge fsspec 2024.6.1 pyhff2d567_0 conda-forge gdal 3.7.3 py311h39b4e0e_11 conda-forge geopandas 0.14.4 pyhd8ed1ab_0 conda-forge geopandas-base 0.14.4 pyha770c72_0 conda-forge geos 3.12.1 h59595ed_0 conda-forge geotiff 1.7.1 hf074850_14 conda-forge gettext 0.22.5 h59595ed_2 conda-forge gettext-tools 0.22.5 h59595ed_2 conda-forge gflags 2.2.2 he1b5a44_1004 conda-forge giflib 5.2.2 hd590300_0 conda-forge glog 0.7.1 hbabe93e_0 conda-forge h11 0.14.0 pyhd8ed1ab_0 conda-forge h2 4.1.0 pyhd8ed1ab_0 conda-forge hdf4 4.2.15 h2a13503_7 conda-forge hdf5 1.14.3 nompi_hdf9ad27_105 conda-forge hpack 4.0.0 pyh9f0ad1d_0 conda-forge httpcore 1.0.5 pyhd8ed1ab_0 conda-forge httpx 0.27.0 pyhd8ed1ab_0 conda-forge hyperframe 6.0.1 pyhd8ed1ab_0 conda-forge icu 73.2 h59595ed_0 conda-forge idna 3.7 pyhd8ed1ab_0 conda-forge imagecodecs-lite 2019.12.3 py311h18e1886_8 conda-forge imageio 2.34.2 pyh12aca89_0 conda-forge importlib-metadata 8.2.0 pyha770c72_0 conda-forge importlib_metadata 8.2.0 hd8ed1ab_0 conda-forge importlib_resources 6.4.0 pyhd8ed1ab_0 conda-forge ipykernel 6.29.5 pyh3099207_0 conda-forge ipython 8.26.0 pyh707e725_0 conda-forge ipywidgets 8.1.3 pyhd8ed1ab_0 conda-forge isoduration 20.11.0 pyhd8ed1ab_0 conda-forge jedi 0.19.1 pyhd8ed1ab_0 conda-forge jinja2 3.1.4 pyhd8ed1ab_0 conda-forge joblib 1.4.2 pyhd8ed1ab_0 conda-forge json-c 0.17 h1220068_1 conda-forge json5 0.9.25 pyhd8ed1ab_0 conda-forge jsonpointer 3.0.0 py311h38be061_0 conda-forge jsonschema 4.23.0 pyhd8ed1ab_0 conda-forge jsonschema-specifications 2023.12.1 pyhd8ed1ab_0 conda-forge jsonschema-with-format-nongpl 4.23.0 hd8ed1ab_0 conda-forge jupyter-lsp 2.2.5 pyhd8ed1ab_0 conda-forge jupyter_client 8.6.2 pyhd8ed1ab_0 conda-forge jupyter_core 5.7.2 py311h38be061_0 conda-forge jupyter_events 0.10.0 pyhd8ed1ab_0 conda-forge jupyter_server 2.14.2 pyhd8ed1ab_0 conda-forge jupyter_server_terminals 0.5.3 pyhd8ed1ab_0 conda-forge jupyterlab 4.2.4 pyhd8ed1ab_0 conda-forge jupyterlab_pygments 0.3.0 pyhd8ed1ab_1 conda-forge jupyterlab_server 2.27.3 pyhd8ed1ab_0 conda-forge jupyterlab_widgets 3.0.11 pyhd8ed1ab_0 conda-forge kealib 1.5.3 hee9dde6_1 conda-forge keyutils 1.6.1 h166bdaf_0 conda-forge kiwisolver 1.4.5 py311h9547e67_1 conda-forge krb5 1.21.3 h659f571_0 conda-forge lazy_loader 0.4 pyhd8ed1ab_0 conda-forge lcms2 2.16 hb7c19ff_0 conda-forge ld_impl_linux-64 2.40 hf3520f5_7 conda-forge lerc 4.0.0 h27087fc_0 conda-forge libabseil 20240116.2 cxx17_he02047a_1 conda-forge libaec 1.1.3 h59595ed_0 conda-forge libarchive 3.7.4 hfca40fe_0 conda-forge libarrow 16.1.0 h1aed627_18_cpu conda-forge libarrow-acero 16.1.0 he02047a_18_cpu conda-forge libarrow-dataset 16.1.0 he02047a_18_cpu conda-forge libarrow-substrait 16.1.0 hc9a23c6_18_cpu conda-forge libasprintf 0.22.5 h661eb56_2 conda-forge libasprintf-devel 0.22.5 h661eb56_2 conda-forge libblas 3.9.0 23_linux64_openblas conda-forge libbrotlicommon 1.1.0 hd590300_1 conda-forge libbrotlidec 1.1.0 hd590300_1 conda-forge libbrotlienc 1.1.0 hd590300_1 conda-forge libcblas 3.9.0 23_linux64_openblas conda-forge libcrc32c 1.1.2 h9c3ff4c_0 conda-forge libcublas 12.2.5.6 hd3aeb46_0 conda-forge libcublas-dev 12.2.5.6 hd3aeb46_0 conda-forge libcudf 24.10.00a160 cuda12_240809_g1bbe440ee7_160 rapidsai-nightly libcufft 11.0.8.103 hd3aeb46_0 conda-forge libcufile 1.7.2.10 hd3aeb46_0 conda-forge libcufile-dev 1.7.2.10 hd3aeb46_0 conda-forge libcuml 24.10.00a33 cuda12_240809_g0def703b4_33 rapidsai-nightly libcumlprims 24.10.00a cuda12_240809_g0141c29_2 rapidsai-nightly libcurand 10.3.3.141 hd3aeb46_0 conda-forge libcurand-dev 10.3.3.141 hd3aeb46_0 conda-forge libcurl 8.9.1 hdb1bdb2_0 conda-forge libcusolver 11.5.2.141 hd3aeb46_0 conda-forge libcusolver-dev 11.5.2.141 hd3aeb46_0 conda-forge libcusparse 12.1.2.141 hd3aeb46_0 conda-forge libcusparse-dev 12.1.2.141 hd3aeb46_0 conda-forge libcuspatial 24.10.00a27 cuda12_240809_g9d7b7382_27 file:///tmp/cpp_channel libdeflate 1.19 hd590300_0 conda-forge libedit 3.1.20191231 he28a2e2_2 conda-forge libev 4.33 hd590300_2 conda-forge libevent 2.1.12 hf998b51_1 conda-forge libexpat 2.6.2 h59595ed_0 conda-forge libffi 3.4.2 h7f98852_5 conda-forge libgcc-ng 14.1.0 h77fa898_0 conda-forge libgdal 3.7.3 h184a269_11 conda-forge libgettextpo 0.22.5 h59595ed_2 conda-forge libgettextpo-devel 0.22.5 h59595ed_2 conda-forge libgfortran-ng 14.1.0 h69a702a_0 conda-forge libgfortran5 14.1.0 hc5f4f2c_0 conda-forge libglib 2.78.4 h783c2da_0 conda-forge libgomp 14.1.0 h77fa898_0 conda-forge libgoogle-cloud 2.26.0 h26d7fe4_0 conda-forge libgoogle-cloud-storage 2.26.0 ha262f82_0 conda-forge libgrpc 1.62.2 h15f2491_0 conda-forge libiconv 1.17 hd590300_2 conda-forge libjpeg-turbo 3.0.0 hd590300_1 conda-forge libkml 1.3.0 hbbc8833_1020 conda-forge libkvikio 24.10.00a cuda12_240809_gab84fdf_26 rapidsai-nightly liblapack 3.9.0 23_linux64_openblas conda-forge libllvm14 14.0.6 hcd5def8_4 conda-forge libnetcdf 4.9.2 nompi_h135f659_114 conda-forge libnghttp2 1.58.0 h47da74e_1 conda-forge libnl 3.10.0 h4bc722e_0 conda-forge libnsl 2.0.1 hd590300_0 conda-forge libnvjitlink 12.2.140 hd3aeb46_0 conda-forge libopenblas 0.3.27 pthreads_hac2b453_1 conda-forge libparquet 16.1.0 h9e5060d_18_cpu conda-forge libpng 1.6.43 h2797004_0 conda-forge libpq 16.4 h482b261_0 conda-forge libprotobuf 4.25.3 h08a7969_0 conda-forge libraft 24.10.00a23 cuda12_240809_g32f3703b_23 rapidsai-nightly libraft-headers 24.10.00a23 cuda12_240809_g32f3703b_23 rapidsai-nightly libraft-headers-only 24.10.00a23 cuda12_240809_g32f3703b_23 rapidsai-nightly libre2-11 2023.09.01 h5a48ba9_2 conda-forge librmm 24.10.00a22 cuda12_240809_g975c911a_22 rapidsai-nightly librttopo 1.1.0 h8917695_15 conda-forge libsodium 1.0.18 h36c2ea0_1 conda-forge libspatialindex 2.0.0 he02047a_0 conda-forge libspatialite 5.1.0 h72606ae_3 conda-forge libsqlite 3.46.0 hde9e2c9_0 conda-forge libssh2 1.11.0 h0841786_0 conda-forge libstdcxx-ng 14.1.0 hc0a3c3a_0 conda-forge libthrift 0.19.0 hb90f79a_1 conda-forge libtiff 4.6.0 ha9c0a0a_2 conda-forge libucxx 0.40.00a cuda12_240809_g021ab84_17 rapidsai-nightly libutf8proc 2.8.0 h166bdaf_0 conda-forge libuuid 2.38.1 h0b41bf4_0 conda-forge libwebp-base 1.4.0 hd590300_0 conda-forge libxcb 1.15 h0b41bf4_0 conda-forge libxcrypt 4.4.36 hd590300_1 conda-forge libxml2 2.12.7 h4c95cb1_3 conda-forge libzip 1.10.1 h2629f0a_3 conda-forge libzlib 1.3.1 h4ab18f5_1 conda-forge llvmlite 0.43.0 py311hbde99c3_0 conda-forge locket 1.0.0 pyhd8ed1ab_0 conda-forge lz4 4.3.3 py311h38e4bf4_0 conda-forge lz4-c 1.9.4 hcb278e6_0 conda-forge lzo 2.10 hd590300_1001 conda-forge mapclassify 2.7.0 pyhd8ed1ab_0 conda-forge markdown-it-py 3.0.0 pyhd8ed1ab_0 conda-forge markupsafe 2.1.5 py311h459d7ec_0 conda-forge matplotlib-base 3.8.4 py311ha4ca890_2 conda-forge matplotlib-inline 0.1.7 pyhd8ed1ab_0 conda-forge mdurl 0.1.2 pyhd8ed1ab_0 conda-forge minizip 4.0.7 h401b404_0 conda-forge mistune 3.0.2 pyhd8ed1ab_0 conda-forge msgpack-python 1.0.8 py311h52f7536_0 conda-forge munch 4.0.0 pyhd8ed1ab_0 conda-forge munkres 1.1.4 pyh9f0ad1d_0 conda-forge nbclient 0.10.0 pyhd8ed1ab_0 conda-forge nbconvert-core 7.16.4 pyhd8ed1ab_1 conda-forge nbformat 5.10.4 pyhd8ed1ab_0 conda-forge nccl 2.22.3.1 hbc370b7_1 conda-forge ncurses 6.5 h59595ed_0 conda-forge nest-asyncio 1.6.0 pyhd8ed1ab_0 conda-forge networkx 3.3 pyhd8ed1ab_1 conda-forge notebook 7.2.1 pyhd8ed1ab_0 conda-forge notebook-shim 0.2.4 pyhd8ed1ab_0 conda-forge nspr 4.35 h27087fc_0 conda-forge nss 3.103 h593d115_0 conda-forge numba 0.60.0 py311h4bc866e_0 conda-forge numpy 1.26.4 py311h64a7726_0 conda-forge nvcomp 3.0.6 h10b603f_0 conda-forge nvtx 0.2.10 py311h459d7ec_0 conda-forge openjpeg 2.5.2 h488ebb8_0 conda-forge openssl 3.3.1 h4bc722e_2 conda-forge orc 2.0.1 h17fec99_1 conda-forge osmnx 1.9.4 pyhd8ed1ab_0 conda-forge overrides 7.7.0 pyhd8ed1ab_0 conda-forge packaging 24.1 pyhd8ed1ab_0 conda-forge pandas 2.2.2 py311h14de704_1 conda-forge pandocfilters 1.5.0 pyhd8ed1ab_0 conda-forge parso 0.8.4 pyhd8ed1ab_0 conda-forge partd 1.4.2 pyhd8ed1ab_0 conda-forge pcre2 10.42 hcad00b1_0 conda-forge pexpect 4.9.0 pyhd8ed1ab_0 conda-forge pickleshare 0.7.5 py_1003 conda-forge pillow 10.3.0 py311h18e6fac_0 conda-forge pip 24.2 pyhd8ed1ab_0 conda-forge pixman 0.43.2 h59595ed_0 conda-forge pkgutil-resolve-name 1.3.10 pyhd8ed1ab_1 conda-forge platformdirs 4.2.2 pyhd8ed1ab_0 conda-forge poppler 23.12.0 h590f24d_0 conda-forge poppler-data 0.4.12 hd8ed1ab_0 conda-forge postgresql 16.4 ha8faf9a_0 conda-forge proj 9.3.0 h1d62c97_2 conda-forge prometheus_client 0.20.0 pyhd8ed1ab_0 conda-forge prompt-toolkit 3.0.47 pyha770c72_0 conda-forge psutil 6.0.0 py311h331c9d8_0 conda-forge pthread-stubs 0.4 h36c2ea0_1001 conda-forge ptyprocess 0.7.0 pyhd3deb0d_0 conda-forge pure_eval 0.2.3 pyhd8ed1ab_0 conda-forge pyarrow 16.1.0 py311hbd00459_5 conda-forge pyarrow-core 16.1.0 py311h9460f28_5_cpu conda-forge pyarrow-hotfix 0.6 pyhd8ed1ab_0 conda-forge pycparser 2.22 pyhd8ed1ab_0 conda-forge pydeck 0.8.0 pyhd8ed1ab_0 conda-forge pygments 2.18.0 pyhd8ed1ab_0 conda-forge pylibraft 24.10.00a23 cuda12_py311_240809_g32f3703b_23 rapidsai-nightly pynvjitlink 0.3.0 py311hd269673_0 rapidsai pynvml 11.4.1 pyhd8ed1ab_0 conda-forge pyparsing 3.1.2 pyhd8ed1ab_0 conda-forge pyproj 3.6.1 py311h1facc83_4 conda-forge pysocks 1.7.1 pyha2e5f31_6 conda-forge python 3.11.9 hb806964_0_cpython conda-forge python-dateutil 2.9.0 pyhd8ed1ab_0 conda-forge python-fastjsonschema 2.20.0 pyhd8ed1ab_0 conda-forge python-json-logger 2.0.7 pyhd8ed1ab_0 conda-forge python-tzdata 2024.1 pyhd8ed1ab_0 conda-forge python_abi 3.11 4_cp311 conda-forge pytz 2024.1 pyhd8ed1ab_0 conda-forge pywavelets 1.6.0 py311h18e1886_0 conda-forge pyyaml 6.0.2 py311h61187de_0 conda-forge pyzmq 26.1.0 py311h759c1eb_0 conda-forge raft-dask 24.10.00a23 cuda12_py311_240809_g32f3703b_23 rapidsai-nightly rapids-dask-dependency 24.10.00a3 py_0 rapidsai-nightly rasterio 1.3.9 py311h40fbdff_0 conda-forge rdma-core 53.0 he02047a_0 conda-forge re2 2023.09.01 h7f4b329_2 conda-forge readline 8.2 h8228510_1 conda-forge referencing 0.35.1 pyhd8ed1ab_0 conda-forge requests 2.32.3 pyhd8ed1ab_0 conda-forge rfc3339-validator 0.1.4 pyhd8ed1ab_0 conda-forge rfc3986-validator 0.1.1 pyh9f0ad1d_0 conda-forge rich 13.7.1 pyhd8ed1ab_0 conda-forge rmm 24.10.00a22 cuda12_py311_240809_g975c911a_22 rapidsai-nightly rpds-py 0.20.0 py311hb3a8bbb_0 conda-forge rtree 1.3.0 py311h51bcefd_1 conda-forge s2n 1.4.19 h3400bea_0 conda-forge scikit-image 0.20.0 py311h2872171_1 conda-forge scikit-learn 1.5.1 py311hd632256_0 conda-forge scipy 1.13.1 py311h517d4fd_0 conda-forge send2trash 1.8.3 pyh0d859eb_0 conda-forge setuptools 72.1.0 pyhd8ed1ab_0 conda-forge shapely 2.0.4 py311h0bed3d6_1 conda-forge six 1.16.0 pyh6c4a22f_0 conda-forge snappy 1.2.1 ha2e4443_0 conda-forge sniffio 1.3.1 pyhd8ed1ab_0 conda-forge snuggs 1.4.7 pyhd8ed1ab_1 conda-forge sortedcontainers 2.4.0 pyhd8ed1ab_0 conda-forge soupsieve 2.5 pyhd8ed1ab_1 conda-forge spdlog 1.12.0 hd2e6256_2 conda-forge sqlite 3.46.0 h6d4b2fc_0 conda-forge stack_data 0.6.2 pyhd8ed1ab_0 conda-forge tblib 3.0.0 pyhd8ed1ab_0 conda-forge terminado 0.18.1 pyh0d859eb_0 conda-forge threadpoolctl 3.5.0 pyhc1e730c_0 conda-forge tifffile 2020.6.3 py_0 conda-forge tiledb 2.18.2 h99f50a1_1 conda-forge tinycss2 1.3.0 pyhd8ed1ab_0 conda-forge tk 8.6.13 noxft_h4845f30_101 conda-forge tomli 2.0.1 pyhd8ed1ab_0 conda-forge toolz 0.12.1 pyhd8ed1ab_0 conda-forge tornado 6.4.1 py311h331c9d8_0 conda-forge traitlets 5.14.3 pyhd8ed1ab_0 conda-forge treelite 4.3.0 py311he8f9275_0 conda-forge types-python-dateutil 2.9.0.20240316 pyhd8ed1ab_0 conda-forge typing-extensions 4.12.2 hd8ed1ab_0 conda-forge typing_extensions 4.12.2 pyha770c72_0 conda-forge typing_utils 0.1.0 pyhd8ed1ab_0 conda-forge tzcode 2024a h3f72095_0 conda-forge tzdata 2024a h0c530f3_0 conda-forge ucx 1.17.0 h0399452_2 conda-forge ucx-py 0.40.00a6 py311_240809_gd1fe2e7_6 rapidsai-nightly ucxx 0.40.00a cuda12_py3.11_240809_g021ab84_17 rapidsai-nightly uri-template 1.3.0 pyhd8ed1ab_0 conda-forge uriparser 0.9.8 hac33072_0 conda-forge urllib3 2.2.2 pyhd8ed1ab_1 conda-forge wcwidth 0.2.13 pyhd8ed1ab_0 conda-forge webcolors 24.6.0 pyhd8ed1ab_0 conda-forge webencodings 0.5.1 pyhd8ed1ab_2 conda-forge websocket-client 1.8.0 pyhd8ed1ab_0 conda-forge wheel 0.44.0 pyhd8ed1ab_0 conda-forge widgetsnbextension 4.0.11 pyhd8ed1ab_0 conda-forge xerces-c 3.2.5 hac6953d_0 conda-forge xorg-kbproto 1.0.7 h7f98852_1002 conda-forge xorg-libice 1.1.1 hd590300_0 conda-forge xorg-libsm 1.2.4 h7391055_0 conda-forge xorg-libx11 1.8.9 h8ee46fc_0 conda-forge xorg-libxau 1.0.11 hd590300_0 conda-forge xorg-libxdmcp 1.1.3 h7f98852_0 conda-forge xorg-libxext 1.3.4 h0b41bf4_2 conda-forge xorg-libxrender 0.9.11 hd590300_0 conda-forge xorg-renderproto 0.11.1 h7f98852_1002 conda-forge xorg-xextproto 7.3.0 h0b41bf4_1003 conda-forge xorg-xproto 7.0.31 h7f98852_1007 conda-forge xyzservices 2024.6.0 pyhd8ed1ab_0 conda-forge xz 5.2.6 h166bdaf_0 conda-forge yaml 0.2.5 h7f98852_2 conda-forge zeromq 4.3.5 h75354e8_4 conda-forge zict 3.0.0 pyhd8ed1ab_0 conda-forge zipp 3.19.2 pyhd8ed1ab_0 conda-forge zlib 1.3.1 h4ab18f5_1 conda-forge zstandard 0.23.0 py311h5cd10c7_0 conda-forge zstd 1.5.6 ha6fb4c9_0 conda-forge /__w/cuspatial/cuspatial/notebooks /__w/cuspatial/cuspatial Fri Aug 9 16:11:53 2024 +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | |-----------------------------------------+------------------------+----------------------+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+========================+======================| | 0 Tesla V100-PCIE-32GB Off | 00000000:05:00.0 Off | 0 | | N/A 27C P0 23W / 250W | 3MiB / 32768MiB | 0% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ +-----------------------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=========================================================================================| | No running processes found | +-----------------------------------------------------------------------------------------+ ```

Other/Misc.

I'm working on creating a minimal, reproducible example that's a bit more precise than CI logs. But wanted to get this opened as soon as possible.

jameslamb commented 1 month ago

I ran this notebook locally on a machine with CUDA 12.2 and 8 V100s.

Was able to reproduce the error there, and can share some more details about that stop_by_zipcode object.

type(stop_by_zipcode)
# <class 'cuspatial.core.geodataframe.GeoDataFrame'>

type(stop_by_zipcode.index)
# <class 'cudf.core.index.RangeIndex'>

stop_by_zipcode.index
# RangeIndex(start=0, stop=121637, step=1)

stop_by_zipcode.dtypes
# x            float64
# y            float64
# ZCTA5CE10     object
# dtype: object

stop_by_zipcode.shape
# (121637, 3)

And here's a permalink to exactly where the error's occurring:

https://github.com/rapidsai/cuspatial/blob/378082231b66c490a3c4b465c34c884ea50b5a97/python/cuspatial/cuspatial/core/geodataframe.py#L171-L172

Looks like that was just added a few days ago, in #1429, as part of #1426. @mroeschke could you take a look?