Open isVoid opened 3 years ago
github-actions[bot]
commented
3 years ago This issue has been labeled inactive-30d due to no recent activity in the past 30 days. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed. This issue will be labeled inactive-90d if there is no activity in the next 60 days.
vyasr
commented
3 months ago This still fails, but differently now. I end up with ValueError: Merge operands must have same number of join key columns
wence-
commented
3 months ago This still fails, but differently now. I end up with
ValueError: Merge operands must have same number of join key columns
I think the narrow issue is that Series._loc_to_iloc doesn't have a carve-out for desugaring tuple keys, so they are treated like a list-like. This patch fixes the narrow issue:
diff --git a/python/cudf/cudf/core/series.py b/python/cudf/cudf/core/series.py
index c7bc97edd6..f55fd460e4 100644
--- a/python/cudf/cudf/core/series.py
+++ b/python/cudf/cudf/core/series.py
@@ -403,7 +403,9 @@ class _SeriesLocIndexer(_FrameIndexer):
arg = cudf.MultiIndex.from_pandas(arg)
return _indices_from_labels(self._frame, arg)
-
+ elif isinstance(self._frame.index, cudf.MultiIndex) and isinstance(arg, tuple):
+ arg = cudf.MultiIndex.from_tuples([arg])
+ return _indices_from_labels(self._frame, arg)
else:
arg = cudf.core.series.Series(cudf.core.column.as_column(arg))
if arg.dtype in (bool, np.bool_):But doesn't address the broader issue that multiindex labels are not handled well: it breaks as soon as you say gs[[(1, 3), (2, 3)]], say.
Describe the bug When assigning to a row of a series with multiindex, cudf raises exception.
Steps/Code to reproduce bug
Expected behavior
Environment overview (please complete the following information)
Environment details
Click here to see environment details
**git*** commit 7d613f5c4b4a5d75cd8f83383251e4e8b0572bfb (HEAD -> 7290, origin/7290) Author: Michael Wang
Date: Wed Feb 24 16:43:25 2021 -0800
Update Docstrings
**git submodules***
***OS Information***
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=18.04
DISTRIB_CODENAME=bionic
DISTRIB_DESCRIPTION="Ubuntu 18.04.5 LTS"
NAME="Ubuntu"
VERSION="18.04.5 LTS (Bionic Beaver)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 18.04.5 LTS"
VERSION_ID="18.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=bionic
UBUNTU_CODENAME=bionic
Linux dgx06 4.15.0-76-generic #86-Ubuntu SMP Fri Jan 17 17:24:28 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
***GPU Information***
Wed Feb 24 18:33:21 2021
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 440.64.00 Driver Version: 440.64.00 CUDA Version: 10.2 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
|===============================+======================+======================|
| 0 Tesla V100-SXM2... On | 00000000:89:00.0 Off | 0 |
| N/A 34C P0 57W / 300W | 1498MiB / 32510MiB | 0% Default |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: GPU Memory |
| GPU PID Type Process name Usage |
|=============================================================================|
+-----------------------------------------------------------------------------+
***CPU***
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 80
On-line CPU(s) list: 0-79
Thread(s) per core: 2
Core(s) per socket: 20
Socket(s): 2
NUMA node(s): 2
Vendor ID: GenuineIntel
CPU family: 6
Model: 79
Model name: Intel(R) Xeon(R) CPU E5-2698 v4 @ 2.20GHz
Stepping: 1
CPU MHz: 1456.910
CPU max MHz: 3600.0000
CPU min MHz: 1200.0000
BogoMIPS: 4390.16
Virtualization: VT-x
L1d cache: 32K
L1i cache: 32K
L2 cache: 256K
L3 cache: 51200K
NUMA node0 CPU(s): 0-19,40-59
NUMA node1 CPU(s): 20-39,60-79
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts md_clear flush_l1d
***CMake***
/raid/wangm/dev/rapids/compose/etc/conda/cuda_10.2/envs/rapids/bin/cmake
cmake version 3.18.5
CMake suite maintained and supported by Kitware (kitware.com/cmake).
***g++***
/usr/local/bin/g++
g++ (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0
Copyright (C) 2017 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
***nvcc***
/usr/local/bin/nvcc
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2019 NVIDIA Corporation
Built on Wed_Oct_23_19:24:38_PDT_2019
Cuda compilation tools, release 10.2, V10.2.89
***Python***
/raid/wangm/dev/rapids/compose/etc/conda/cuda_10.2/envs/rapids/bin/python
Python 3.7.10
***Environment Variables***
PATH : /raid/wangm/dev/rapids/compose/etc/conda/cuda_10.2/envs/rapids/bin:/raid/wangm/dev/rapids/compose/etc/conda/cuda_10.2/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/cuda-10.2/bin
LD_LIBRARY_PATH : /raid/wangm/dev/rapids/compose/etc/conda/cuda_10.2/envs/rapids/lib:/raid/wangm/dev/rapids/compose/etc/conda/cuda_10.2/lib:/usr/lib/x86_64-linux-gnu:/usr/lib/i386-linux-gnu:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/local/cuda-10.2/lib64:/usr/local/lib:/raid/wangm/dev/rapids/rmm/build/release:/raid/wangm/dev/rapids/cudf/cpp/build/release:/raid/wangm/dev/rapids/cudf/cpp/build/release:/raid/wangm/dev/rapids/cuml/cpp/build/release:/raid/wangm/dev/rapids/cugraph/cpp/build/release:/raid/wangm/dev/rapids/cuspatial/cpp/build/release
NUMBAPRO_NVVM :
NUMBAPRO_LIBDEVICE :
CONDA_PREFIX : /raid/wangm/dev/rapids/compose/etc/conda/cuda_10.2/envs/rapids
PYTHON_PATH :
***conda packages***
/raid/wangm/dev/rapids/compose/etc/conda/cuda_10.2/bin/conda
# packages in environment at /raid/wangm/dev/rapids/compose/etc/conda/cuda_10.2/envs/rapids:
#
# Name Version Build Channel
_libgcc_mutex 0.1 conda_forge conda-forge
_openmp_mutex 4.5 1_gnu conda-forge
abseil-cpp 20200923.3 h9c3ff4c_0 conda-forge
alabaster 0.7.12 py_0 conda-forge
apipkg 1.5 py_0 conda-forge
appdirs 1.4.4 pyh9f0ad1d_0 conda-forge
argon2-cffi 20.1.0 py37h8f50634_2 conda-forge
arrow-cpp 1.0.1 py37hb84ec65_31_cuda conda-forge
arrow-cpp-proc 3.0.0 cuda conda-forge
async_generator 1.10 py_0 conda-forge
attrs 20.3.0 pyhd3deb0d_0 conda-forge
aws-c-cal 0.4.5 h2ff795d_6 conda-forge
aws-c-common 0.4.67 h7f98852_0 conda-forge
aws-c-event-stream 0.2.6 h4285e0c_4 conda-forge
aws-c-io 0.8.3 h3b39b8c_1 conda-forge
aws-checksums 0.1.11 h3b39b8c_1 conda-forge
aws-sdk-cpp 1.8.138 h9e0957a_1 conda-forge
babel 2.9.0 pyhd3deb0d_0 conda-forge
backcall 0.2.0 pyh9f0ad1d_0 conda-forge
backports 1.0 py_2 conda-forge
backports.functools_lru_cache 1.6.1 py_0 conda-forge
black 19.10b0 py37_0 conda-forge
bleach 3.3.0 pyh44b312d_0 conda-forge
bokeh 2.2.3 py37hc8dfbb8_0 conda-forge
boost-cpp 1.75.0 hc6e9bd1_0 conda-forge
brotli 1.0.9 h9c3ff4c_4 conda-forge
brotlipy 0.7.0 py37hb5d75c8_1001 conda-forge
bzip2 1.0.8 h7f98852_4 conda-forge
c-ares 1.17.1 h36c2ea0_0 conda-forge
ca-certificates 2021.1.19 h06a4308_0
certifi 2020.12.5 py37h89c1867_1 conda-forge
cffi 1.14.5 py37hc58025e_0 conda-forge
cfgv 3.2.0 py_0 conda-forge
chardet 4.0.0 py37h89c1867_1 conda-forge
clang 8.0.1 hc9558a2_2 conda-forge
clang-tools 8.0.1 hc9558a2_2 conda-forge
clangxx 8.0.1 2 conda-forge
click 7.1.2 pyh9f0ad1d_0 conda-forge
cloudpickle 1.6.0 py_0 conda-forge
cmake 3.18.5 h1f3970d_0 rapidsai-nightly
cmake-format 0.6.11 pyh9f0ad1d_0 conda-forge
cmake_setuptools 0.1.3 py_0 rapidsai
colorama 0.4.4 pyh9f0ad1d_0 conda-forge
commonmark 0.9.1 py_0 conda-forge
cryptography 3.4.4 py37hf1a17b8_0 conda-forge
cudatoolkit 10.2.89 h6bb024c_0 nvidia
cudnn 7.6.5.32 h01f27c4_1 conda-forge
cupy 8.4.0 py37hca4e673_1 conda-forge
cython 0.29.22 py37hcd2ae1e_0 conda-forge
cytoolz 0.11.0 py37h5e8e339_3 conda-forge
dask 2021.2.0+31.g895c9541 pypi_0 pypi
dask-core 2021.2.0 pyhd8ed1ab_0 conda-forge
decorator 4.4.2 py_0 conda-forge
defusedxml 0.6.0 py_0 conda-forge
distlib 0.3.1 pyh9f0ad1d_0 conda-forge
distributed 2021.2.0+12.gd24d62f1 pypi_0 pypi
dlpack 0.3 he1b5a44_1 conda-forge
docutils 0.16 py37h89c1867_3 conda-forge
double-conversion 3.1.5 he1b5a44_2 conda-forge
editdistance 0.5.3 py37hcd2ae1e_3 conda-forge
entrypoints 0.3 py37hc8dfbb8_1002 conda-forge
execnet 1.8.0 pyh44b312d_0 conda-forge
expat 2.2.10 h9c3ff4c_0 conda-forge
fastavro 1.3.2 py37h5e8e339_0 conda-forge
fastrlock 0.5 py37hcd2ae1e_2 conda-forge
filelock 3.0.12 pyh9f0ad1d_0 conda-forge
flake8 3.8.3 py_1 conda-forge
flatbuffers 1.12.0 he1b5a44_0 conda-forge
freetype 2.10.4 h0708190_1 conda-forge
fsspec 0.8.5 pyhd8ed1ab_0 conda-forge
future 0.18.2 py37h89c1867_3 conda-forge
gflags 2.2.2 he1b5a44_1004 conda-forge
glog 0.4.0 h49b9bf7_3 conda-forge
gmp 6.2.1 h58526e2_0 conda-forge
grpc-cpp 1.35.0 h7919d58_1 conda-forge
heapdict 1.0.1 py_0 conda-forge
hypothesis 6.3.0 pyhd8ed1ab_0 conda-forge
icu 68.1 h58526e2_0 conda-forge
identify 1.5.14 pyh44b312d_0 conda-forge
idna 2.10 pyh9f0ad1d_0 conda-forge
imagesize 1.2.0 py_0 conda-forge
importlib-metadata 3.4.0 py37h89c1867_0 conda-forge
importlib_metadata 3.4.0 hd8ed1ab_0 conda-forge
iniconfig 1.1.1 pyh9f0ad1d_0 conda-forge
ipykernel 5.5.0 py37h888b3d9_1 conda-forge
ipython 7.20.0 py37h888b3d9_2 conda-forge
ipython_genutils 0.2.0 py_1 conda-forge
isort 5.0.7 py37hc8dfbb8_0 conda-forge
jedi 0.18.0 py37h89c1867_2 conda-forge
jinja2 2.11.3 pyh44b312d_0 conda-forge
jpeg 9d h516909a_0 conda-forge
jsonschema 3.2.0 py37hc8dfbb8_1 conda-forge
jupyter_client 6.1.11 pyhd8ed1ab_1 conda-forge
jupyter_core 4.7.1 py37h89c1867_0 conda-forge
jupyterlab_pygments 0.1.2 pyh9f0ad1d_0 conda-forge
krb5 1.17.2 h926e7f8_0 conda-forge
lcms2 2.12 hddcbb42_0 conda-forge
ld_impl_linux-64 2.35.1 hea4e1c9_2 conda-forge
libblas 3.9.0 8_openblas conda-forge
libcblas 3.9.0 8_openblas conda-forge
libcurl 7.71.1 hcdd3856_8 conda-forge
libedit 3.1.20191231 he28a2e2_2 conda-forge
libev 4.33 h516909a_1 conda-forge
libevent 2.1.10 hcdb4288_3 conda-forge
libffi 3.3 h58526e2_2 conda-forge
libgcc-ng 9.3.0 h2828fa1_18 conda-forge
libgfortran-ng 7.5.0 h14aa051_18 conda-forge
libgfortran4 7.5.0 h14aa051_18 conda-forge
libgomp 9.3.0 h2828fa1_18 conda-forge
liblapack 3.9.0 8_openblas conda-forge
libllvm10 10.0.1 he513fc3_3 conda-forge
libllvm8 8.0.1 hc9558a2_0 conda-forge
libnghttp2 1.43.0 h812cca2_0 conda-forge
libopenblas 0.3.12 pthreads_hb3c22a3_1 conda-forge
libpng 1.6.37 hed695b0_2 conda-forge
libprotobuf 3.15.1 h780b84a_0 conda-forge
libsodium 1.0.18 h516909a_1 conda-forge
libssh2 1.9.0 hab1572f_5 conda-forge
libstdcxx-ng 9.3.0 h6de172a_18 conda-forge
libthrift 0.13.0 hbe8ec66_6 conda-forge
libtiff 4.2.0 hdc55705_0 conda-forge
libutf8proc 2.6.1 h7f98852_0 conda-forge
libuv 1.41.0 h7f98852_0 conda-forge
libwebp-base 1.2.0 h7f98852_0 conda-forge
llvmlite 0.35.0 py37h9d7f4d0_1 conda-forge
locket 0.2.1 py37h06a4308_1
lz4-c 1.9.3 h9c3ff4c_0 conda-forge
markdown 3.3.3 pyh9f0ad1d_0 conda-forge
markupsafe 1.1.1 py37h5e8e339_3 conda-forge
mccabe 0.6.1 py_1 conda-forge
mimesis 4.0.0 pyh9f0ad1d_0 conda-forge
mistune 0.8.4 py37h5e8e339_1003 conda-forge
more-itertools 8.7.0 pyhd8ed1ab_0 conda-forge
msgpack-python 1.0.2 py37h2527ec5_1 conda-forge
mypy 0.782 py_0 conda-forge
mypy_extensions 0.4.3 py37h89c1867_3 conda-forge
nbclient 0.5.2 pyhd8ed1ab_0 conda-forge
nbconvert 6.0.7 py37h89c1867_3 conda-forge
nbformat 5.1.2 pyhd8ed1ab_1 conda-forge
nbsphinx 0.8.1 pyh44b312d_0 conda-forge
nccl 2.8.4.1 h1a5f58c_1 conda-forge
ncurses 6.2 h58526e2_4 conda-forge
nest-asyncio 1.5.1 pyhd3eb1b0_0
nodeenv 1.5.0 pyh9f0ad1d_0 conda-forge
notebook 6.2.0 py37h89c1867_0 conda-forge
numba 0.52.0 py37hdc94413_0 conda-forge
numpy 1.19.5 py37haa41c4c_1 conda-forge
numpydoc 1.1.0 py_1 conda-forge
nvtx 0.2.3 py37h5e8e339_0 conda-forge
olefile 0.46 pyh9f0ad1d_1 conda-forge
openssl 1.1.1j h7f98852_0 conda-forge
orc 1.6.7 heec2584_1 conda-forge
packaging 20.9 pyh44b312d_0 conda-forge
pandas 1.1.5 py37hdc94413_0 conda-forge
pandoc 1.19.2.1 hea2e7c5_1
pandocfilters 1.4.3 py37h06a4308_1
parquet-cpp 1.5.1 1 conda-forge
parso 0.8.1 pyhd8ed1ab_0 conda-forge
partd 1.1.0 py_0 conda-forge
pathspec 0.8.1 pyhd3deb0d_0 conda-forge
pexpect 4.8.0 py37hc8dfbb8_1 conda-forge
pickleshare 0.7.5 py37hc8dfbb8_1002 conda-forge
pillow 8.1.0 py37h4600e1f_2 conda-forge
pip 21.0.1 pyhd8ed1ab_0 conda-forge
pluggy 0.13.1 py37h89c1867_4 conda-forge
pre-commit 2.10.1 py37h89c1867_0 conda-forge
pre_commit 2.10.1 hd8ed1ab_0 conda-forge
prometheus_client 0.9.0 pyhd3deb0d_0 conda-forge
prompt-toolkit 3.0.16 pyha770c72_0 conda-forge
protobuf 3.15.1 py37hcd2ae1e_0 conda-forge
psutil 5.8.0 py37h5e8e339_1 conda-forge
ptvsd 4.3.2 pypi_0 pypi
ptyprocess 0.7.0 pyhd3deb0d_0 conda-forge
py 1.10.0 pyhd3deb0d_0 conda-forge
py-cpuinfo 7.0.0 pyh9f0ad1d_0 conda-forge
pyarrow 1.0.1 py37h3dc597d_31_cuda conda-forge
pycodestyle 2.6.0 pyh9f0ad1d_0 conda-forge
pycparser 2.20 pyh9f0ad1d_2 conda-forge
pyflakes 2.2.0 pyh9f0ad1d_0 conda-forge
pygments 2.8.0 pyhd8ed1ab_0 conda-forge
pynvml 8.0.4 pypi_0 pypi
pyopenssl 20.0.1 pyhd8ed1ab_0 conda-forge
pyorc 0.4.0 pypi_0 pypi
pyparsing 2.4.7 pyh9f0ad1d_0 conda-forge
pyrsistent 0.17.3 py37h5e8e339_2 conda-forge
pysocks 1.7.1 py37h89c1867_3 conda-forge
pytest 6.2.2 py37h89c1867_0 conda-forge
pytest-benchmark 3.2.3 pyh9f0ad1d_0 conda-forge
pytest-forked 1.3.0 pyhd3deb0d_0 conda-forge
pytest-xdist 2.2.1 pyhd8ed1ab_0 conda-forge
python 3.7.10 hffdb5ce_100_cpython conda-forge
python-dateutil 2.8.1 py_0 conda-forge
python_abi 3.7 1_cp37m conda-forge
pytz 2021.1 pyhd8ed1ab_0 conda-forge
pyyaml 5.4.1 py37h5e8e339_0 conda-forge
pyzmq 22.0.3 py37h499b945_0 conda-forge
rapidjson 1.1.0 hf484d3e_1002 conda-forge
re2 2020.11.01 h58526e2_0 conda-forge
readline 8.1 h27cfd23_0
recommonmark 0.7.1 pyhd8ed1ab_0 conda-forge
regex 2020.11.13 py37h5e8e339_1 conda-forge
requests 2.25.1 pyhd3deb0d_0 conda-forge
rhash 1.4.1 h7f98852_0 conda-forge
s2n 0.10.26 h9b69904_0 conda-forge
send2trash 1.5.0 py_0 conda-forge
setuptools 52.0.0 py37h06a4308_0
six 1.15.0 pyh9f0ad1d_0 conda-forge
snappy 1.1.8 he1b5a44_3 conda-forge
snowballstemmer 2.1.0 pyhd8ed1ab_0 conda-forge
sortedcontainers 2.3.0 pyhd8ed1ab_0 conda-forge
spdlog 1.7.0 hc9558a2_2 conda-forge
sphinx 3.5.1 pyhd8ed1ab_0 conda-forge
sphinx-copybutton 0.3.1 pyhd8ed1ab_0 conda-forge
sphinx-markdown-tables 0.0.15 pyhd3deb0d_0 conda-forge
sphinx_rtd_theme 0.5.1 pyhd3deb0d_0 conda-forge
sphinxcontrib-applehelp 1.0.2 py_0 conda-forge
sphinxcontrib-devhelp 1.0.2 py_0 conda-forge
sphinxcontrib-htmlhelp 1.0.3 py_0 conda-forge
sphinxcontrib-jsmath 1.0.1 py_0 conda-forge
sphinxcontrib-qthelp 1.0.3 py_0 conda-forge
sphinxcontrib-serializinghtml 1.1.4 py_0 conda-forge
sphinxcontrib-websupport 1.2.4 pyh9f0ad1d_0 conda-forge
sqlite 3.34.0 h74cdb3f_0 conda-forge
streamz 0.6.2 pyh44b312d_0 conda-forge
tblib 1.7.0 py_0
terminado 0.9.2 py37h89c1867_0 conda-forge
testpath 0.4.4 py_0 conda-forge
tk 8.6.10 hed695b0_1 conda-forge
toml 0.10.2 pyhd8ed1ab_0 conda-forge
toolz 0.11.1 py_0 conda-forge
tornado 6.1 py37h5e8e339_1 conda-forge
traitlets 5.0.5 py_0 conda-forge
typed-ast 1.4.2 py37h5e8e339_0 conda-forge
typing_extensions 3.7.4.3 py_0 conda-forge
urllib3 1.26.3 pyhd8ed1ab_0 conda-forge
virtualenv 20.4.2 py37h89c1867_0 conda-forge
wcwidth 0.2.5 pyh9f0ad1d_2 conda-forge
webencodings 0.5.1 py_1 conda-forge
wheel 0.36.2 pyhd3deb0d_0 conda-forge
xz 5.2.5 h516909a_1 conda-forge
yaml 0.2.5 h516909a_0 conda-forge
zeromq 4.3.4 h9c3ff4c_0 conda-forge
zict 2.0.0 py_0 conda-forge
zipp 3.4.0 py_0 conda-forge
zlib 1.2.11 h516909a_1010 conda-forge
zstd 1.4.8 ha95c52a_1 conda-forge