Closed galipremsagar closed 3 years ago
Describe the bug When we try to do __setitem__ on a Dataframe with a numpy array it is being handled well, but not in the case of a cupy array.
__setitem__
Steps/Code to reproduce bug
>>> import cudf >>> import cupy as cp >>> import numpy as np >>> df = cudf.DataFrame(cp.random.randn(10, 2)) >>> df[cp.random.rand(df.shape[0]) > 0.5] = 1.5 Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/nvme/0/pgali/envs/cudfdev/lib/python3.7/contextlib.py", line 74, in inner return func(*args, **kwds) File "/nvme/0/pgali/envs/cudfdev/lib/python3.7/site-packages/cudf/core/dataframe.py", line 820, in __setitem__ f"__setitem__ on type {type(arg)} is not supported" TypeError: __setitem__ on type <class 'cupy.core.core.ndarray'> is not supported >>> df[np.random.rand(df.shape[0]) > 0.5] = 1.5 >>> df 0 1 0 -0.111322 -0.579361 1 0.594744 -0.828844 2 1.500000 1.500000 3 -0.169765 -1.177498 4 1.500000 1.500000 5 -0.766372 0.926135 6 -2.126321 -0.599888 7 1.089514 0.724857 8 1.500000 1.500000 9 1.028590 -0.307863
Expected behavior
>>> df[cp.random.rand(df.shape[0]) > 0.5] = 1.5 >>> df 0 1 0 -0.111322 -0.579361 1 0.594744 -0.828844 2 1.500000 1.500000 3 -0.169765 -1.177498 4 1.500000 1.500000 5 -0.766372 0.926135 6 -2.126321 -0.599888 7 1.089514 0.724857 8 1.500000 1.500000 9 1.028590 -0.307863
Environment overview (please complete the following information)
Environment details Please run and paste the output of the cudf/print_env.sh script here, to gather any other relevant environment details
cudf/print_env.sh
**git*** commit 621de88c2afe01dee14bda9e06c2e7d7f0d6231b (HEAD -> branch-0.19, upstream/branch-0.19) Author: Conor Hoekstra <36027403+codereport@users.noreply.github.com> Date: Fri Feb 5 23:17:09 2021 -0500 Cleaning up `for` loops with `make_(counting_)transform_iterator` (#6546) Doing some cleanup - using `make_counting_transform_iterator` and `make_transform_iterator` to clean up `for` loops and other code. Making an argument that `make_counting_transform_iterator` should be moved out of `cudf::test::`. Also, will clean up the `f`/`begin` and `op` naming conventions. Depends on: https://github.com/rapidsai/cudf/pull/7306 Authors: - Conor Hoekstra (@codereport) Approvers: - David (@davidwendt) - Jake Hemstad (@jrhemstad) - Mark Harris (@harrism) URL: https://github.com/rapidsai/cudf/pull/6546 **git submodules*** ***OS Information*** DISTRIB_ID=Ubuntu DISTRIB_RELEASE=18.04 DISTRIB_CODENAME=bionic DISTRIB_DESCRIPTION="Ubuntu 18.04.4 LTS" NAME="Ubuntu" VERSION="18.04.4 LTS (Bionic Beaver)" ID=ubuntu ID_LIKE=debian PRETTY_NAME="Ubuntu 18.04.4 LTS" VERSION_ID="18.04" HOME_URL="https://www.ubuntu.com/" SUPPORT_URL="https://help.ubuntu.com/" BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" VERSION_CODENAME=bionic UBUNTU_CODENAME=bionic Linux dt07 4.15.0-76-generic #86-Ubuntu SMP Fri Jan 17 17:24:28 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux ***GPU Information*** Sat Feb 6 10:33:35 2021 +-----------------------------------------------------------------------------+ | NVIDIA-SMI 440.64.00 Driver Version: 440.64.00 CUDA Version: 10.2 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | |===============================+======================+======================| | 0 Tesla T4 On | 00000000:3B:00.0 Off | 0 | | N/A 45C P8 9W / 70W | 0MiB / 15109MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 1 Tesla T4 On | 00000000:5E:00.0 Off | 0 | | N/A 36C P8 9W / 70W | 0MiB / 15109MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 2 Tesla T4 On | 00000000:AF:00.0 Off | 0 | | N/A 32C P8 9W / 70W | 0MiB / 15109MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 3 Tesla T4 On | 00000000:D8:00.0 Off | 0 | | N/A 31C P8 9W / 70W | 0MiB / 15109MiB | 0% Default | +-------------------------------+----------------------+----------------------+ +-----------------------------------------------------------------------------+ | Processes: GPU Memory | | GPU PID Type Process name Usage | |=============================================================================| | No running processes found | +-----------------------------------------------------------------------------+ ***CPU*** Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 64 On-line CPU(s) list: 0-63 Thread(s) per core: 2 Core(s) per socket: 16 Socket(s): 2 NUMA node(s): 2 Vendor ID: GenuineIntel CPU family: 6 Model: 85 Model name: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz Stepping: 4 CPU MHz: 1240.152 BogoMIPS: 4200.00 Virtualization: VT-x L1d cache: 32K L1i cache: 32K L2 cache: 1024K L3 cache: 22528K NUMA node0 CPU(s): 0,2,4,6,8,10,12,14,16,18,20,22,24,26,28,30,32,34,36,38,40,42,44,46,48,50,52,54,56,58,60,62 NUMA node1 CPU(s): 1,3,5,7,9,11,13,15,17,19,21,23,25,27,29,31,33,35,37,39,41,43,45,47,49,51,53,55,57,59,61,63 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti intel_ppin ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb intel_pt avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts pku ospke md_clear flush_l1d ***CMake*** /nvme/0/pgali/envs/cudfdev/bin/cmake cmake version 3.18.5 CMake suite maintained and supported by Kitware (kitware.com/cmake). ***g++*** /usr/bin/g++ g++ (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0 Copyright (C) 2017 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. ***nvcc*** /usr/local/cuda/bin/nvcc nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2019 NVIDIA Corporation Built on Wed_Oct_23_19:24:38_PDT_2019 Cuda compilation tools, release 10.2, V10.2.89 ***Python*** /nvme/0/pgali/envs/cudfdev/bin/python Python 3.7.9 ***Environment Variables*** PATH : /nvme/0/pgali/envs/cudfdev/bin:/usr/share/swift/usr/bin:/home/nfs/pgali/bin:/home/nfs/pgali/.local/bin:/home/nfs/pgali/anaconda3/condabin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/lib/jvm/default-java/bin:/usr/share/sbt-launcher-packaging/bin/sbt-launch.jar/bin:/usr/lib/spark/bin:/usr/lib/spark/sbin:/usr/local/cuda/bin:/nvme/0/pgali/envs/cudfdev/bin LD_LIBRARY_PATH : /usr/local/cuda/lib64::/usr/local/cuda/lib64:/usr/local/cuda/extras/CUPTI/lib64 NUMBAPRO_NVVM : NUMBAPRO_LIBDEVICE : CONDA_PREFIX : /nvme/0/pgali/envs/cudfdev PYTHON_PATH : ***conda packages*** /home/nfs/pgali/anaconda3/condabin/conda # packages in environment at /nvme/0/pgali/envs/cudfdev: # # Name Version Build Channel _libgcc_mutex 0.1 conda_forge conda-forge _openmp_mutex 4.5 1_gnu conda-forge abseil-cpp 20200923.3 h9c3ff4c_0 conda-forge alabaster 0.7.12 py_0 conda-forge apipkg 1.5 py_0 conda-forge appdirs 1.4.4 pyh9f0ad1d_0 conda-forge argon2-cffi 20.1.0 py37h5e8e339_2 conda-forge arrow-cpp 1.0.1 py37hb964363_28_cuda conda-forge arrow-cpp-proc 3.0.0 cuda conda-forge async_generator 1.10 py_0 conda-forge attrs 20.3.0 pyhd3deb0d_0 conda-forge aws-c-cal 0.4.5 hf6e5757_5 conda-forge aws-c-common 0.4.66 h7f98852_0 conda-forge aws-c-event-stream 0.2.6 h512258e_2 conda-forge aws-c-io 0.8.2 hb50cebf_1 conda-forge aws-checksums 0.1.10 hb50cebf_3 conda-forge aws-sdk-cpp 1.8.134 h52c4536_1 conda-forge babel 2.9.0 pyhd3deb0d_0 conda-forge backcall 0.2.0 pyh9f0ad1d_0 conda-forge backports 1.0 py_2 conda-forge backports.functools_lru_cache 1.6.1 py_0 conda-forge black 19.10b0 py_4 conda-forge bleach 3.3.0 pyh44b312d_0 conda-forge bokeh 2.2.3 py37h89c1867_0 conda-forge boost-cpp 1.74.0 hc6e9bd1_2 conda-forge brotli 1.0.9 h9c3ff4c_4 conda-forge brotlipy 0.7.0 py37h5e8e339_1001 conda-forge bzip2 1.0.8 h7f98852_4 conda-forge c-ares 1.17.1 h36c2ea0_0 conda-forge ca-certificates 2020.12.5 ha878542_0 conda-forge certifi 2020.12.5 py37h89c1867_1 conda-forge cffi 1.14.4 py37hc58025e_1 conda-forge cfgv 3.2.0 py_0 conda-forge chardet 4.0.0 py37h89c1867_1 conda-forge clang 8.0.1 hc9558a2_2 conda-forge clang-tools 8.0.1 hc9558a2_2 conda-forge clangxx 8.0.1 2 conda-forge click 7.1.2 pyh9f0ad1d_0 conda-forge cloudpickle 1.6.0 py_0 conda-forge cmake 3.18.5 h1f3970d_0 rapidsai-nightly cmake_setuptools 0.1.3 py_0 rapidsai colorama 0.4.4 pyh9f0ad1d_0 conda-forge commonmark 0.9.1 py_0 conda-forge cryptography 3.3.1 py37h7f0c10b_1 conda-forge cudatoolkit 10.2.89 h6bb024c_0 nvidia cudf 0.19.0a0+83.g7e0437dde1 pypi_0 pypi cudnn 7.6.5.32 h01f27c4_1 conda-forge cupy 8.4.0 py37hca4e673_1 conda-forge cython 0.29.21 py37hcd2ae1e_2 conda-forge cytoolz 0.11.0 py37h5e8e339_3 conda-forge dask 2021.1.1+20.g996b5066 pypi_0 pypi dask-cudf branch-0.19-latest-2.g621de88c2a.dirty pypi_0 pypi decorator 4.4.2 py_0 conda-forge defusedxml 0.6.0 py_0 conda-forge distlib 0.3.1 pyh9f0ad1d_0 conda-forge distributed 2021.1.1+14.ga0d60e7b pypi_0 pypi dlpack 0.3 he1b5a44_1 conda-forge docutils 0.16 py37h89c1867_3 conda-forge double-conversion 3.1.5 he1b5a44_2 conda-forge editdistance 0.5.3 py37hcd2ae1e_3 conda-forge entrypoints 0.3 pyhd8ed1ab_1003 conda-forge execnet 1.8.0 pyh44b312d_0 conda-forge expat 2.2.10 h9c3ff4c_0 conda-forge fastavro 1.3.0 py37h5e8e339_0 conda-forge fastrlock 0.5 py37hcd2ae1e_2 conda-forge filelock 3.0.12 pyh9f0ad1d_0 conda-forge flake8 3.8.3 py_1 conda-forge flatbuffers 1.12.0 h58526e2_0 conda-forge freetype 2.10.4 h0708190_1 conda-forge fsspec 0.8.5 pyhd8ed1ab_0 conda-forge future 0.18.2 py37h89c1867_3 conda-forge gflags 2.2.2 he1b5a44_1004 conda-forge glog 0.4.0 h49b9bf7_3 conda-forge gmp 6.2.1 h58526e2_0 conda-forge grpc-cpp 1.35.0 h146f9af_0 conda-forge heapdict 1.0.1 py_0 conda-forge hypothesis 6.1.1 pyhd8ed1ab_0 conda-forge icu 68.1 h58526e2_0 conda-forge identify 1.5.13 pyh44b312d_0 conda-forge idna 2.10 pyh9f0ad1d_0 conda-forge imagesize 1.2.0 py_0 conda-forge importlib-metadata 3.4.0 py37h89c1867_0 conda-forge importlib_metadata 3.4.0 hd8ed1ab_0 conda-forge iniconfig 1.1.1 pyh9f0ad1d_0 conda-forge ipykernel 5.4.2 py37h888b3d9_0 conda-forge ipython 7.20.0 py37h888b3d9_2 conda-forge ipython_genutils 0.2.0 py_1 conda-forge isort 5.0.7 py37hc8dfbb8_0 conda-forge jedi 0.18.0 py37h89c1867_2 conda-forge jinja2 2.11.3 pyh44b312d_0 conda-forge jpeg 9d h36c2ea0_0 conda-forge jsonschema 3.2.0 py_2 conda-forge jupyter_client 6.1.11 pyhd8ed1ab_1 conda-forge jupyter_core 4.7.1 py37h89c1867_0 conda-forge jupyterlab_pygments 0.1.2 pyh9f0ad1d_0 conda-forge krb5 1.17.2 h926e7f8_0 conda-forge lcms2 2.11 hcbb858e_1 conda-forge ld_impl_linux-64 2.35.1 hea4e1c9_2 conda-forge libblas 3.9.0 8_openblas conda-forge libcblas 3.9.0 8_openblas conda-forge libcurl 7.71.1 hcdd3856_8 conda-forge libedit 3.1.20191231 he28a2e2_2 conda-forge libev 4.33 h516909a_1 conda-forge libevent 2.1.10 hcdb4288_3 conda-forge libffi 3.3 h58526e2_2 conda-forge libgcc-ng 9.3.0 h2828fa1_18 conda-forge libgfortran-ng 9.3.0 hff62375_18 conda-forge libgfortran5 9.3.0 hff62375_18 conda-forge libgomp 9.3.0 h2828fa1_18 conda-forge liblapack 3.9.0 8_openblas conda-forge libllvm10 10.0.1 he513fc3_3 conda-forge libllvm8 8.0.1 hc9558a2_0 conda-forge libnghttp2 1.43.0 h812cca2_0 conda-forge libopenblas 0.3.12 pthreads_h4812303_1 conda-forge libpng 1.6.37 h21135ba_2 conda-forge libprotobuf 3.14.0 h780b84a_0 conda-forge librmm 0.19.0a210205 cuda10.2_g31604e7_13 rapidsai-nightly libsodium 1.0.18 h36c2ea0_1 conda-forge libssh2 1.9.0 hab1572f_5 conda-forge libstdcxx-ng 9.3.0 h6de172a_18 conda-forge libthrift 0.13.0 h5aa387f_6 conda-forge libtiff 4.2.0 hdc55705_0 conda-forge libutf8proc 2.6.1 h7f98852_0 conda-forge libuv 1.40.0 h7f98852_0 conda-forge libwebp-base 1.2.0 h7f98852_0 conda-forge llvmlite 0.35.0 py37h9d7f4d0_1 conda-forge locket 0.2.0 py_2 conda-forge lz4-c 1.9.3 h9c3ff4c_0 conda-forge markdown 3.3.3 pyh9f0ad1d_0 conda-forge markupsafe 1.1.1 py37h5e8e339_3 conda-forge mccabe 0.6.1 py_1 conda-forge mimesis 4.0.0 pyh9f0ad1d_0 conda-forge mistune 0.8.4 py37h5e8e339_1003 conda-forge more-itertools 8.6.0 pyhd8ed1ab_0 conda-forge msgpack-python 1.0.2 py37h2527ec5_1 conda-forge mypy 0.782 py_0 conda-forge mypy_extensions 0.4.3 py37h89c1867_3 conda-forge nbclient 0.5.1 py_0 conda-forge nbconvert 6.0.7 py37h89c1867_3 conda-forge nbformat 5.1.2 pyhd8ed1ab_1 conda-forge nbsphinx 0.8.1 pyh44b312d_0 conda-forge nccl 2.8.3.1 h1a5f58c_0 conda-forge ncurses 6.2 h58526e2_4 conda-forge nest-asyncio 1.4.3 pyhd8ed1ab_0 conda-forge nodeenv 1.5.0 pyh9f0ad1d_0 conda-forge notebook 6.2.0 py37h89c1867_0 conda-forge numba 0.52.0 py37hdc94413_0 conda-forge numpy 1.19.5 py37haa41c4c_1 conda-forge numpydoc 1.1.0 py_1 conda-forge nvtx 0.2.3 py37h5e8e339_0 conda-forge olefile 0.46 pyh9f0ad1d_1 conda-forge openssl 1.1.1i h7f98852_0 conda-forge orc 1.6.7 h7950760_0 conda-forge packaging 20.9 pyh44b312d_0 conda-forge pandas 1.1.5 py37hdc94413_0 conda-forge pandoc 1.19.2 0 conda-forge pandocfilters 1.4.2 py_1 conda-forge parquet-cpp 1.5.1 2 conda-forge parso 0.8.1 pyhd8ed1ab_0 conda-forge partd 1.1.0 py_0 conda-forge pathspec 0.8.1 pyhd3deb0d_0 conda-forge pexpect 4.8.0 pyh9f0ad1d_2 conda-forge pickleshare 0.7.5 py_1003 conda-forge pillow 8.1.0 py37he6b4880_1 conda-forge pip 21.0.1 pyhd8ed1ab_0 conda-forge pluggy 0.13.1 py37h89c1867_4 conda-forge pre-commit 2.10.0 py37h89c1867_0 conda-forge pre_commit 2.10.0 hd8ed1ab_0 conda-forge prometheus_client 0.9.0 pyhd3deb0d_0 conda-forge prompt-toolkit 3.0.14 pyha770c72_0 conda-forge protobuf 3.14.0 py37hcd2ae1e_1 conda-forge psutil 5.8.0 py37h5e8e339_1 conda-forge ptyprocess 0.7.0 pyhd3deb0d_0 conda-forge py 1.10.0 pyhd3deb0d_0 conda-forge py-cpuinfo 7.0.0 pyh9f0ad1d_0 conda-forge pyarrow 1.0.1 py37h9267296_28_cuda conda-forge pycodestyle 2.6.0 pyh9f0ad1d_0 conda-forge pycparser 2.20 pyh9f0ad1d_2 conda-forge pyflakes 2.2.0 pyh9f0ad1d_0 conda-forge pygments 2.7.4 pyhd8ed1ab_0 conda-forge pyopenssl 20.0.1 pyhd8ed1ab_0 conda-forge pyorc 0.4.0 pypi_0 pypi pyparsing 2.4.7 pyh9f0ad1d_0 conda-forge pyrsistent 0.17.3 py37h5e8e339_2 conda-forge pysocks 1.7.1 py37h89c1867_3 conda-forge pytest 6.2.2 py37h89c1867_0 conda-forge pytest-benchmark 3.2.3 pyh9f0ad1d_0 conda-forge pytest-forked 1.2.0 pyh9f0ad1d_0 conda-forge pytest-xdist 2.2.0 pyhd8ed1ab_0 conda-forge python 3.7.9 hffdb5ce_0_cpython conda-forge python-dateutil 2.8.1 py_0 conda-forge python_abi 3.7 1_cp37m conda-forge pytz 2021.1 pyhd8ed1ab_0 conda-forge pyyaml 5.4.1 py37h5e8e339_0 conda-forge pyzmq 22.0.1 py37h499b945_0 conda-forge rapidjson 1.1.0 he1b5a44_1002 conda-forge re2 2020.11.01 h58526e2_0 conda-forge readline 8.0 he28a2e2_2 conda-forge recommonmark 0.7.1 pyhd8ed1ab_0 conda-forge regex 2020.11.13 py37h5e8e339_1 conda-forge requests 2.25.1 pyhd3deb0d_0 conda-forge rhash 1.4.1 h7f98852_0 conda-forge rmm 0.19.0a210205 cuda_10.2_py37_g31604e7_13 rapidsai-nightly s2n 0.10.26 h9b69904_0 conda-forge send2trash 1.5.0 py_0 conda-forge setuptools 49.6.0 py37h89c1867_3 conda-forge six 1.15.0 pyh9f0ad1d_0 conda-forge snappy 1.1.8 he1b5a44_3 conda-forge snowballstemmer 2.1.0 pyhd8ed1ab_0 conda-forge sortedcontainers 2.3.0 pyhd8ed1ab_0 conda-forge spdlog 1.7.0 hc9558a2_2 conda-forge sphinx 3.4.3 pyhd8ed1ab_0 conda-forge sphinx-copybutton 0.3.1 pyhd8ed1ab_0 conda-forge sphinx-markdown-tables 0.0.15 pyhd3deb0d_0 conda-forge sphinx_rtd_theme 0.5.1 pyhd3deb0d_0 conda-forge sphinxcontrib-applehelp 1.0.2 py_0 conda-forge sphinxcontrib-devhelp 1.0.2 py_0 conda-forge sphinxcontrib-htmlhelp 1.0.3 py_0 conda-forge sphinxcontrib-jsmath 1.0.1 py_0 conda-forge sphinxcontrib-qthelp 1.0.3 py_0 conda-forge sphinxcontrib-serializinghtml 1.1.4 py_0 conda-forge sphinxcontrib-websupport 1.2.4 pyh9f0ad1d_0 conda-forge sqlite 3.34.0 h74cdb3f_0 conda-forge streamz 0.6.2 pyh44b312d_0 conda-forge tblib 1.6.0 py_0 conda-forge terminado 0.9.2 py37h89c1867_0 conda-forge testpath 0.4.4 py_0 conda-forge tk 8.6.10 h21135ba_1 conda-forge toml 0.10.2 pyhd8ed1ab_0 conda-forge toolz 0.11.1 py_0 conda-forge tornado 6.1 py37h5e8e339_1 conda-forge traitlets 5.0.5 py_0 conda-forge typed-ast 1.4.2 py37h5e8e339_0 conda-forge typing_extensions 3.7.4.3 py_0 conda-forge urllib3 1.26.3 pyhd8ed1ab_0 conda-forge virtualenv 20.4.2 py37h89c1867_0 conda-forge wcwidth 0.2.5 pyh9f0ad1d_2 conda-forge webencodings 0.5.1 py_1 conda-forge wheel 0.36.2 pyhd3deb0d_0 conda-forge xz 5.2.5 h516909a_1 conda-forge yaml 0.2.5 h516909a_0 conda-forge zeromq 4.3.4 h9c3ff4c_0 conda-forge zict 2.0.0 py_0 conda-forge zipp 3.4.0 py_0 conda-forge zlib 1.2.11 h516909a_1010 conda-forge zstd 1.4.8 ha95c52a_1 conda-forge
Additional context Add any other context about the problem here.
Closed by #7340
galipremsagar
commented
3 years ago galipremsagar
commented
3 years ago
Describe the bug When we try to do
__setitem__on a Dataframe with a numpy array it is being handled well, but not in the case of a cupy array.Steps/Code to reproduce bug
Expected behavior
Environment overview (please complete the following information)
Environment details Please run and paste the output of the
cudf/print_env.shscript here, to gather any other relevant environment detailsClick here to see environment details
**git*** commit 621de88c2afe01dee14bda9e06c2e7d7f0d6231b (HEAD -> branch-0.19, upstream/branch-0.19) Author: Conor Hoekstra <36027403+codereport@users.noreply.github.com> Date: Fri Feb 5 23:17:09 2021 -0500 Cleaning up `for` loops with `make_(counting_)transform_iterator` (#6546) Doing some cleanup - using `make_counting_transform_iterator` and `make_transform_iterator` to clean up `for` loops and other code. Making an argument that `make_counting_transform_iterator` should be moved out of `cudf::test::`. Also, will clean up the `f`/`begin` and `op` naming conventions. Depends on: https://github.com/rapidsai/cudf/pull/7306 Authors: - Conor Hoekstra (@codereport) Approvers: - David (@davidwendt) - Jake Hemstad (@jrhemstad) - Mark Harris (@harrism) URL: https://github.com/rapidsai/cudf/pull/6546 **git submodules*** ***OS Information*** DISTRIB_ID=Ubuntu DISTRIB_RELEASE=18.04 DISTRIB_CODENAME=bionic DISTRIB_DESCRIPTION="Ubuntu 18.04.4 LTS" NAME="Ubuntu" VERSION="18.04.4 LTS (Bionic Beaver)" ID=ubuntu ID_LIKE=debian PRETTY_NAME="Ubuntu 18.04.4 LTS" VERSION_ID="18.04" HOME_URL="https://www.ubuntu.com/" SUPPORT_URL="https://help.ubuntu.com/" BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" VERSION_CODENAME=bionic UBUNTU_CODENAME=bionic Linux dt07 4.15.0-76-generic #86-Ubuntu SMP Fri Jan 17 17:24:28 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux ***GPU Information*** Sat Feb 6 10:33:35 2021 +-----------------------------------------------------------------------------+ | NVIDIA-SMI 440.64.00 Driver Version: 440.64.00 CUDA Version: 10.2 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | |===============================+======================+======================| | 0 Tesla T4 On | 00000000:3B:00.0 Off | 0 | | N/A 45C P8 9W / 70W | 0MiB / 15109MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 1 Tesla T4 On | 00000000:5E:00.0 Off | 0 | | N/A 36C P8 9W / 70W | 0MiB / 15109MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 2 Tesla T4 On | 00000000:AF:00.0 Off | 0 | | N/A 32C P8 9W / 70W | 0MiB / 15109MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 3 Tesla T4 On | 00000000:D8:00.0 Off | 0 | | N/A 31C P8 9W / 70W | 0MiB / 15109MiB | 0% Default | +-------------------------------+----------------------+----------------------+ +-----------------------------------------------------------------------------+ | Processes: GPU Memory | | GPU PID Type Process name Usage | |=============================================================================| | No running processes found | +-----------------------------------------------------------------------------+ ***CPU*** Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 64 On-line CPU(s) list: 0-63 Thread(s) per core: 2 Core(s) per socket: 16 Socket(s): 2 NUMA node(s): 2 Vendor ID: GenuineIntel CPU family: 6 Model: 85 Model name: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz Stepping: 4 CPU MHz: 1240.152 BogoMIPS: 4200.00 Virtualization: VT-x L1d cache: 32K L1i cache: 32K L2 cache: 1024K L3 cache: 22528K NUMA node0 CPU(s): 0,2,4,6,8,10,12,14,16,18,20,22,24,26,28,30,32,34,36,38,40,42,44,46,48,50,52,54,56,58,60,62 NUMA node1 CPU(s): 1,3,5,7,9,11,13,15,17,19,21,23,25,27,29,31,33,35,37,39,41,43,45,47,49,51,53,55,57,59,61,63 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti intel_ppin ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb intel_pt avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts pku ospke md_clear flush_l1d ***CMake*** /nvme/0/pgali/envs/cudfdev/bin/cmake cmake version 3.18.5 CMake suite maintained and supported by Kitware (kitware.com/cmake). ***g++*** /usr/bin/g++ g++ (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0 Copyright (C) 2017 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. ***nvcc*** /usr/local/cuda/bin/nvcc nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2019 NVIDIA Corporation Built on Wed_Oct_23_19:24:38_PDT_2019 Cuda compilation tools, release 10.2, V10.2.89 ***Python*** /nvme/0/pgali/envs/cudfdev/bin/python Python 3.7.9 ***Environment Variables*** PATH : /nvme/0/pgali/envs/cudfdev/bin:/usr/share/swift/usr/bin:/home/nfs/pgali/bin:/home/nfs/pgali/.local/bin:/home/nfs/pgali/anaconda3/condabin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/lib/jvm/default-java/bin:/usr/share/sbt-launcher-packaging/bin/sbt-launch.jar/bin:/usr/lib/spark/bin:/usr/lib/spark/sbin:/usr/local/cuda/bin:/nvme/0/pgali/envs/cudfdev/bin LD_LIBRARY_PATH : /usr/local/cuda/lib64::/usr/local/cuda/lib64:/usr/local/cuda/extras/CUPTI/lib64 NUMBAPRO_NVVM : NUMBAPRO_LIBDEVICE : CONDA_PREFIX : /nvme/0/pgali/envs/cudfdev PYTHON_PATH : ***conda packages*** /home/nfs/pgali/anaconda3/condabin/conda # packages in environment at /nvme/0/pgali/envs/cudfdev: # # Name Version Build Channel _libgcc_mutex 0.1 conda_forge conda-forge _openmp_mutex 4.5 1_gnu conda-forge abseil-cpp 20200923.3 h9c3ff4c_0 conda-forge alabaster 0.7.12 py_0 conda-forge apipkg 1.5 py_0 conda-forge appdirs 1.4.4 pyh9f0ad1d_0 conda-forge argon2-cffi 20.1.0 py37h5e8e339_2 conda-forge arrow-cpp 1.0.1 py37hb964363_28_cuda conda-forge arrow-cpp-proc 3.0.0 cuda conda-forge async_generator 1.10 py_0 conda-forge attrs 20.3.0 pyhd3deb0d_0 conda-forge aws-c-cal 0.4.5 hf6e5757_5 conda-forge aws-c-common 0.4.66 h7f98852_0 conda-forge aws-c-event-stream 0.2.6 h512258e_2 conda-forge aws-c-io 0.8.2 hb50cebf_1 conda-forge aws-checksums 0.1.10 hb50cebf_3 conda-forge aws-sdk-cpp 1.8.134 h52c4536_1 conda-forge babel 2.9.0 pyhd3deb0d_0 conda-forge backcall 0.2.0 pyh9f0ad1d_0 conda-forge backports 1.0 py_2 conda-forge backports.functools_lru_cache 1.6.1 py_0 conda-forge black 19.10b0 py_4 conda-forge bleach 3.3.0 pyh44b312d_0 conda-forge bokeh 2.2.3 py37h89c1867_0 conda-forge boost-cpp 1.74.0 hc6e9bd1_2 conda-forge brotli 1.0.9 h9c3ff4c_4 conda-forge brotlipy 0.7.0 py37h5e8e339_1001 conda-forge bzip2 1.0.8 h7f98852_4 conda-forge c-ares 1.17.1 h36c2ea0_0 conda-forge ca-certificates 2020.12.5 ha878542_0 conda-forge certifi 2020.12.5 py37h89c1867_1 conda-forge cffi 1.14.4 py37hc58025e_1 conda-forge cfgv 3.2.0 py_0 conda-forge chardet 4.0.0 py37h89c1867_1 conda-forge clang 8.0.1 hc9558a2_2 conda-forge clang-tools 8.0.1 hc9558a2_2 conda-forge clangxx 8.0.1 2 conda-forge click 7.1.2 pyh9f0ad1d_0 conda-forge cloudpickle 1.6.0 py_0 conda-forge cmake 3.18.5 h1f3970d_0 rapidsai-nightly cmake_setuptools 0.1.3 py_0 rapidsai colorama 0.4.4 pyh9f0ad1d_0 conda-forge commonmark 0.9.1 py_0 conda-forge cryptography 3.3.1 py37h7f0c10b_1 conda-forge cudatoolkit 10.2.89 h6bb024c_0 nvidia cudf 0.19.0a0+83.g7e0437dde1 pypi_0 pypi cudnn 7.6.5.32 h01f27c4_1 conda-forge cupy 8.4.0 py37hca4e673_1 conda-forge cython 0.29.21 py37hcd2ae1e_2 conda-forge cytoolz 0.11.0 py37h5e8e339_3 conda-forge dask 2021.1.1+20.g996b5066 pypi_0 pypi dask-cudf branch-0.19-latest-2.g621de88c2a.dirty pypi_0 pypi decorator 4.4.2 py_0 conda-forge defusedxml 0.6.0 py_0 conda-forge distlib 0.3.1 pyh9f0ad1d_0 conda-forge distributed 2021.1.1+14.ga0d60e7b pypi_0 pypi dlpack 0.3 he1b5a44_1 conda-forge docutils 0.16 py37h89c1867_3 conda-forge double-conversion 3.1.5 he1b5a44_2 conda-forge editdistance 0.5.3 py37hcd2ae1e_3 conda-forge entrypoints 0.3 pyhd8ed1ab_1003 conda-forge execnet 1.8.0 pyh44b312d_0 conda-forge expat 2.2.10 h9c3ff4c_0 conda-forge fastavro 1.3.0 py37h5e8e339_0 conda-forge fastrlock 0.5 py37hcd2ae1e_2 conda-forge filelock 3.0.12 pyh9f0ad1d_0 conda-forge flake8 3.8.3 py_1 conda-forge flatbuffers 1.12.0 h58526e2_0 conda-forge freetype 2.10.4 h0708190_1 conda-forge fsspec 0.8.5 pyhd8ed1ab_0 conda-forge future 0.18.2 py37h89c1867_3 conda-forge gflags 2.2.2 he1b5a44_1004 conda-forge glog 0.4.0 h49b9bf7_3 conda-forge gmp 6.2.1 h58526e2_0 conda-forge grpc-cpp 1.35.0 h146f9af_0 conda-forge heapdict 1.0.1 py_0 conda-forge hypothesis 6.1.1 pyhd8ed1ab_0 conda-forge icu 68.1 h58526e2_0 conda-forge identify 1.5.13 pyh44b312d_0 conda-forge idna 2.10 pyh9f0ad1d_0 conda-forge imagesize 1.2.0 py_0 conda-forge importlib-metadata 3.4.0 py37h89c1867_0 conda-forge importlib_metadata 3.4.0 hd8ed1ab_0 conda-forge iniconfig 1.1.1 pyh9f0ad1d_0 conda-forge ipykernel 5.4.2 py37h888b3d9_0 conda-forge ipython 7.20.0 py37h888b3d9_2 conda-forge ipython_genutils 0.2.0 py_1 conda-forge isort 5.0.7 py37hc8dfbb8_0 conda-forge jedi 0.18.0 py37h89c1867_2 conda-forge jinja2 2.11.3 pyh44b312d_0 conda-forge jpeg 9d h36c2ea0_0 conda-forge jsonschema 3.2.0 py_2 conda-forge jupyter_client 6.1.11 pyhd8ed1ab_1 conda-forge jupyter_core 4.7.1 py37h89c1867_0 conda-forge jupyterlab_pygments 0.1.2 pyh9f0ad1d_0 conda-forge krb5 1.17.2 h926e7f8_0 conda-forge lcms2 2.11 hcbb858e_1 conda-forge ld_impl_linux-64 2.35.1 hea4e1c9_2 conda-forge libblas 3.9.0 8_openblas conda-forge libcblas 3.9.0 8_openblas conda-forge libcurl 7.71.1 hcdd3856_8 conda-forge libedit 3.1.20191231 he28a2e2_2 conda-forge libev 4.33 h516909a_1 conda-forge libevent 2.1.10 hcdb4288_3 conda-forge libffi 3.3 h58526e2_2 conda-forge libgcc-ng 9.3.0 h2828fa1_18 conda-forge libgfortran-ng 9.3.0 hff62375_18 conda-forge libgfortran5 9.3.0 hff62375_18 conda-forge libgomp 9.3.0 h2828fa1_18 conda-forge liblapack 3.9.0 8_openblas conda-forge libllvm10 10.0.1 he513fc3_3 conda-forge libllvm8 8.0.1 hc9558a2_0 conda-forge libnghttp2 1.43.0 h812cca2_0 conda-forge libopenblas 0.3.12 pthreads_h4812303_1 conda-forge libpng 1.6.37 h21135ba_2 conda-forge libprotobuf 3.14.0 h780b84a_0 conda-forge librmm 0.19.0a210205 cuda10.2_g31604e7_13 rapidsai-nightly libsodium 1.0.18 h36c2ea0_1 conda-forge libssh2 1.9.0 hab1572f_5 conda-forge libstdcxx-ng 9.3.0 h6de172a_18 conda-forge libthrift 0.13.0 h5aa387f_6 conda-forge libtiff 4.2.0 hdc55705_0 conda-forge libutf8proc 2.6.1 h7f98852_0 conda-forge libuv 1.40.0 h7f98852_0 conda-forge libwebp-base 1.2.0 h7f98852_0 conda-forge llvmlite 0.35.0 py37h9d7f4d0_1 conda-forge locket 0.2.0 py_2 conda-forge lz4-c 1.9.3 h9c3ff4c_0 conda-forge markdown 3.3.3 pyh9f0ad1d_0 conda-forge markupsafe 1.1.1 py37h5e8e339_3 conda-forge mccabe 0.6.1 py_1 conda-forge mimesis 4.0.0 pyh9f0ad1d_0 conda-forge mistune 0.8.4 py37h5e8e339_1003 conda-forge more-itertools 8.6.0 pyhd8ed1ab_0 conda-forge msgpack-python 1.0.2 py37h2527ec5_1 conda-forge mypy 0.782 py_0 conda-forge mypy_extensions 0.4.3 py37h89c1867_3 conda-forge nbclient 0.5.1 py_0 conda-forge nbconvert 6.0.7 py37h89c1867_3 conda-forge nbformat 5.1.2 pyhd8ed1ab_1 conda-forge nbsphinx 0.8.1 pyh44b312d_0 conda-forge nccl 2.8.3.1 h1a5f58c_0 conda-forge ncurses 6.2 h58526e2_4 conda-forge nest-asyncio 1.4.3 pyhd8ed1ab_0 conda-forge nodeenv 1.5.0 pyh9f0ad1d_0 conda-forge notebook 6.2.0 py37h89c1867_0 conda-forge numba 0.52.0 py37hdc94413_0 conda-forge numpy 1.19.5 py37haa41c4c_1 conda-forge numpydoc 1.1.0 py_1 conda-forge nvtx 0.2.3 py37h5e8e339_0 conda-forge olefile 0.46 pyh9f0ad1d_1 conda-forge openssl 1.1.1i h7f98852_0 conda-forge orc 1.6.7 h7950760_0 conda-forge packaging 20.9 pyh44b312d_0 conda-forge pandas 1.1.5 py37hdc94413_0 conda-forge pandoc 1.19.2 0 conda-forge pandocfilters 1.4.2 py_1 conda-forge parquet-cpp 1.5.1 2 conda-forge parso 0.8.1 pyhd8ed1ab_0 conda-forge partd 1.1.0 py_0 conda-forge pathspec 0.8.1 pyhd3deb0d_0 conda-forge pexpect 4.8.0 pyh9f0ad1d_2 conda-forge pickleshare 0.7.5 py_1003 conda-forge pillow 8.1.0 py37he6b4880_1 conda-forge pip 21.0.1 pyhd8ed1ab_0 conda-forge pluggy 0.13.1 py37h89c1867_4 conda-forge pre-commit 2.10.0 py37h89c1867_0 conda-forge pre_commit 2.10.0 hd8ed1ab_0 conda-forge prometheus_client 0.9.0 pyhd3deb0d_0 conda-forge prompt-toolkit 3.0.14 pyha770c72_0 conda-forge protobuf 3.14.0 py37hcd2ae1e_1 conda-forge psutil 5.8.0 py37h5e8e339_1 conda-forge ptyprocess 0.7.0 pyhd3deb0d_0 conda-forge py 1.10.0 pyhd3deb0d_0 conda-forge py-cpuinfo 7.0.0 pyh9f0ad1d_0 conda-forge pyarrow 1.0.1 py37h9267296_28_cuda conda-forge pycodestyle 2.6.0 pyh9f0ad1d_0 conda-forge pycparser 2.20 pyh9f0ad1d_2 conda-forge pyflakes 2.2.0 pyh9f0ad1d_0 conda-forge pygments 2.7.4 pyhd8ed1ab_0 conda-forge pyopenssl 20.0.1 pyhd8ed1ab_0 conda-forge pyorc 0.4.0 pypi_0 pypi pyparsing 2.4.7 pyh9f0ad1d_0 conda-forge pyrsistent 0.17.3 py37h5e8e339_2 conda-forge pysocks 1.7.1 py37h89c1867_3 conda-forge pytest 6.2.2 py37h89c1867_0 conda-forge pytest-benchmark 3.2.3 pyh9f0ad1d_0 conda-forge pytest-forked 1.2.0 pyh9f0ad1d_0 conda-forge pytest-xdist 2.2.0 pyhd8ed1ab_0 conda-forge python 3.7.9 hffdb5ce_0_cpython conda-forge python-dateutil 2.8.1 py_0 conda-forge python_abi 3.7 1_cp37m conda-forge pytz 2021.1 pyhd8ed1ab_0 conda-forge pyyaml 5.4.1 py37h5e8e339_0 conda-forge pyzmq 22.0.1 py37h499b945_0 conda-forge rapidjson 1.1.0 he1b5a44_1002 conda-forge re2 2020.11.01 h58526e2_0 conda-forge readline 8.0 he28a2e2_2 conda-forge recommonmark 0.7.1 pyhd8ed1ab_0 conda-forge regex 2020.11.13 py37h5e8e339_1 conda-forge requests 2.25.1 pyhd3deb0d_0 conda-forge rhash 1.4.1 h7f98852_0 conda-forge rmm 0.19.0a210205 cuda_10.2_py37_g31604e7_13 rapidsai-nightly s2n 0.10.26 h9b69904_0 conda-forge send2trash 1.5.0 py_0 conda-forge setuptools 49.6.0 py37h89c1867_3 conda-forge six 1.15.0 pyh9f0ad1d_0 conda-forge snappy 1.1.8 he1b5a44_3 conda-forge snowballstemmer 2.1.0 pyhd8ed1ab_0 conda-forge sortedcontainers 2.3.0 pyhd8ed1ab_0 conda-forge spdlog 1.7.0 hc9558a2_2 conda-forge sphinx 3.4.3 pyhd8ed1ab_0 conda-forge sphinx-copybutton 0.3.1 pyhd8ed1ab_0 conda-forge sphinx-markdown-tables 0.0.15 pyhd3deb0d_0 conda-forge sphinx_rtd_theme 0.5.1 pyhd3deb0d_0 conda-forge sphinxcontrib-applehelp 1.0.2 py_0 conda-forge sphinxcontrib-devhelp 1.0.2 py_0 conda-forge sphinxcontrib-htmlhelp 1.0.3 py_0 conda-forge sphinxcontrib-jsmath 1.0.1 py_0 conda-forge sphinxcontrib-qthelp 1.0.3 py_0 conda-forge sphinxcontrib-serializinghtml 1.1.4 py_0 conda-forge sphinxcontrib-websupport 1.2.4 pyh9f0ad1d_0 conda-forge sqlite 3.34.0 h74cdb3f_0 conda-forge streamz 0.6.2 pyh44b312d_0 conda-forge tblib 1.6.0 py_0 conda-forge terminado 0.9.2 py37h89c1867_0 conda-forge testpath 0.4.4 py_0 conda-forge tk 8.6.10 h21135ba_1 conda-forge toml 0.10.2 pyhd8ed1ab_0 conda-forge toolz 0.11.1 py_0 conda-forge tornado 6.1 py37h5e8e339_1 conda-forge traitlets 5.0.5 py_0 conda-forge typed-ast 1.4.2 py37h5e8e339_0 conda-forge typing_extensions 3.7.4.3 py_0 conda-forge urllib3 1.26.3 pyhd8ed1ab_0 conda-forge virtualenv 20.4.2 py37h89c1867_0 conda-forge wcwidth 0.2.5 pyh9f0ad1d_2 conda-forge webencodings 0.5.1 py_1 conda-forge wheel 0.36.2 pyhd3deb0d_0 conda-forge xz 5.2.5 h516909a_1 conda-forge yaml 0.2.5 h516909a_0 conda-forge zeromq 4.3.4 h9c3ff4c_0 conda-forge zict 2.0.0 py_0 conda-forge zipp 3.4.0 py_0 conda-forge zlib 1.2.11 h516909a_1010 conda-forge zstd 1.4.8 ha95c52a_1 conda-forgeAdditional context Add any other context about the problem here.