rgsl888prabhu
commented
4 years ago @okdimok the doc should have been cudf.DataFrame.from_pandas, thank you for raising issue.
Closed okdimok closed 4 years ago
rgsl888prabhu
commented
4 years ago @okdimok the doc should have been cudf.DataFrame.from_pandas, thank you for raising issue.
Bug description In the latest version of cufd.from_pandas documentation, it is stated that this function has the second parameter
nan_as_null = True. However, in reality it does not.Steps/Code to reproduce bug
The last line produces error
Expected behavior I would expect this flag to be present in this function, and also be able to control NaN → null conversion during df creation from python dict.
Environment overview (please complete the following information)
docker pull rapidsai/rapidsai-nightly:0.14-cuda10.1-base-ubuntu18.04-py3.7docker run -p 8888:8888 rapidsai/rapidsai-nightly:0.14-cuda10.1-base-ubuntu18.04-py3.7Environment details
Click here to see environment details
**git*** Not inside a git repository ***OS Information*** DISTRIB_ID=Ubuntu DISTRIB_RELEASE=18.04 DISTRIB_CODENAME=bionic DISTRIB_DESCRIPTION="Ubuntu 18.04.3 LTS" NAME="Ubuntu" VERSION="18.04.3 LTS (Bionic Beaver)" ID=ubuntu ID_LIKE=debian PRETTY_NAME="Ubuntu 18.04.3 LTS" VERSION_ID="18.04" HOME_URL="https://www.ubuntu.com/" SUPPORT_URL="https://help.ubuntu.com/" BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" VERSION_CODENAME=bionic UBUNTU_CODENAME=bionic Linux e1819dbd408c 5.3.0-45-generic #37~18.04.1-Ubuntu SMP Fri Mar 27 15:58:10 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux ***GPU Information*** Fri May 15 13:37:23 2020 +-----------------------------------------------------------------------------+ | NVIDIA-SMI 440.64.00 Driver Version: 440.64.00 CUDA Version: 10.2 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | |===============================+======================+======================| | 0 Quadro P6000 On | 00000000:03:00.0 Off | Off | | 26% 30C P8 9W / 250W | 144MiB / 24447MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 1 Quadro GV100 On | 00000000:04:00.0 Off | Off | | 29% 34C P2 23W / 250W | 0MiB / 32508MiB | 0% Default | +-------------------------------+----------------------+----------------------+ +-----------------------------------------------------------------------------+ | Processes: GPU Memory | | GPU PID Type Process name Usage | |=============================================================================| +-----------------------------------------------------------------------------+ ***CPU*** Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 4 On-line CPU(s) list: 0-3 Thread(s) per core: 1 Core(s) per socket: 4 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 45 Model name: Intel(R) Xeon(R) CPU E5-2603 0 @ 1.80GHz Stepping: 7 CPU MHz: 1786.567 CPU max MHz: 1800.0000 CPU min MHz: 1200.0000 BogoMIPS: 3613.14 Virtualization: VT-x L1d cache: 32K L1i cache: 32K L2 cache: 256K L3 cache: 10240K NUMA node0 CPU(s): 0-3 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm epb pti ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid xsaveopt dtherm arat pln pts md_clear flush_l1d ***CMake*** ***g++*** ***nvcc*** ***Python*** /opt/conda/envs/rapids/bin/python Python 3.7.6 ***Environment Variables*** PATH : /opt/conda/envs/rapids/bin:/opt/conda/condabin:/root/.vscode-server/bin/5763d909d5f12fe19f215cbfdd29a91c0fa9208a/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/conda/bin:/conda/bin LD_LIBRARY_PATH : /opt/conda/envs/rapids/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/local/cuda/lib64:/usr/local/lib NUMBAPRO_NVVM : NUMBAPRO_LIBDEVICE : CONDA_PREFIX : /opt/conda/envs/rapids PYTHON_PATH : ***conda packages*** /opt/conda/condabin/conda # packages in environment at /opt/conda/envs/rapids: # # Name Version Build Channel _libgcc_mutex 0.1 conda_forge conda-forge _openmp_mutex 4.5 1_llvm conda-forge aiohttp 3.6.2 py37h516909a_0 conda-forge appdirs 1.4.3 py_1 conda-forge arrow-cpp 0.15.0 py37h090bef1_2 conda-forge async-timeout 3.0.1 py_1000 conda-forge attrs 19.3.0 py_0 conda-forge backcall 0.1.0 py_0 conda-forge blas 2.14 openblas conda-forge bleach 3.1.5 pyh9f0ad1d_0 conda-forge bokeh 1.4.0 py37hc8dfbb8_1 conda-forge boost 1.70.0 py37h9de70de_1 conda-forge boost-cpp 1.70.0 h8e57a91_2 conda-forge brotli 1.0.7 he1b5a44_1001 conda-forge brotlipy 0.7.0 py37h8f50634_1000 conda-forge bzip2 1.0.8 h516909a_2 conda-forge c-ares 1.15.0 h516909a_1001 conda-forge ca-certificates 2020.4.5.1 hecc5488_0 conda-forge cairo 1.16.0 hcf35c78_1003 conda-forge certifi 2020.4.5.1 py37hc8dfbb8_0 conda-forge cffi 1.14.0 py37hd463f26_0 conda-forge cfitsio 3.470 h3eac812_5 conda-forge chardet 3.0.4 py37hc8dfbb8_1006 conda-forge click 7.1.2 pyh9f0ad1d_0 conda-forge click-plugins 1.1.1 py_0 conda-forge cligj 0.5.0 py_0 conda-forge cloudpickle 1.4.1 py_0 conda-forge colorcet 2.0.1 py_0 conda-forge cryptography 2.9.2 py37hb09aad4_0 conda-forge cudatoolkit 10.1.243 h6bb024c_0 nvidia cudf 0.14.0a200515 py37_4705 rapidsai-nightly cudnn 7.6.0 cuda10.1_0 nvidia cugraph 0.14.0a200514 py37_551 rapidsai-nightly cuml 0.14.0a200514 cuda10.1_py37_2655 rapidsai-nightly cupy 7.4.0 py37h0632833_2 conda-forge curl 7.69.1 h33f0ec9_0 conda-forge cusignal 0.14.0a200515 py37_338 rapidsai-nightly cuspatial 0.14.0a200514 py37_513 rapidsai-nightly cuxfilter 0.14.0a200514 py37_88 rapidsai-nightly cycler 0.10.0 py_2 conda-forge cytoolz 0.10.1 py37h516909a_0 conda-forge dask 2.16.0 py_0 conda-forge dask-core 2.16.0 py_0 conda-forge dask-cuda 0.14.0a200515 py37_102 rapidsai-nightly dask-cudf 0.14.0a200515 py37_4705 rapidsai-nightly dask-xgboost 0.2.0.dev28 cuda10.1py36_0 rapidsai datashader 0.10.0 py_0 conda-forge datashape 0.5.4 py_1 conda-forge decorator 4.4.2 py_0 conda-forge defusedxml 0.6.0 py_0 conda-forge distributed 2.16.0 py37hc8dfbb8_0 conda-forge dlpack 0.2 he1b5a44_1 conda-forge double-conversion 3.1.5 he1b5a44_2 conda-forge entrypoints 0.3 py37hc8dfbb8_1001 conda-forge expat 2.2.9 he1b5a44_2 conda-forge fastavro 0.23.3 py37h8f50634_0 conda-forge fastrlock 0.4 py37h3340039_1001 conda-forge fiona 1.8.9.post2 py37hdff7cfa_0 conda-forge fontconfig 2.13.1 h86ecdb6_1001 conda-forge freetype 2.10.2 he06d7ca_0 conda-forge freexl 1.0.5 h14c3975_1002 conda-forge fsspec 0.7.3 py_0 conda-forge gdal 2.4.4 py37h5f563d9_0 conda-forge geopandas 0.7.0 py_1 conda-forge geos 3.8.0 he1b5a44_1 conda-forge geotiff 1.5.1 h38872f0_8 conda-forge gettext 0.19.8.1 hc5be6a0_1002 conda-forge gflags 2.2.2 he1b5a44_1002 conda-forge giflib 5.1.7 h516909a_1 conda-forge git 2.26.2 pl526h5e3e691_0 conda-forge glib 2.64.2 h6f030ca_0 conda-forge glog 0.4.0 h49b9bf7_3 conda-forge grpc-cpp 1.23.0 h18db393_0 conda-forge hdf4 4.2.13 hf30be14_1003 conda-forge hdf5 1.10.5 nompi_h3c11f04_1104 conda-forge heapdict 1.0.1 py_0 conda-forge icu 64.2 he1b5a44_1 conda-forge idna 2.9 py_1 conda-forge imagecodecs-lite 2019.12.3 py37h8f50634_0 conda-forge imageio 2.8.0 py_0 conda-forge importlib-metadata 1.6.0 py37hc8dfbb8_0 conda-forge importlib_metadata 1.6.0 0 conda-forge ipykernel 5.2.1 py37h43977f1_0 conda-forge ipython 7.14.0 py37hc8dfbb8_0 conda-forge ipython_genutils 0.2.0 py_1 conda-forge jedi 0.17.0 py37hc8dfbb8_0 conda-forge jinja2 2.11.2 pyh9f0ad1d_0 conda-forge joblib 0.14.1 py_0 conda-forge jpeg 9c h14c3975_1001 conda-forge json-c 0.13.1 hbfbb72e_1002 conda-forge jsonschema 3.2.0 py37hc8dfbb8_1 conda-forge jupyter-server-proxy 1.4.0 py_0 conda-forge jupyter_client 6.1.3 py_0 conda-forge jupyter_core 4.6.3 py37hc8dfbb8_1 conda-forge kealib 1.4.13 hec59c27_0 conda-forge kiwisolver 1.2.0 py37h99015e2_0 conda-forge krb5 1.17.1 h2fd8d38_0 conda-forge ld_impl_linux-64 2.34 h53a641e_0 conda-forge libblas 3.8.0 14_openblas conda-forge libcblas 3.8.0 14_openblas conda-forge libcudf 0.14.0a200515 cuda10.1_4705 rapidsai-nightly libcugraph 0.14.0a200514 cuda10.1_551 rapidsai-nightly libcuml 0.14.0a200514 cuda10.1_2655 rapidsai-nightly libcumlprims 0.14.0a200514 cuda10.1_28 rapidsai-nightly libcurl 7.69.1 hf7181ac_0 conda-forge libcuspatial 0.14.0a200514 cuda10.1_513 rapidsai-nightly libdap4 3.20.6 h1d1bd15_0 conda-forge libedit 3.1.20170329 hf8c457e_1001 conda-forge libevent 2.1.10 h72c5cf5_0 conda-forge libffi 3.2.1 he1b5a44_1007 conda-forge libgcc-ng 7.3.0 h24d8f2e_5 conda-forge libgdal 2.4.4 h2b6fda6_0 conda-forge libgfortran-ng 7.3.0 hdf63c60_5 conda-forge libhwloc 2.1.0 h3c4fd83_0 conda-forge libiconv 1.15 h516909a_1006 conda-forge libkml 1.3.0 h4fcabce_1010 conda-forge liblapack 3.8.0 14_openblas conda-forge liblapacke 3.8.0 14_openblas conda-forge libllvm8 8.0.1 hc9558a2_0 conda-forge libnetcdf 4.7.3 nompi_h9f9fd6a_101 conda-forge libnvstrings 0.14.0a200515 cuda10.1_4705 rapidsai-nightly libopenblas 0.3.7 h5ec1e0e_7 conda-forge libpng 1.6.37 hed695b0_1 conda-forge libpq 12.2 h5513abc_1 conda-forge libprotobuf 3.8.0 h8b12597_0 conda-forge librmm 0.14.0a200514 cuda10.1_360 rapidsai-nightly libsodium 1.0.17 h516909a_0 conda-forge libspatialindex 1.9.3 he1b5a44_3 conda-forge libspatialite 4.3.0a ha48a99a_1034 conda-forge libssh2 1.8.2 h22169c7_2 conda-forge libstdcxx-ng 7.3.0 hdf63c60_5 conda-forge libtiff 4.1.0 hfc65ed5_0 conda-forge libuuid 2.32.1 h14c3975_1000 conda-forge libuv 1.34.0 h516909a_0 conda-forge libxcb 1.13 h14c3975_1002 conda-forge libxgboost 1.0.2dev.rapidsai0.13 cuda10.1_6 rapidsai libxml2 2.9.10 hee79883_0 conda-forge llvm-openmp 10.0.0 hc9558a2_0 conda-forge llvmlite 0.32.0 py37h5202443_0 conda-forge locket 0.2.0 py_2 conda-forge lz4-c 1.8.3 he1b5a44_1001 conda-forge markdown 3.2.2 py_0 conda-forge markupsafe 1.1.1 py37h8f50634_1 conda-forge matplotlib-base 3.2.1 py37h30547a4_0 conda-forge mistune 0.8.4 py37h8f50634_1001 conda-forge msgpack-python 1.0.0 py37h99015e2_1 conda-forge multidict 4.7.5 py37h8f50634_1 conda-forge multipledispatch 0.6.0 py_0 conda-forge munch 2.5.0 py_0 conda-forge nbconvert 5.6.1 py37hc8dfbb8_1 conda-forge nbformat 5.0.6 py_0 conda-forge nccl 2.5.7.1 h51cf6c1_0 conda-forge ncurses 6.1 hf484d3e_1002 conda-forge networkx 2.4 py_1 conda-forge nodejs 13.13.0 hf5d1a2b_0 conda-forge nomkl 1.0 h5ca1d4c_0 conda-forge notebook 6.0.3 py37hc8dfbb8_0 conda-forge numba 0.49.0 py37h0573a6f_0 numpy 1.18.4 py37h8960a57_0 conda-forge nvstrings 0.14.0a200515 py37_4705 rapidsai-nightly olefile 0.46 py_0 conda-forge openjpeg 2.3.1 h981e76c_3 conda-forge openssl 1.1.1g h516909a_0 conda-forge packaging 20.1 py_0 conda-forge pandas 0.25.3 py37hb3f55d8_0 conda-forge pandoc 2.9.2.1 0 conda-forge pandocfilters 1.4.2 py_1 conda-forge panel 0.6.4 0 conda-forge param 1.9.3 py_0 conda-forge parquet-cpp 1.5.1 2 conda-forge parso 0.7.0 pyh9f0ad1d_0 conda-forge partd 1.1.0 py_0 conda-forge pcre 8.44 he1b5a44_0 conda-forge perl 5.26.2 h516909a_1006 conda-forge pexpect 4.8.0 py37hc8dfbb8_1 conda-forge pickleshare 0.7.5 py37hc8dfbb8_1001 conda-forge pillow 7.1.2 py37h718be6c_0 conda-forge pip 20.1 pyh9f0ad1d_0 conda-forge pixman 0.38.0 h516909a_1003 conda-forge poppler 0.67.0 h14e79db_8 conda-forge poppler-data 0.4.9 1 conda-forge postgresql 12.2 h8573dbc_1 conda-forge proj 6.3.0 hc80f0dc_0 conda-forge prometheus_client 0.7.1 py_0 conda-forge prompt-toolkit 3.0.5 py_0 conda-forge psutil 5.7.0 py37h8f50634_1 conda-forge pthread-stubs 0.4 h14c3975_1001 conda-forge ptyprocess 0.6.0 py_1001 conda-forge py-xgboost 1.0.2dev.rapidsai0.13 cuda10.1py37_6 rapidsai pyarrow 0.15.0 py37h8b68381_1 conda-forge pycparser 2.20 py_0 conda-forge pyct 0.4.6 py_0 conda-forge pyct-core 0.4.6 py_0 conda-forge pyee 7.0.1 py_0 conda-forge pygments 2.6.1 py_0 conda-forge pynvml 8.0.4 py_0 conda-forge pyopenssl 19.1.0 py_1 conda-forge pyparsing 2.4.7 pyh9f0ad1d_0 conda-forge pyppeteer 0.0.25 py_1 conda-forge pyproj 2.5.0 py37h8ff28aa_0 conda-forge pyrsistent 0.16.0 py37h8f50634_0 conda-forge pysocks 1.7.1 py37hc8dfbb8_1 conda-forge python 3.7.6 h8356626_5_cpython conda-forge python-dateutil 2.8.1 py_0 conda-forge python_abi 3.7 1_cp37m conda-forge pytz 2020.1 pyh9f0ad1d_0 conda-forge pyviz_comms 0.7.4 pyh8c360ce_0 conda-forge pywavelets 1.1.1 py37h03ebfcd_1 conda-forge pyyaml 5.3.1 py37h8f50634_0 conda-forge pyzmq 19.0.1 py37hac76be4_0 conda-forge rapids 0.14.0 cuda10.1_py37_157 rapidsai-nightly rapids-xgboost 0.14.0 cuda10.1_py37_150 rapidsai-nightly re2 2020.05.01 he1b5a44_0 conda-forge readline 8.0 hf8c457e_0 conda-forge requests 2.23.0 pyh8c360ce_2 conda-forge rmm 0.14.0a200514 py37_360 rapidsai-nightly rtree 0.9.4 py37h8526d28_1 conda-forge scikit-image 0.17.2 py37h0da4684_0 conda-forge scikit-learn 0.23.0 py37h8a51577_0 conda-forge scipy 1.4.1 py37ha3d9a3c_3 conda-forge send2trash 1.5.0 py_0 conda-forge setuptools 46.3.0 py37hc8dfbb8_0 conda-forge shapely 1.7.0 py37hb106bac_1 conda-forge simpervisor 0.3 py_1 conda-forge six 1.14.0 py_1 conda-forge snappy 1.1.8 he1b5a44_1 conda-forge sortedcontainers 2.1.0 py_0 conda-forge spdlog 1.5.0 hc9558a2_0 conda-forge sqlite 3.30.1 hcee41ef_0 conda-forge tbb 2020.1 hc9558a2_0 conda-forge tblib 1.6.0 py_0 conda-forge terminado 0.8.3 py37hc8dfbb8_1 conda-forge testpath 0.4.4 py_0 conda-forge threadpoolctl 2.0.0 pyh5ca1d4c_0 conda-forge thrift-cpp 0.12.0 hf3afdfd_1004 conda-forge tifffile 2020.5.11 py_0 conda-forge tk 8.6.10 hed695b0_0 conda-forge toolz 0.10.0 py_0 conda-forge tornado 6.0.4 py37h8f50634_1 conda-forge tqdm 4.46.0 pyh9f0ad1d_0 conda-forge traitlets 4.3.3 py37hc8dfbb8_1 conda-forge tzcode 2020a h516909a_0 conda-forge ucx 1.8.0+gf6ec8d4 cuda10.1_20 rapidsai-nightly ucx-py 0.14.0a0+216.g4e7ba49 pypi_0 pypi uriparser 0.9.3 he1b5a44_1 conda-forge urllib3 1.25.9 py_0 conda-forge wcwidth 0.1.9 pyh9f0ad1d_0 conda-forge webencodings 0.5.1 py_1 conda-forge websockets 8.1 py37h8f50634_1 conda-forge wheel 0.34.2 py_1 conda-forge xarray 0.15.1 py_0 conda-forge xerces-c 3.2.2 h8412b87_1004 conda-forge xgboost 1.0.2dev.rapidsai0.13 cuda10.1py37_6 rapidsai xorg-kbproto 1.0.7 h14c3975_1002 conda-forge xorg-libice 1.0.10 h516909a_0 conda-forge xorg-libsm 1.2.3 h84519dc_1000 conda-forge xorg-libx11 1.6.9 h516909a_0 conda-forge xorg-libxau 1.0.9 h14c3975_0 conda-forge xorg-libxdmcp 1.1.3 h516909a_0 conda-forge xorg-libxext 1.3.4 h516909a_0 conda-forge xorg-libxrender 0.9.10 h516909a_1002 conda-forge xorg-renderproto 0.11.1 h14c3975_1002 conda-forge xorg-xextproto 7.3.0 h14c3975_1002 conda-forge xorg-xproto 7.0.31 h14c3975_1007 conda-forge xz 5.2.5 h516909a_0 conda-forge yaml 0.2.4 h516909a_0 conda-forge yarl 1.3.0 py37h516909a_1000 conda-forge zeromq 4.3.2 he1b5a44_2 conda-forge zict 2.0.0 py_0 conda-forge zipp 3.1.0 py_0 conda-forge zlib 1.2.11 h516909a_1006 conda-forge zstd 1.4.3 h3b9ef0a_0 conda-forge