rapidsai-community / notebooks-contrib

RAPIDS Community Notebooks
Apache License 2.0
513 stars 267 forks source link

df.to_csv('./dataset.csv', index=False) crashing with "internal error" in RAPIDS 24.02 cuFile #386

Open frasertajima opened 7 months ago

frasertajima commented 7 months ago

Describe the bug Running 02_Introduction_to_cuDF.ipynb notebook from Rapids sample notebooks results in cuFile "internal error":

File csv.pyx:545, in cudf._lib.csv.write_csv()

RuntimeError: cuFile error at: [/var/home/fraser/anaconda3/envs/rapids-24.02/include/kvikio/file_handle.hpp:178](https://file+.vscode-resource.vscode-cdn.net/var/home/fraser/anaconda3/envs/rapids-24.02/include/kvikio/file_handle.hpp:178): internal error

Fedora Silverblue 40 beta CUDA is 12.4 but the Conda environment installs CUDA 12.0:

nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2022 NVIDIA Corporation Built on Mon_Oct_24_19:12:58_PDT_2022 Cuda compilation tools, release 12.0, V12.0.76 Build cuda_12.0.r12.0/compiler.31968024_0

Steps/Code to reproduce bug Screenshot from 2024-04-04 10-21-47

Run notebook cell 27:

df.to_csv('./dataset.csv', index=False)

the following notebook cell 28 also crashes with same error:

df = cudf.read_csv('./dataset.csv')

Expected behavior Writing/reading of df dataframe to/from csv file.

Environment details (please complete the following information):

Additional context This error has existed since January's rapids 23.12 when I last tried Rapids out. (cudf read csv)