search

rapidsai-community / rapidsai-csp-utils

35 stars 63 forks source link

Colab - can't import cudf, following template instructions #82

Closed timmyphang closed 1 week ago

timmyphang commented 11 months ago

Please excuse me if there's something obvious that I can fix myself, I'm new to using GPU for workloads

Error log:

ValueError Traceback (most recent call last) in <cell line: 1>() ----> 1 import cudf 2 cudf.version

2 frames /usr/local/lib/python3.10/dist-packages/cudf/_lib/init.py in 2 import numpy as np 3 ----> 4 from . import ( 5 avro, 6 binaryop,

avro.pyx in init cudf._lib.avro()

column.pyx in init cudf._lib.column()

scalar.pyx in init cudf._lib.scalar()

interop.pyx in init cudf._lib.interop()

ValueError: pyarrow.lib.IpcWriteOptions size changed, may indicate binary incompatibility. Expected 88 from C header, got 72 from PyObject

adityapatkar commented 11 months ago

Having the same issue in Google Colab

beckernick commented 11 months ago

I wasn't able to reproduce this error using the RAPIDS quick-start colab notebook installation scripts in a fresh Colab runtime.

This error generally comes up when your environment's PyArrow is incompatible with cuDF. I'd recommend trying in a fresh environment to see if things work smoothly. If that's not possible, I'd explore whether you can ensure only PyArrow 12.0 is present (cuDF 23.10 is coupled to that version)