NVIDIA / spark-rapids-jni

RAPIDS Accelerator JNI For Apache Spark
Apache License 2.0
38 stars 65 forks source link

[BUG] nightly build failed kvikIO in cuda11+arm64 #2580

Closed pxLi closed 4 days ago

pxLi commented 1 week ago

Describe the bug spark-rapids-jni_nightly-dev run: 925,926 failed cmake issue,

this failed only with cuda11+arm64 scenarios (x86 and cuda12+arm64 works fine), and indicated that the property contains a path prefixed with the build directory

[2024-11-08T06:32:08.543Z] [INFO]      [exec] -- CPM: Adding package kvikio@24.12 (branch-24.12)
[2024-11-08T06:32:11.080Z] [INFO]      [exec] CMake Warning at /home/jenkins/agent/workspace/spark-rapids-jni_nightly-dev/target/libcudf/cmake-build/_deps/kvikio-src/cpp/CMakeLists.txt:83 (message):
[2024-11-08T06:32:11.081Z] [INFO]      [exec]   Cannot find cuFile - KvikIO will still work but won't use GPUDirect Storage
[2024-11-08T06:32:11.081Z] [INFO]      [exec]   (GDS)
[2024-11-08T06:32:11.081Z] [INFO]      [exec] 
[2024-11-08T06:32:11.081Z] [INFO]      [exec] 
[2024-11-08T06:32:11.081Z] [INFO]      [exec] -- Could NOT find cuFile (missing: cuFile_LIBRARY cuFileRDMA_LIBRARY cuFile_INCLUDE_DIR) 
[2024-11-08T06:32:11.081Z] [INFO]      [exec] -- CPM: kvikio: Adding package bs_thread_pool@4.1.0 (097aa718f25d44315cadb80b407144ad455ee4f9)
[2024-11-08T06:32:12.456Z] [INFO]      [exec] -- CPM: Adding package nanoarrow@0.6.0.dev (0.6.0.dev)
[2024-11-08T06:32:16.652Z] [INFO]      [exec] -- Building using CMake version: 3.26.4
[2024-11-08T06:32:16.654Z] [INFO]      [exec] -- Configuring done (43.7s)
[2024-11-08T06:32:16.654Z] [INFO]      [exec] CMake Error in /home/jenkins/agent/workspace/spark-rapids-jni_nightly-dev/target/libcudf/cmake-build/_deps/kvikio-src/cpp/CMakeLists.txt:
[2024-11-08T06:32:16.654Z] [INFO]      [exec]   Target "kvikio" INTERFACE_INCLUDE_DIRECTORIES property contains path:
[2024-11-08T06:32:16.654Z] [INFO]      [exec] 
[2024-11-08T06:32:16.654Z] [INFO]      [exec]     "/home/jenkins/agent/workspace/spark-rapids-jni_nightly-dev/target/libcudf/cmake-build/_deps/kvikio-src/cpp/"
[2024-11-08T06:32:16.654Z] [INFO]      [exec] 
[2024-11-08T06:32:16.654Z] [INFO]      [exec]   which is prefixed in the build directory.

Steps/Code to reproduce bug Please provide a list of steps or a code sample to reproduce the issue. Avoid posting private or sensitive data.

Expected behavior Pass the build

Environment details (please complete the following information)

Additional context Add any other context about the problem here.

ttnghia commented 1 week ago

Suspect that it is due to https://github.com/rapidsai/kvikio/pull/540 or https://github.com/rapidsai/kvikio/pull/527 but not sure.

ttnghia commented 1 week ago

Should be fixed by https://github.com/rapidsai/kvikio/pull/542.