NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs
https://nvidia.github.io/spark-rapids
Apache License 2.0
823 stars 235 forks source link

[BUG] delta_lake_write_test.py failed on "AssertionError: GPU and CPU boolean values are different" #11716

Closed parthosa closed 1 week ago

parthosa commented 1 week ago

Describe the bug

Test case delta_lake_write_test.py::test_delta_overwrite_by_expression_exec_v1 failed with DATAGEN_SEED=1731436170

Environment - arm64, ubuntu22, cuda12, spark-3.4.1

Console Output:


[2024-11-12T19:02:36.318Z] =========================== short test summary info ============================

[2024-11-12T19:02:36.318Z] FAILED ../../src/main/python/delta_lake_write_test.py::test_delta_overwrite_by_expression_exec_v1[False][DATAGEN_SEED=1731436170, TZ=UTC, INJECT_OOM, IGNORE_ORDER({'local': True}), 

ALLOW_NON_GPU(DeserializeToObjectExec,ShuffleExchangeExec,FileSourceScanExec,FilterExec,MapPartitionsExec,MapElementsExec,ObjectHashAggregateExec,ProjectExec,SerializeFromObjectExec,SortExec)] 

  - AssertionError: GPU and CPU boolean values are different at [306, 'c43', 0, 0, 'child7']
pmattione-nvidia commented 1 week ago

Fixed by this cuDF PR.