search

NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs
https://nvidia.github.io/spark-rapids
Apache License 2.0
822 stars 235 forks source link

Add a test for ORC write with more than one stripe #11743

Open ustcfy opened 1 day ago

ustcfy commented 1 day ago

closes https://github.com/NVIDIA/spark-rapids/issues/11735

This new test function ensures that enough rows are written to generate more than one stripe during ORC write process, allowing us to catch the "ORC writes don't fully support Booleans with nulls" bug.