NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs
https://nvidia.github.io/spark-rapids
Apache License 2.0
823 stars 236 forks source link

[Spark 4.0] Address test failures in cast_test.py [databricks] #11559

Closed mythrocks closed 1 month ago

mythrocks commented 1 month ago

Fixes #11009 and #11530.

This commit addresses the test failures in cast_test.py, on Spark 4.0. These generally have to do with changes in behaviour of Spark when ANSI mode is enabled. In these cases, the tests have been split out into ANSI=on and ANSI=off.

The bugs uncovered from the tests have been spun into their own issues; fixing all of them was beyond the scope of this change.

mythrocks commented 1 month ago

Build

mythrocks commented 1 month ago

Build

mythrocks commented 1 month ago

Build

mythrocks commented 1 month ago

I've merged this change. Thank you for the review, @gerashegalov.