NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs
https://nvidia.github.io/spark-rapids
Apache License 2.0
822 stars 235 forks source link

Fix `misc_expr_test` for [databricks] 14.3 #11670

Closed mythrocks closed 2 weeks ago

mythrocks commented 3 weeks ago

Fixes #11537.

This commit addresses the failure of the test_raise_error test in misc_expr_test.py for Databricks 14.3.

This is an extension of #11129, where this test was skipped for Apache Spark 4.0. The failure on Databricks 14.3 shares the same cause as in Spark 4.0, i.e. a backward-incompatible Spark change in the signature of RaiseError, as introduced in https://issues.apache.org/jira/browse/SPARK-44838.

The work to support SPARK-44838 in a Spark-RAPIDS shim will be tracked in #10969. This test needs to be skipped until that work is completed.

mythrocks commented 3 weeks ago

Build