search

NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs
https://nvidia.github.io/spark-rapids
Apache License 2.0
822 stars 235 forks source link

Fix `orc_write_test.py` for [databricks] 14.3 #11664

Closed mythrocks closed 3 weeks ago

mythrocks commented 3 weeks ago

Fixes #11529.

This commit fixes the failure of orc_write_test.py::test_orc_do_not_lowercase_columns as described in #11529.

The failure was the result of a change in the exception text in Databricks 14.3. (It differs from Spark 3.5, on which it is based, and more closely resembles Spark 4.0.)

mythrocks commented 3 weeks ago

Build

mythrocks commented 3 weeks ago

Sorting the test failure out now. Applying the patch on main seems to have messed up the imports, I think.

mythrocks commented 3 weeks ago

Build

mythrocks commented 3 weeks ago

Thank you for the review, @revans2. I've merged this change.