NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs
https://nvidia.github.io/spark-rapids
Apache License 2.0
823 stars 236 forks source link

Change DataSource calendar interval error to fix spark400 build [databricks] #11610

Closed jlowe closed 1 month ago

jlowe commented 1 month ago

Updates the error reported by GpuDataSource for CalendarIntervalType to use dataTypeUnsupportedByDataSourceError rather than cannotSaveIntervalIntoExternalStorageError which was removed in Spark 4.0.0 by SPARK-49892.

razajafri commented 1 month ago

build

razajafri commented 1 month ago

Thank you for doing this