Do not package the Databricks 14.3 shim into the dist jar [skip ci]

NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

https://nvidia.github.io/spark-rapids

Apache License 2.0

822 stars 235 forks source link

Do not package the Databricks 14.3 shim into the dist jar [skip ci] #11744

Closed NvTimLiu closed 4 hours ago

NvTimLiu commented 1 day ago

The 350db143 shim will be packaged into the dist jar in branch-25.02

NvTimLiu commented 1 day ago

build

NvTimLiu commented 1 day ago

Local test got PASS

source jenkins/version-def.sh
SPARK_SHIM_VERSIONS_DATABRICKS=330db 332db 341db
SPARK_SHIM_VERSIONS=320 321 321cdh 322 323 324 330 331 332 333 334 340 341 342 343 344 330cdh 332cdh 350 351 352 353
export SCALA_BINARY_VER=2.13

source jenkins/version-def.sh
SCALA_BINARY_VER: 2.13
SPARK_SHIM_VERSIONS_DATABRICKS=330db 332db 341db
SPARK_SHIM_VERSIONS=330 331 332 333 334 340 341 342 343 344 350 351 352 353 400

NvTimLiu commented 5 hours ago

[skip ci], pre-merge has been PASS in the previous commit, the latest commit only add a comment.

NvTimLiu commented 5 hours ago

build

NvTimLiu commented 4 hours ago

build

NvTimLiu commented 4 hours ago

build