search

NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs
https://nvidia.github.io/spark-rapids
Apache License 2.0
822 stars 235 forks source link

[BUG] Databricks 14.3 nightly deploy fails due to incorrect DB_SHIM_NAME #11726

Closed gerashegalov closed 4 days ago

gerashegalov commented 6 days ago

Describe the bug

[2024-11-15T10:03:58.129Z] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-deploy-plugin:2.7:deploy-file (default-cli) on project rapids-4-spark-parent_2.12: /home/jenkins/agent/workspace/rapids_databricks_nightly-dev-github-14.3-1358/deploy/spark-rapids/aggregator/target/spark350db/rapids-4-spark-aggregator_2.12-24.12.0-SNAPSHOT-spark350db.jar not found. -> [Help 1]

Steps/Code to reproduce bug deploy.sh for spark350db143

Expected behavior DB_SHIM_NAME in deploy.sh needs an uniquifier in https://github.com/NVIDIA/spark-rapids/blob/a8010cc88c7cee721f75d8107fca16b1863276f9/jenkins/databricks/deploy.sh#L32

Environment details (please complete the following information) Databricks 14.3 CI

Additional context Add any other context about the problem here.

NvTimLiu commented 4 days ago

Oh I forgot it, update deploy.sh for 14.3 shim: https://github.com/NVIDIA/spark-rapids/pull/11728