Use mvn -f scala2.13/ in the build scripts to build the 2.13 jars

NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

https://nvidia.github.io/spark-rapids

Apache License 2.0

822 stars 235 forks source link

Use mvn -f scala2.13/ in the build scripts to build the 2.13 jars #11608

Closed NvTimLiu closed 1 month ago

NvTimLiu commented 1 month ago

To fix: https://github.com/NVIDIA/spark-rapids/issues/11444

Change to use ' maven -f scala2.13/' in our build scripts/docs/CICD instead 'cd scala2.13/' to builds 2.13 jars

NvTimLiu commented 1 month ago

build

NvTimLiu commented 1 month ago

Build FAILED on spark440 shim;

[INFO] compiling 472 Scala sources and 58 Java sources to /home/runner/work/spark-rapids/spark-rapids/scala2.13/sql-plugin/target/spark400/classes ...

Error: ] /home/runner/work/spark-rapids/spark-rapids/sql-plugin/src/main/spark332db/scala/org/apache/spark/sql/rapids/shims/GpuDataSource.scala:126: 

value cannotSaveIntervalIntoExternalStorageError is not a member of object 

org.apache.spark.sql.errors.QueryCompilationErrors

Error: [ERROR] one error found

jlowe commented 1 month ago

Build FAILED on spark440 shim

Note that this is not blocking for this PR, as spark400 shim is a snapshot shim.