javiroman
commented
7 months ago The same problem, more information about the error here:
$ podman run --rm -it -v $(pwd):/workspace -v $HOME/.m2:/root/.m2 livy-ci mvn clean package -Pscala-2.12 -Pspark3 -DskipTests -DskipITs -Dmaven.javadoc.skip=true
[...]
[INFO] livy-server ........................................ SUCCESS [ 37.986 s]
[INFO] livy-assembly ...................................... FAILURE [ 0.065 s]
[INFO] livy-client-http ................................... SKIPPED
[INFO] livy-scala-api-parent .............................. SKIPPED
[INFO] livy-scala-api_2.12 ................................ SKIPPED
[INFO] livy-integration-test .............................. SKIPPED
[INFO] livy-coverage-report ............................... SKIPPED
[INFO] livy-examples ...................................... SKIPPED
[INFO] livy-python-api .................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:34 min
[INFO] Finished at: 2024-04-20T08:44:36+00:00
[INFO] Final Memory: 212M/3879M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process (process-resource-bundles) on project livy-assem
bly: Failed to resolve dependencies for one or more projects in the reactor. Reason: Missing:
[ERROR] ----------
[ERROR] 1) org.apache.livy:livy-core_2.11:jar:0.9.0-incubating-SNAPSHOT
[...]
Build fails on assembly module due to scala-2.11 dependencies. I think this is due to the
${scala.binary.version}being used in themodulessections, and it's populated before the profiles are loaded. When I ensure that scala-2.12 is the default in the<properties>then it works fine.