search

tensorflow / ecosystem

Integration of TensorFlow with other open-source frameworks
Apache License 2.0
1.37k stars 393 forks source link

Failed to build spark-tensorflow-connector_2.12 #179

Open Echo9573 opened 3 years ago

Echo9573 commented 3 years ago

Environment

tensorflow: 2.0.0 spark version: 2.4.3-107 maven version: 3.6.3

Description I have followed the steps to build which is shown in the link . image But, I got fail in the test stage when building the jar, which is shown as follows:

T E S T S

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO] [INFO] --- scalatest-maven-plugin:1.0:test (scalaTest) @ spark-tensorflow-connector_2.12 --- Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/doxia/doxia-sink-api/1.0-alpha-10/doxia-sink-api-1.0-alpha-10.pom Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/doxia/doxia-sink-api/1.0-alpha-10/doxia-sink-api-1.0-alpha-10.pom (1.3 kB at 3.1 kB/s) Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/doxia/doxia/1.0-alpha-10/doxia-1.0-alpha-10.pom Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/doxia/doxia/1.0-alpha-10/doxia-1.0-alpha-10.pom (9.2 kB at 5.1 kB/s) /bin/sh: 1: java: not found [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 01:14 h [INFO] Finished at: 2021-01-06T01:04:30+08:00 [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.scalatest:scalatest-maven-plugin:1.0:test (scalaTest) on project spark-tensorflow-connector_2.12: There are test failures -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

dgoldenberg-audiomack commented 3 years ago

Hey @Echo9573, I think your error is:

/bin/sh: 1: java: not found

judging by the output. However you can try running Maven with -e and -X to get more info. It seems like either you don't have Java installed or it's not on your PATH.

Echo9573 commented 3 years ago

Hi @dgoldenberg-audiomack, thanks for your remind! I have added the JAVA_HOME to PATH. But, after that, another error appears, as the following shows:

21/01/06 11:52:46 INFO ShutdownHookManager: Shutdown hook called 21/01/06 11:52:46 INFO ShutdownHookManager: Deleting directory /tmp/spark-cc13aa16-ab22-4e48-ac89-8bce42492280 [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 01:07 min [INFO] Finished at: 2021-01-06T11:52:46+08:00 [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.scalatest:scalatest-maven-plugin:1.0:test (scalaTest) on project spark-tensorflow-connector_2.12: There are test failures -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

dgoldenberg-audiomack commented 3 years ago

It says there are test failures. Any more info before or after this snippet? You can add -e and -X switches to your maven command to get more info, too.

Worst comes to worse you could disable tests by adding -DskipTests but I would not recommend it. Tests should pass..