search

Hydrospheredata / mist

Serverless proxy for Spark cluster
http://hydrosphere.io/mist/
Apache License 2.0
326 stars 68 forks source link

Issue building mist 1.0.0 for spark 2.2.1 #531

Open palaiya opened 5 years ago

palaiya commented 5 years ago

I tried building the mist 1.0.0 for spark 2.2.1 but it throws the following error and error was quite long so am attaching the only few lines of it. Sample Error


[error] 18 errors were encountered during merge
[info] Done packaging.
[error] java.lang.RuntimeException: deduplicate: different file contents found in the following:
[error] /home/AEPL/sparkuser/.cache/coursier/v1/https/repo1.maven.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar:javax/inject/Inject.class
[error] /home/AEPL/sparkuser/.cache/coursier/v1/https/repo1.maven.org/maven2/org/glassfish/hk2/external/javax.inject/2.4.0-b34/javax.inject-2.4.0-b34.jar:javax/inject/Inject.class
[error] deduplicate: different file contents found in the following:
[error] /home/AEPL/sparkuser/.cache/coursier/v1/https/repo1.maven.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar:javax/inject/Named.class
[error] /home/AEPL/sparkuser/.cache/coursier/v1/https/repo1.maven.org/maven2/org/glassfish/hk2/external/javax.inject/2.4.0-b34/javax.inject-2.4.0-b34.jar:javax/inject/Named.class
[error] deduplicate: different file contents found in the following:
[error] /home/AEPL/sparkuser/.cache/coursier/v1/https/repo1.maven.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar:javax/inject/Provider.class
[error] /home/AEPL/sparkuser/.cache/coursier/v1/https/repo1.maven.org/maven2/org/glassfish/hk2/external/javax.inject/2.4.0-b34/javax.inject-2.4.0-b34.jar:javax/inject/Provider.class
[error] deduplicate: different file contents found in the following:
[error] /home/AEPL/sparkuser/.cache/coursier/v1/https/repo1.maven.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar:javax/inject/Qualifier.class
[error] /home/AEPL/sparkuser/.cache/coursier/v1/https/repo1.maven.org/maven2/org/glassfish/hk2/external/javax.inject/2.4.0-b34/javax.inject-2.4.0-b34.jar:javax/inject/Qualifier.class
[error] deduplicate: different file contents found in the following:
[error] /home/AEPL/sparkuser/.cache/coursier/v1/https/repo1.maven.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar:javax/inject/Scope.class
[error] /home/AEPL/sparkuser/.cache/coursier/v1/https/repo1.maven.org/maven2/org/glassfish/hk2/external/javax.inject/2.4.0-b34/javax.inject-2.4.0-b34.jar:javax/inject/Scope.class
dos65 commented 5 years ago

Couldn't reproduce this one. Have you tried to remove these artifacts from coursier cache?

palaiya commented 5 years ago

I tried both sbt clean and deleted this coursier cache also. But still, I am getting the same error. Even now when I try to build the mist 1.1.1 i am getting the same error. So, what could be wrong despite sbt clean and deleting coursier cache

I took checkout of mist 1.1.1 tag on a different machine but i still got the same error. So, could you please check what is causing this error.

I am using ./sbt/sbt -DsparkVersion=2.2.1 assembly command on root folder of mist.