search

vegas-viz / Vegas

The missing MatPlotLib for Scala + Spark
MIT License
730 stars 98 forks source link

Error while running %AddDeps to add vegas to apache toree scala kernel #115

Closed asdspal closed 7 years ago

asdspal commented 7 years ago

I'm just starting with your project. I'm getting error while adding vegas as a dependency in apache-toree scala kernel.

Spark-version -- 2.2.0 (scala -version 2.11.8) apache-toree -- 0.2.0-dev1 vegas-version -- 0.3.11

error message

 error: error while loading package, class file '/home/pauli/wspace/SoftLib/spark-2.2.0/jars/scala-library-2.11.8.jar(scala/reflect/package.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
error: error while loading package, class file '/home/pauli/wspace/SoftLib/spark-2.2.0/jars/scala-library-2.11.8.jar(scala/package.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
error: error while loading Serializable, class file '/home/pauli/wspace/SoftLib/spark-2.2.0/jars/scala-library-2.11.8.jar(scala/Serializable.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
res4: Either[org.apache.toree.magic.CellMagicOutput,org.apache.toree.magic.LineMagicOutput] = Right(())
error: error while loading Predef, class file '/home/pauli/wspace/SoftLib/spark-2.2.0/jars/scala-library-2.11.8.jar(scala/Predef.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)

MeanWhile, nice project. I have been planning to shift to scala for spark, but was stuck with pyspark in absence of nice visualization library for scala.

asdspal commented 7 years ago

Solved it. It was due to conflict between scala-reflect-2.11.6 and scala-reflect-2.11.8. I had to manually install vegas-viz and its dependencies to local maven repo. Then added vegas-viz as sparks.jars.pacakages in configuration file instead of loading it on the run.