search

deanwampler / spark-scala-tutorial

A free tutorial for Apache Spark.
Other
985 stars 430 forks source link

set test issue #36

Open srynobio opened 7 years ago

srynobio commented 7 years ago

Hello I'm having a bit of an issue with the sbt test section of the tutorial.

From the spark-scala-tutorial root directory:

{<@_@>}~/spark-scala-tutorial sbt
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=384m; support was removed in 8.0
[info] Loading project definition from /Users/srynobio1/spark-scala-tutorial/project
[info] Updating {file:/Users/srynobio1/spark-scala-tutorial/project/}spark-scala-tutorial-build...
[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[info] Done updating.
[info] Compiling 1 Scala source to /Users/srynobio1/spark-scala-tutorial/project/target/scala-2.10/sbt-0.13/classes...
[info] Set current project to spark-scala-tutorial (in build file:/Users/srynobio1/spark-scala-tutorial/)

> test
[info] Updating {file:/Users/srynobio1/spark-scala-tutorial/}SparkWorkshop...
[info] Resolving jline#jline;2.12.1 ...
[info] downloading https://repo1.maven.org/maven2/org/apache/avro/avro/1.7.7/avro-1.7.7.jar ...
[info]  [SUCCESSFUL ] org.apache.avro#avro;1.7.7!avro.jar (933ms)
[info] Done updating.
[info] Compiling 38 Scala sources to /Users/srynobio1/spark-scala-tutorial/target/scala-2.11/classes...
[error] /Users/srynobio1/spark-scala-tutorial/src/main/scala/sparktutorial/NGrams6.scala:98: object Vector is not a value
[error]       val outputLines = Vector(
[error]                         ^
[error] /Users/srynobio1/spark-scala-tutorial/src/main/scala/sparktutorial/SparkStreaming11Main.scala:76: Vector does not take type parameters
[error]     def mkStreamArgs(argsSeq: Seq[String], newSeq: Vector[String]): Vector[String] =
[error]                                                                     ^
[error] /Users/srynobio1/spark-scala-tutorial/src/main/scala/sparktutorial/SparkStreaming11Main.scala:76: Vector does not take type parameters
[error]     def mkStreamArgs(argsSeq: Seq[String], newSeq: Vector[String]): Vector[String] =
[error]                                                    ^
[error] /Users/srynobio1/spark-scala-tutorial/src/main/scala/sparktutorial/SparkStreaming11Main.scala:83: value empty is not a member of object Vector
[error]     val streamArgs = mkStreamArgs(args, Vector.empty[String]).toArray
[error]                                                ^
[error] /Users/srynobio1/spark-scala-tutorial/src/main/scala/sparktutorial/solns/Matrix4StdDev.scala:69: object Vector is not a value
[error]       val outputLines = Vector(          // Scala's Vector, not MLlib's version!
[error]                         ^
[error] 5 errors found
[error] (compile:compileIncremental) Compilation failed
[error] Total time: 8 s, completed Feb 25, 2017 4:22:40 PM

My scala version:

{<@_@>}~/spark-scala-tutorial scala -version
Scala code runner version 2.12.1 -- Copyright 2002-2016, LAMP/EPFL and Lightbend, Inc.

my sbt version:

[info] This is sbt 0.13.11

my java version:

{<@_@>}~ java -version
java version "1.8.0_101"
Java(TM) SE Runtime Environment (build 1.8.0_101-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.101-b13, mixed mode)