Open giwa opened 10 years ago
I have the same java.lang.ClassNotFoundException: org.apache.spark.streaming.twitter.TwitterReceiver
issue now that I fixed the scalaVersion := "2.10.3"
thing.
Same here. Just getting blank tweets.
Same here. Not sure what is wrong. If I changed the sparkUrl to "local[4]", it works perfectly.
I've got the same issue.
I got a bit farther along. I edited the build.sbt: I changed:
scalaVersion := "2.10.4"
and: "org.apache.spark" %% "spark-streaming" % "0.9.0-incubating", "org.apache.spark" %% "spark-streaming-twitter" % "0.9.0-incubating" to: "org.apache.spark" %% "spark-streaming" % "1.1.0", "org.apache.spark" %% "spark-streaming-twitter" % "1.1.0"
I get a few warnings but not classpath errors. The app runs but it's still just getting blank tweets.
Sorry, that should have been: scalaVersion := "2.10.3" That's the version reported when I run ./spark-shell If I let the app run long enough, 15 seconds or so, I'll get the line: WARN scheduler.TaskSchedulerImpl: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient memory Googling that brings up all kinds of stuff, some of which say it's a red herring. All of my slaves have 2gigs, which is the amp-camp default.
I followed instruction in ampcamp4 and launched amazon ec2 instances. I tried to run Spark Streaming but it was not working. I suffered from the problem that scala version mismatch to requirement in sbt. Even if I fixed scala version problem. example of Spark Streaming did not work in ec2 instances.
line 3 in build.sbt
I pasted two errors. First one is the error due to scala version when I complied Spark Streaming. Second one is happened when I ran Spark Streaming.
This was happened when I ran Spark Streaming example