search

cloudera / cdh-twitter-example

Example application for analyzing Twitter data using CDH - Flume, Oozie, Hive
288 stars 343 forks source link

Flume: Unable to start EventDrivenSourceRunner #10

Closed Maddin485 closed 10 years ago

Maddin485 commented 10 years ago

Hi, tried this code and guidance for extracting data from Twitter. But when i start the agent i got the following error:

Unable to start EventDrivenSourceRunner: { source:com.cloudera.flume.source.TwitterSource{name:Twitter,state:IDLE} } - Exception follows. java.lang.NoSuchMethodError: twitter4j.FilterQuery.setIncludeEntities(Z)Ltwitter4j/FilterQuery; at com.cloudera.flume.source.TwitterSource.start(TwitterSource.java:139) at org.apache.flume.source.EventDrivenSourceRunner.start(EventDrivenSourceRunner.java:44) at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:251) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744)

What could be my failure. I am a absolute beginner with flume!

Thanks and best regards, Martin

Maddin485 commented 10 years ago

Hm Perhaps i am a Step forward. But today i got this error: Exception in thread "Twitter4J Async Dispatcher[0]" java.lang.NoSuchMethodError: twitter4j.json.JSONObjectType.determine(Ltwitter4j/internal/org/json/JSONObject;)Ltwitter4j/json/JSONObjectType; at twitter4j.AbstractStreamImplementation$1.run(AbstractStreamImplementation.java:100) at twitter4j.internal.async.ExecuteThread.run(DispatcherImpl.java:116)

Maddin485 commented 10 years ago

It´s working, now. But i have rebuild the jar file.

StrangeTcy commented 10 years ago

Rebuilt it how? Can you post instructions? I'm having the same problem, and would appreciate any help.

Maddin485 commented 10 years ago

In Step 1 of the instructions-page there are 2 possilities:

  1. download the already generated .jar-file or
  2. generate the .jar-file on your own

and in my Environment the already generated .jar-File does not work but when i generate it on my own it works fine. Therefore you need a Maven-Installation in your Environment and then download (and unzip) the sources cdh-twitter-example-master.zip and build the .jar-File with Maven with the commands from the instructions:

$ cd flume-sources
$ mvn package $ cd ..

Good Luck and best regards

StrangeTcy commented 10 years ago

Thanks, I shall try. If it works, can I mention your advice on stackoverflow?

PriyadarshanLive commented 9 years ago

I also get the same error. If anyone found a solution please mention here..urgent!. I am using the flume-sources-1.0-SNAPSHOT.jar file and the same configuration file from the cloudera.

jmkd0 commented 3 years ago

i have the same issue