Closed Kartik-ramalingam closed 12 years ago
Hi. Thank you for your interest in my project. And I'm sorry for the late reply.
It seems that you couldn't connect github.com when you tried. Can you download the pom file from http://ueshin.github.com/hadoop-client/releases/st/happy_camper/hadoop/hadoop-client/cdh3u2-1/hadoop-client-cdh3u2-1.pom now? If you can, you will be able to complete to rebuild the project. If you can't, please let me know again.
Thanks.
Hi,
We still have the same problem.
Would you be able to upload the JAR file, so that we can use it in our linux environment.
Thanks, Kartik
Ok, I see.
You can download from here. https://github.com/ueshin/flume-twitter/tree/gh-pages/releases/st/happy_camper/flume/flume-twitter/0.0.3
Thanks.
Thanks. Download the jar file.
But, have a issue in using the plugin. Please see the below stack trace:
2012-02-07 15:43:45,991 [logicalNode hadoop-master-19] ERROR twitter.TwitterStreamingConnection: The host did not accept the connection within timeout of 1000 ms
org.apache.commons.httpclient.ConnectTimeoutException: The host did not accept the connection within timeout of 1000 ms
at org.apache.commons.httpclient.protocol.ReflectionSocketFactory.createSocket(ReflectionSocketFactory.java:155)
at org.apache.commons.httpclient.protocol.SSLProtocolSocketFactory.createSocket(SSLProtocolSocketFactory.java:130)
at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707)
at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387)
at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
at st.happy_camper.flume.twitter.TwitterStreamingConnection.doOpen(TwitterStreamingConnection.java:180)
at st.happy_camper.flume.twitter.TwitterStreamingConnection.
It says that connection timeout was occured. This plugin needs to connect to stream.twitter.com within 1000ms.
Thanks.
Is there a way to increase the connection timeout.
Thanks,
Yes, I can increase the connection timeout(, and of course you can). To do so, modify here ( https://github.com/ueshin/flume-twitter/blob/master/src/main/java/st/happy_camper/flume/twitter/TwitterStreamingConnection.java#L62 ) and rebuild it.
But I'm wondering if your linux environment can reach stream.twitter.com (or github.com)? At first comment, you said that maven download also occured connection timeout. I think maven download timeout is 60 seconds by default and I can't believe it takes so long time.
Thanks.
Hi Ueshin san, Thanks for your reply.
We have a problem in accessing https://stream.twitter.com and working with network team to shortout.
Thanks, Kartik
Hi, Kartik. Thank you for your reply. I hope your network gets well soon.
I will make this plugin possible to configure connection timeout by flume command. Please wait for a few days if you need it.
Thanks.
Hi Ueshin san, We are able to access it now. Thanks, Kartik
Oh, great! I'm really glad to hear that!
Now I'm going to close this issue. But if you have another problem, please reopen or create the next issue.
Have fun!
Please see the below errorlog:
[cloudera@hadoop-master ueshin-flume-twitter-a26a7a5]$ mvn clean package [INFO] Scanning for projects... Downloading: http://ueshin.github.com/hadoop-client/releases/st/happy_camper/hadoop/hadoop-client/cdh3u2-1/hadoop-client-cdh3u2-1.pom Downloading: http://repo.maven.apache.org/maven2/st/happy_camper/hadoop/hadoop-client/cdh3u2-1/hadoop-client-cdh3u2-1.pom [ERROR] The build could not read 1 project -> [Help 1] [ERROR]
[ERROR] The project st.happy_camper.flume:flume-twitter:0.0.4-SNAPSHOT (/usr/local/hadoop-u3/ueshin-flume-twitter-a26a7a5/pom.xml) has 1 error [ERROR] Non-resolvable parent POM: Could not transfer artifact st.happy_camper.hadoop:hadoop-client:pom:cdh3u2-1 from/to hadoop-client-releases (http://ueshin.github.com/hadoop-client/releases): Connection to http://ueshin.github.com refused and 'parent.relativePath' points at wrong local POM @ line 3, column 10: Connection timed out -> [Help 2] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException [ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException