RevolutionAnalytics / RHadoop

RHadoop
https://github.com/RevolutionAnalytics/RHadoop/wiki
763 stars 278 forks source link

rhdfs.init() failure #128

Open centiteo opened 12 years ago

centiteo commented 12 years ago

I have successfully installed rhdfs in R over hadoop cluster. But when I invoke hdfs.init(), it complains with:

/usr/lib64/Revo-6.0/R-2.14.2/lib64/R/lib/libExaCore.so.1(_Z21CriticalSignalHandleri+0x1e)[0x7f05695ca75e] /usr/java/jdk1.6.0_31/jre/lib/amd64/server/libjvm.so(+0x71158d)[0x7f056d4f158d] /usr/java/jdk1.6.0_31/jre/lib/amd64/server/libjvm.so(+0x70e4db)[0x7f056d4ee4db] /usr/java/jdk1.6.0_31/jre/lib/amd64/server/libjvm.so(JVM_handle_linux_signal+0x170)[0x7f056d4f2040] /usr/java/jdk1.6.0_31/jre/lib/amd64/server/libjvm.so(+0x70e3ee)[0x7f056d4ee3ee] /lib64/libpthread.so.0(+0xf4a0)[0x7f0577d434a0] [0x7f04cd05e4d3]

I cannot figure out what was the problem. Could you please help to look at it? Thanks!

RevolutionAnalytics commented 12 years ago

Hi,

can you tell me what version of Hadoop you are using? Also, can you tell me what your HADOOP_CMD environment variable value is?

Thanks

David

RevolutionAnalytics commented 12 years ago

Can you also check the namenode and/or datanode logs to see if there are any errors or stack traces

centiteo commented 12 years ago

We use hadoop-1.0.3. The HADOOP_CMD is: /usr/lib/hadoop/bin/hadoop.

There is nothing abnormal in namenode/datanode log.

Do I need to set the HADOOP_CMD env in all nodes or just the node running R console? Thanks!

Best Regards, Jianzhong

From: Revolution Analytics [mailto:notifications@github.com] Sent: Saturday, September 01, 2012 4:57 AM To: RevolutionAnalytics/RHadoop Cc: Chen, Jianzhong Subject: Re: [RHadoop] rhdfs.init() failure (#128)

Can you also check the namenode and/or datanode logs to see if there are any errors or stack traces

— Reply to this email directly or view it on GitHubhttps://github.com/RevolutionAnalytics/RHadoop/issues/128#issuecomment-8204770.

centiteo commented 12 years ago

Sometimes, when I type the following commands, it will be okay: " library(rhdfs) Loading required package: rJava

HADOOP_CMD=/usr/lib/hadoop/bin/hadoop

Be sure to run hdfs.init() hdfs.ls() Error in .jcall("java/lang/Class", "Ljava/lang/Class;", "forName", cl, : No running JVM detected. Maybe .jinit() would help. Error in .jfindClass(as.character(class)) : No running JVM detected. Maybe .jinit() would help. hdfs.init() Warning: $HADOOP_HOME is deprecated.

"

I have installed R and rhdfs on all hadoop nodes, set all HADOOP_CMD env. Also I randomly choose a node to run the R console.

yugi2245 commented 10 years ago

Hi All,

I too face the same issue and resolved by reconfiguring the Java for R by simple command in Linux CentOS 6.2.

$R CMD javareconf

Thanks, Yugandhar