kinghorse333
commented
10 years ago Experts, please guide me in this issue as early as possible.
Open kinghorse333 opened 10 years ago
kinghorse333
commented
10 years ago Experts, please guide me in this issue as early as possible.
Hi All,
I am trying to run basic mapreduce example in R using rmr2 and rhdfs libraries, but I am getting an error. Single node hadoop cluster is installed properly and all five demeans are starting properly.
Following is the R code:
Sys.setenv(HADOOP_CMD="/usr/local/hadoop/bin/hadoop") Sys.setenv(HADOOP_HOME="/usr/local/hadoop") Sys.setenv(HADOOP_STREAMING="/usr/local/hadoop/share/hadoop/tools/lib/hadoop-streaming-2.2.0.jar")
Sys.setenv(HADOOP_CONF_DIR="/usr/local/hadoop/etc/hadoop") Sys.setenv(JAVA_HOME="/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home")
library('rhdfs')
library('rmr2')
hdfs.init()
small.ints = to.dfs(1:10) // This line causing following error
Error output:
mkdir: `/var/folders/Jy/Jy7jXOZtG-yUvVOni3n+ZU+++TI/-Tmp-//RtmpUnfVRV': No such file or directory Error: retval == 0 is not TRUE
hdfs.init() is happening properly but to.dfs(1:10) is giving an error
It would be great if experts guide me in this matter. Thanks in advance.