RevolutionAnalytics / RHadoop

RHadoop
https://github.com/RevolutionAnalytics/RHadoop/wiki
763 stars 278 forks source link

rhadoop giving null key value output #239

Open Surender1984 opened 7 years ago

Surender1984 commented 7 years ago

I have integrated R with Hadoop using RHadoop and running below program from R.

library(rmr2) library(rhdfs) hdfs.init() ints = to.dfs(1:100) calc = mapreduce(input = ints, map = function(k, v) cbind(v, 2*v)) from.dfs(calc)

Map reduce job runs successfully but it's giving null output as below.

$key NULL

$val NULL

However if I use the option rmr.options(backend="local") then it's giving proper output.

It will be a great help if you can please help me on this and provide the solution.

liuhuanHappyStudy commented 4 years ago

I encountered the same problem. what should I do?

liuhuanHappyStudy commented 4 years ago

First, install rhadoop by install.packages () ; encounter the above problem. Later, manually download rhadoop packages and their dependent packages (* tar.gz), using the method: *R CMD INSTALL .tar.gz**, the above problem is solved.