search

RevolutionAnalytics / RHadoop

RHadoop
https://github.com/RevolutionAnalytics/RHadoop/wiki
763 stars 278 forks source link

Problem upgrading rmr2 package to latest version #201

Closed meggenb closed 10 years ago

meggenb commented 10 years ago

I am experiencing a few problems upgrading to the latest version of rmr2.

Loading required package: rmr2 Loading required package: Rcpp Loading required package: RJSONIO Loading required package: bitops Loading required package: digest Loading required package: stringr Loading required package: plyr Loading required package: reshape2 Loading required package: caTools Warning in library(package, lib.loc = lib.loc, character.only = TRUE, logical.return = TRUE, : there is no package called ‘caTools’ Warning in FUN(c("rhdfs", "rJava", "rmr2", "caTools", "plyr", "stringr", : can't load caTools Error in rmr2:::map.loop(map = map, keyval.reader = input.reader(), keyval.writer = if (!has.reduce) output.writer() else default.writer(), : unused argument (map.only = !has.reduce) Calls: -> No traceback available Error during wrapup: Execution halted java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1 at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:362) at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:576) at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:135) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57) at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:36) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:429) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:365) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232) at org.apache.hadoop.mapred.Child.main(Child.java:249)

I did install the new dependencies as root. This may have something to to with resolving additional packages. Below is the sessionInfo();

sessionInfo() R version 3.0.2 (2013-09-25) Platform: x86_64-unknown-linux-gnu (64-bit)

locale: [1] LC_CTYPE=en_US.UTF-8 LC_NUMERIC=C
[3] LC_TIME=en_US.UTF-8 LC_COLLATE=en_US.UTF-8
[5] LC_MONETARY=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8
[7] LC_PAPER=en_US.UTF-8 LC_NAME=C
[9] LC_ADDRESS=C LC_TELEPHONE=C
[11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C

attached base packages: [1] stats graphics grDevices utils datasets methods base

other attached packages: [1] rhdfs_1.0.8 rJava_0.9-6 rmr2_3.0.0 caTools_1.16 plyr_1.8
[6] stringr_0.6.2 reshape2_1.2.2 functional_0.4 digest_0.6.4 bitops_1.0-6
[11] RJSONIO_1.0-3 Rcpp_0.11.0

Thank you -martin eggenberger

piccolbo commented 10 years ago

Hi, we deal with rmr2-specific issues on the rmr2 issue tracker, I opened RevolutionAnalytics/rmr2#84 for you.