delta-rho / RHIPE

R and Hadoop Integrated Programming Environment
58 stars 28 forks source link

Create function to gather debug info #7

Open hafen opened 10 years ago

hafen commented 10 years ago

Add an exported, documented function to RHIPE, call it maybe rhipeDebugInfo() that runs a MapReduce job that returns for each map task a list with the following:

Anything else?

The trick is to make it run a dummy job that we can ensure will run on all nodes of the cluster, but only a small number (preferably one) task per node.

This will be a useful function to expose to any RHIPE user to be able to run to figure out why something might not be working, or to provide details about their system.

hafen commented 10 years ago

It would be good to put it in both master and dev.