search

deva-rajan / hamake

Automatically exported from code.google.com/p/hamake
0 stars 0 forks source link

ReduceTask launches job with no input in case of empty input folder #18

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago 
What steps will reproduce the problem?
1. create empty lib/ input directory
2. ant examples

What is the expected output? What do you see instead?

     [exec] java.io.IOException: No input paths specified in job
     [exec]     at
org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:152)
     [exec]     at
org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:201)
     [exec]     at
org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:810)
     [exec]     at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:781)
     [exec]     at
org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:730)
     [exec]     at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1249)
     [exec]     at
com.codeminders.hamake.examples.ClassSizeHistogram.run(ClassSizeHistogram.java:7
7)
     [exec]     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
     [exec]     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
     [exec]     at
com.codeminders.hamake.examples.ClassSizeHistogram.main(ClassSizeHistogram.java:
35)
     [exec]     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     [exec]     at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
     [exec]     at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.jav
a:25)
     [exec]     at java.lang.reflect.Method.invoke(Method.java:597)
     [exec]     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
     [exec]     at
com.codeminders.hamake.commands.HadoopCommand.execute(HadoopCommand.java:74)
     [exec]     at
com.codeminders.hamake.tasks.ReduceTask.execute(ReduceTask.java:65)
     [exec]     at com.codeminders.hamake.TaskThread.run(TaskThread.java:43)

Please use labels and text to provide additional information.

MapTask and ReduceTask should not launch job and should output warning in
case there is empty input folder

Original issue reported on code.google.com by vorl.s...@gmail.com on 29 Mar 2010 at 9:22

GoogleCodeExporter commented 8 years ago

Original comment by vorl.s...@gmail.com on 29 Mar 2010 at 9:23

GoogleCodeExporter commented 8 years ago

Original comment by vorl.s...@gmail.com on 29 Mar 2010 at 11:37