search

NICTA / scoobi

A Scala productivity framework for Hadoop.
http://nicta.github.com/scoobi/
482 stars 97 forks source link

OutputChannel - can not move #351

Open msprunck opened 10 years ago

msprunck commented 10 years ago

I run a ScoobiApp locally using scoobi 0.8.4-cdh5 with the LocalJobRunner. The overwrite option is set to true. At the last step, I get the following error:

[ERROR] OutputChannel - can not move file:/tmp/scoobi-user/SampleApp$-1104-100253-2062082297/tmp-out-step_4_of_4/ch303-128 to data/output

ch303-128 contains a file with the expected results.

This error only occurs if the data/output folder contains only a _SUCCESS or an hidden file before I run the application.

The workaround is to remove the output directory or its content.

msprunck commented 10 years ago

I found the same issue on Google Groups with a reproducer: https://groups.google.com/forum/#!searchin/scoobi-users/_SUCCESS/scoobi-users/jtpKRDsldK0/4svvlpdpBTwJ