search

mozilla / jydoop

Efficient Hadoop Map-Reduce in Python
Other
31 stars 19 forks source link

output files lost if terminal connection is lost #36

Closed bcolloran closed 11 years ago

bcolloran commented 11 years ago

I discovered this problem b/c of the flaky wi-fi in the SF office... if my connection to e.g. the Mango cluster is lost, my jobs will complete without issue, but the target output file will not be written.

'Screen' can be used to work-around, but I wonder if it's possible to have jydoop write its output independent of an active shell (or whatevs.)

bsmedberg commented 11 years ago

Use nohup... the problem is that we're receiving SIGHUP and dealing with that in Java is hard.