Moved partition sink setup to outputConfigure so it gets executed on the client and not each mapper.

NICTA / scoobi

A Scala productivity framework for Hadoop.

http://nicta.github.com/scoobi/

482 stars 97 forks source link

Closed raronson closed 10 years ago

raronson commented 10 years ago

This fixes the org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException when using textFilePartitionedSink and multiple mappers