nathanmarz / dfs-datastores

Dead-simple vertical partitioning, compression, appends, and consolidation of data on a distributed filesystem.
BSD 3-Clause "New" or "Revised" License
215 stars 82 forks source link

consolidator enhancements: throw exception on delete failure, add working directory as argument #44

Open dkincaid opened 10 years ago

dkincaid commented 10 years ago

These are a couple of enhancements to the Consolidator.

  1. At the end of the consolidator mapper I added a check on the delete of the source file and throw an exception if the delete fails.
  2. The working directory for the consolidator was hard coded to "/tmp/consolidator". I added the ability to specify a different working directory.
sorenmacbeth commented 10 years ago

Thanks. This looks good to merge, I'm just wondering if there are any additional test that might be added in addition to the code changes?