nathanmarz / dfs-datastores

Dead-simple vertical partitioning, compression, appends, and consolidation of data on a distributed filesystem.
BSD 3-Clause "New" or "Revised" License
215 stars 82 forks source link

PailTap doesn't create random file names #29

Open fkautz opened 11 years ago

fkautz commented 11 years ago

When PailTap is used, sink taps do not use randomized names as expected. Instead, they use the default hadoop naming scheme.

expected:

target/randomized.pailfile

actual:

target/part-00000.pailfile

I've reproduced the problem here: https://github.com/fkautz/bugrepro/tree/dfs-datastores-filenames-bug