kzk / webhdfs

Ruby client for Hadoop WebHDFS
Other
81 stars 46 forks source link

Any interest in a remote copy/merge feature (hdfs -> local)? #6

Open internetoutfitters opened 10 years ago

internetoutfitters commented 10 years ago

Effectively something along these lines: http://hadoop.apache.org/docs/current/api/org/apache/hadoop/fs/FileUtil.html#copyMerge

I have an alpha implementation of this inside a project I'm currently working on, but thought it might be a good addition this one...