Create a script to automate the fsimage export

twitter-archive / hdfs-du

Visualize your HDFS cluster usage

https://twitter.com/hdfsdu

Apache License 2.0

230 stars 83 forks source link

Create a script to automate the fsimage export #7

Open ryanhennig-ebaysf opened 12 years ago

ryanhennig-ebaysf commented 12 years ago

I'm working on automation for the steps required to export the fsimage and process it for input into hdfs-du. I'm currently doing this as a shell script designed to run from the secondary name node.

I'm already wishing this was in a language like ruby or python. I'm more familiar with ruby so that is my first inclination, but the project already has a dependency on python, so that might make sense as well.

cbaenziger commented 5 years ago

Though frozen now, it may help folks to see we at Bloomberg did write an Oozie workflow and Chef recipes to deploy HDFS-DU in https://github.com/bloomberg/chef-bach/pull/932