search

linkedin / dynamometer

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.
BSD 2-Clause "Simplified" License
131 stars 34 forks source link

Closes #42. Add in an Azkaban runner to support running Dynamometer as a HadoopJavaJob. #44

Closed xkrogen closed 6 years ago

oliverhu commented 6 years ago

It might be better to create a new AZ jobtype for Dynamometer ?

xkrogen commented 6 years ago

@oliverhu - I considered that, but it seems too heavy-weight for this. It would require changes to the Azkaban Plugins repo, which we don't own. Also, we require very little functionality, so the HadoopJavaJob type suffices. If Dynamometer becomes pretty widely accepted, I would say that it would be worth adding it to Azkaban itself, but in the mean time I think it makes sense for us to maintain this code on our own.