linkedin / dynamometer

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.
BSD 2-Clause "Simplified" License
131 stars 34 forks source link

Add the ability to specify additional dependencies for containers #73

Closed xkrogen closed 5 years ago

xkrogen commented 5 years ago

Currently, the only Java dependency that is distributed to the containers is the dynamometer-infra.jar containing the Application Master. We may need to support arbitrary dependencies in the future, and in particular, Hadoop 3 support will require distributing the JUnit JAR to containers because MiniDFSCluster relies on JUnit. Add in generic support for dependencies, instead of the current method of assuming there is only a single JAR needed.