search

linkedin / linkedin-gradle-plugin-for-apache-hadoop

Apache License 2.0
117 stars 76 forks source link

First commit for Hadoop automatic mode builds. This first commit auto… #182

Closed convexquad closed 7 years ago

convexquad commented 7 years ago

…matically builds the Hadoop DSL for every definition set in the given path.

convexquad commented 7 years ago

This is my first cut at automatic Hadoop Plugin builds. With this PR, in your build.gradle you just say:

hadoopZip {
  automatic { }
}

and it automatically sets hadoopZip { libPath="lib" } and sets a build task dependency on building the Hadoop Zips and compiling the Hadoop DSL. For every Gradle file in the folder src/main/definitions, it will rebuild the Hadoop DSL with that definition set and the user's Hadoop DSL profile. Tested successfully with the (internal to LinkedIn) metronome-examples multiproduct.

Next - automatically add one Hadoop zip per definitionSet file and add the compiled Hadoop DSL files for each definition set to the proper zip.

convexquad commented 7 years ago

First commit for #115