search

linkedin / linkedin-gradle-plugin-for-apache-hadoop

Apache License 2.0
117 stars 76 forks source link

Second PR for Yaml output for Flow 2.0 #200

Closed reallocf closed 6 years ago

reallocf commented 6 years ago

This is the second and final PR related to this issue: #193

This PR builds the interface users interact with to choose whether or not they want to output .flow/.project files or .job/.properties files. As stated in my prior PR (#196) the default is .job/.properties for now.

After this PR is merged (and subsequently released), users can specify that they want to output yaml by adding:

in the hadoop closure within their gradle files.

The change to existing code to make this happen is only ~75 lines, the other 500 lines added are from adding 4 end-to-end tests that confirm basic functionality for Flow 2.0. These tests mirror those done on the Azkaban side to confirm proper uploading.

reallocf commented 6 years ago

@nntnag17 have time to review this today? The actual code is small - it's mostly just tests. Thanks so much!