linkedin / linkedin-gradle-plugin-for-apache-hadoop

Apache License 2.0
117 stars 76 forks source link

Hadoop DSL SparkJob should support namedAppParams construct #111

Open convexquad opened 8 years ago

convexquad commented 8 years ago

Currently you declare the arguments to a Hadoop DSL SparkJob using "appParams" where you just list the job arguments directly.

Another way to do this would be to support "namedAppParams" that takes a list of keys for job properties that you have already set on the job and looks up their corresponding values as the values to use for the job argument. This can thrown an error if you haven't declared the given key for the job.