search

globocom / gcloud-utils

Global package for Cloud Management in Python
https://gcloud-utils.readthedocs.io/en/latest/
Apache License 2.0
16 stars 23 forks source link

Allow passing Spark job properties when submitting it to DataProc #7

Closed ffmmjj closed 5 years ago

ffmmjj commented 5 years ago

This PR makes it possible to call Dataproc.submit_job() passing a properties arguments (which is None by default to keep the method backwards compatible) to it.

These properties will be passed as the Spark job properties field that is described in this link to the documentation.