snowplow / dataflow-runner

Run templatable playbooks of Hadoop/Spark/et al jobs on Amazon EMR
http://snowplowanalytics.com
19 stars 8 forks source link

Add file-based locking #20

Closed alexanderdean closed 7 years ago

alexanderdean commented 7 years ago

This lets us run specific jobs as singletons, to prevent overlapping runs.

See also: #17, #30