search

snowplow / dataflow-runner

Run templatable playbooks of Hadoop/Spark/et al jobs on Amazon EMR
http://snowplowanalytics.com
19 stars 8 forks source link

Add timeWithFormat template function #18

Closed alexanderdean closed 7 years ago

alexanderdean commented 7 years ago

Was: Allow a variable to be defined once and reused

The template function should be:

{{timeWithFormat epochMs timestamp}}

Example:

"--dest","s3n://foo/bar/run={{timeWithFormat 1494930397 "2006-01-02-15-04-05"}}/",
alexanderdean commented 7 years ago

Hmm, maybe I am thinking about this wrong. Maybe we just need to add {{timeWithFormat epochMs timestamp}} and then you pass in your epochMs on the command line as a --var.

https://github.com/snowplow/dataflow-runner/wiki/Guide-for-analysts#templates