treasure-data / digdag

Workload Automation System
https://www.digdag.io/
Apache License 2.0
1.3k stars 221 forks source link

workflow per file and digdag.yml #45

Closed frsyuki closed 8 years ago

frsyuki commented 8 years ago

Design:

$ digdag init <name> creates digdag.yml and <name>.yml files in <name> directory as following:

# digdag.yml
name: <name>
workflows:
  - <name>.yml
# <name>.yml
+step1:
  sh>: some example here...
+step2:
  sh>: some example here...

All digdag commands (run, push, etc.) use digdag.yml as the entry point.

name section in digdag.yml is the name of project. Name of a workflow matches with the file name (so workflow yml files don't need name section).

digdag push doesn't require -f option. It reads ./digdag.yml.

frsyuki commented 8 years ago

this will need workflow-per-file branch and some more code to ProjectArchive and ProjectArchiveLoader.