search

treasure-data / digdag

Workload Automation System
https://www.digdag.io/
Apache License 2.0
1.31k stars 221 forks source link

Fail when '_' is not used as a prefix as required for certain parameters #65

Closed rbparrish closed 8 years ago

rbparrish commented 8 years ago

When a user tries using a parameter that requires a '' at as a prefix, but doesn't include it, it should fail and mentioned the the '' is required.

For example, if a user doesn't include the '_' as a prefix in '_parallel', then the workflow is executed sequentially, but it's not necessarily obvious that it's not operating as the user expected.

frsyuki commented 8 years ago

Grouping tasks should also have a warning if local config is not used. But a problem is that grouping task doesn't run on an agent (io.digdag.core.agent.OperatorManager). This means that logging doesn't go through task logger. If task runs on a digdag-server, messages from grouping tasks won't be available from the client.

frsyuki commented 8 years ago

66 added validation.