search

apache / dolphinscheduler

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
https://dolphinscheduler.apache.org/
Apache License 2.0
12.68k stars 4.57k forks source link

[Improvement][datax] datax task support passing context parameters to downstream task #15231

Open alextinng opened 9 months ago

alextinng commented 9 months ago

Search before asking

Description

mostly I defined a context parameter to get date or some constants, however sometimes I get parameters from calculation, such as a unix timestamp. it's easy using shell task as dolphinscheduler support transferring parameter between shell,python and sql task, but it gets difficult when using datax task(also other task does not support transferring parameter).

Are you willing to submit a PR?

Code of Conduct

fuchanghai commented 9 months ago

hi @alextinng do you want to fix it by yourself? if not i will fix it

alextinng commented 9 months ago

mostly I defined a context parameter to get date or some constants, however sometimes I get parameters from calculation, such as a unix timestamp. it's easy using shell task as dolphinscheduler support transferring parameter between shell,python and sql task, but it gets difficult when using datax task(also other task does not support transferring parameter).

@fuchanghai I will not fix it, you could fix it