apache / dolphinscheduler

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
https://dolphinscheduler.apache.org/
Apache License 2.0
12.46k stars 4.51k forks source link

[Feature][API] Custom built-in parameters #8770

Open Weipleasure opened 2 years ago

Weipleasure commented 2 years ago

Search before asking

Description

中文描述: 【功能】【API】自定义内置参数 所有项目当中的工作流都可以获取到自定义的内置参数。

Use case

目前最新2.0.5版本提供内置参数都是基于T-1等相关的时间参数,但是金融行业(证券)相对特殊,定时跑批任务时间不是T-1(跑批时间参数不固定),而是交易日。由于每个工作流的时间参数都是一样的(上一个交易日),工作流之间的参数不能传递,只有在同一个工作流内部的参数才可以传递。因此,为了所有工作流的获取时间参数一样,我们在所有项目的每个工作流开始的第一个任务都是获取交易日,并设置为时间参数,作为参数传递下去。我们希望可以自定义内置参数,方便所有工作流获取。

Related issues

No response

Are you willing to submit a PR?

Code of Conduct

github-actions[bot] commented 2 years ago

Search before asking

Description

Chinese description: [Function] [API] Customize built-in parameters Workflows in all projects can get custom built-in parameters.

Use case

At present, the built-in parameters provided in the latest version 2.0.5 are based on T-1 and other related time parameters, but the financial industry (securities) is relatively special. The time for the scheduled batch running task is not T-1 (the batch running time parameter is not fixed), but trading day. Since the time parameters of each workflow are the same (the previous trading day), parameters between workflows cannot be passed, only parameters within the same workflow can be passed. Therefore, in order to obtain the same time parameter for all workflows, the first task we start in each workflow of all projects is to obtain the trading day, set it as the time parameter, and pass it on as a parameter. We hope that built-in parameters can be customized to facilitate access to all workflows.

Related issues

No response

Are you willing to submit a PR?

Code of Conduct

github-actions[bot] commented 2 years ago

Hi:

caishunfeng commented 2 years ago

@Weipleasure Good idea, can you add your design or what will you change to this issue description?

BTW, it's better to use the English first, which can make foreign developers also understand.