[Improvement][Task Plugin] Make task plugin loading configurable

apache / dolphinscheduler

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

https://dolphinscheduler.apache.org/

Apache License 2.0

12.7k stars 4.58k forks source link

[Improvement][Task Plugin] Make task plugin loading configurable #12959

Open EricGao888 opened 1 year ago

EricGao888 commented 1 year ago

Search before asking

[X] I had searched in the issues and found no similar feature requirement.

Description

Many users does not need all of DS task plugins. It would be handy if they could configure what to pick through configurations.

Are you willing to submit a PR?

[X] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

github-actions[bot] commented 1 year ago

Thank you for your feedback, we have received your issue, Please wait patiently for a reply.

In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
If you haven't received a reply for a long time, you can join our slack and send your question to channel #troubleshooting

jieguangzhou commented 1 year ago

Good idea, can we config that in the Web server?

EricGao888 commented 1 year ago

Good idea, can we config that in the Web server?

No, currently we can't. It is easy to choose what not to load from the backend part. But I have no idea how to make it work for the front-end part. May I ask whether you have any ideas? @songjianet @Amy0104 @devosend

fuchanghai commented 1 year ago

Good idea, can we config that in the Web server?

No, currently we can't. It is easy to choose what not to load from the backend part. But I have no idea how to make it work for the front-end part. May I ask whether you have any ideas? @songjianet @Amy0104 @devosend

can we storage plugin name in DB that user does not need? ,when we start the application filter that

EricGao888 commented 1 year ago

Good idea, can we config that in the Web server?

No, currently we can't. It is easy to choose what not to load from the backend part. But I have no idea how to make it work for the front-end part. May I ask whether you have any ideas? @songjianet @Amy0104 @devosend

can we storage plugin name in DB that user does not need? ,when we start the application filter that

I was planning to do it with configurations instead of adding more interactions with DB. For example, users could provide a list of plugins they want to use in common.properties or application.yaml, and TaskPluginManager will only load these types.