apache / dolphinscheduler

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
https://dolphinscheduler.apache.org/
Apache License 2.0
12.88k stars 4.63k forks source link

[Improvement][Helm Chart] Support HDFS HA #16390

Open JonasGao opened 3 months ago

JonasGao commented 3 months ago

Search before asking

Description

The helm chart support HDFS HA.

Use case

Now, the config option has "resource.hdfs.fs.defaultFS". And the comment say "if resource.storage.type=HDFS and namenode HA is enabled, you need to copy core-site.xml and hdfs-site.xml to conf dir", but the template not use the "conf" dir or "config" dir. The pod only mount common.properties.

I want some ways to support HDFS enabled HA. Maybe some option for the xml files in common.properties, or some mount.

And, i m using HDFS deployed by stackable hdfs operator, the core-site.xml and hdfs-site.xml are ConfigMaps. Maybe some way can use this.

Related issues

No response

Are you willing to submit a PR?

Code of Conduct