apache / linkis

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
https://linkis.apache.org/
Apache License 2.0
3.27k stars 1.15k forks source link

[Feature][1.5.0] flink loads env.java.opts configuration #5012

Closed yangwenzea closed 7 months ago

yangwenzea commented 7 months ago

Search before asking

Problem Description

The current streaming Flink job does not record GC logs, making it impossible to view GC related information. In order to solve this problem, the flink engine loads the env.java.opts configuration in flink-config.yaml. The parameter with the same name submitted by the streamis job has a higher priority than the env.java.opts value of the default configuration file, and must be deduplicated.

Description

flink loads env.java.opts configuration

Use case

No response

Solutions

In FlinkisEngineConnFactory, first read the default flink-config.yaml file in the service and obtain the value of the env.java.opts parameter. Get the user's env.java.opts, split it first by spaces, and then by equal signs. If there are duplicates, replace them with the user's values. If there are no duplicates, add them after the parameters.

Anything else

No response

Are you willing to submit a PR?

github-actions[bot] commented 7 months ago

:blush: Welcome to the Apache Linkis community!!

We are glad that you are contributing by opening this issue.

Please make sure to include all the relevant context. We will be here shortly.

If you are interested in contributing to our website project, please let us know! You can check out our contributing guide on :point_right: How to Participate in Project Contribution.

Community

WeChat Assistant WeChat Public Account

Mailing Lists

Name Description Subscribe Unsubscribe Archive
dev@linkis.apache.org community activity information subscribe unsubscribe archive