Spark supports spark.conf parameters to configure multiple parameters - Githubissues

apache / linkis

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

https://linkis.apache.org/

Apache License 2.0

3.29k stars 1.16k forks source link

Spark supports spark.conf parameters to configure multiple parameters #4935

Closed peacewong closed 10 months ago

peacewong commented 11 months ago

What is the purpose of the change

Spark supports spark.conf parameters to configure multiple parameters

Related issues/PRs

Related issues: #4881

Brief change log

Added logs for the ask engine stage
optimize hive task progress
Supports spark.conf parameters to configure multiple parameters
Python supports killing subprocesses
Spark supports printing parameters to task logs

Checklist

[x] I have read the Contributing Guidelines on pull requests.
[ ] I have explained the need for this PR and the problem it solves
[ ] I have explained the changes or the new features added to this PR
[ ] I have added tests corresponding to this change
[ ] I have updated the documentation to reflect this change
[ ] I have verified that this change is backward compatible (If not, please discuss on the Linkis mailing list first)
[ ] If this is a code change: I have written unit tests to fully verify the new behavior.