[Improve] Improved application process control - Githubissues

apache / incubator-streampark

Make stream processing easier! Easy-to-use streaming application development framework and operation platform.

https://streampark.apache.org/

Apache License 2.0

3.91k stars 1.01k forks source link

[Improve] Improved application process control #4083

Closed lenoxzhao closed 1 month ago

lenoxzhao commented 1 month ago

What changes were proposed in this pull request

Brief change log

For Spark applications, used spark-workspace as the workspace to prevent conflicts with Flink workspace due to the same ID.
Provided exception information for failed task submissions.
Introduced Yarn FinalStatus to update failed state judgment.

Added Spark SQL demo.
Supported hadoopUser specification.

Verifying this change

This change is a trivial rework / code cleanup without any test coverage.

(or)

This change is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

Does this pull request potentially affect one of the following parts

Dependencies (does it add or upgrade a dependency): (yes / no)

sonarcloud[bot] commented 1 month ago

Quality Gate failed

Failed conditions
15.8% Duplication on New Code (required ≤ 3%)

See analysis details on SonarCloud