apache / incubator-streampark

Make stream processing easier! Easy-to-use streaming application development framework and operation platform.
https://streampark.apache.org/
Apache License 2.0
3.91k stars 1.01k forks source link

[Feature] We need to keep the state of the jobs on the cluster consistent with the state of the jobs on the platform #3663

Open Mrart opened 7 months ago

Mrart commented 7 months ago

Search before asking

Description

  1. Synchronize the job status when the k8s/yarn cluster is abnormal
  2. If the operation is abnormal, the status can be synchronized to the platform
  3. After the platform is restarted, the job status can be synchronized

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

Code of Conduct

caicancai commented 7 months ago

@Mrart I am happy to participate in this part of the discussion. Do you have a corresponding solution? I also think this function is very important. I have also been trying to sort it out recently.