apache / incubator-streampark

Make stream processing easier! Easy-to-use streaming application development framework and operation platform.
https://streampark.apache.org/
Apache License 2.0
3.91k stars 1.01k forks source link

[Bug] FlinkTrackController's trackIds, canceling, jobStatuses uniformly use appId as Key #1666

Open xinzhuxiansheng opened 2 years ago

xinzhuxiansheng commented 2 years ago

Search before asking

What happened

FlinkTrackController's trackIds, canceling, endpoints, jobStatuses uniformly use appId as Key.

FlinkTrackController 图片

trackIds,canceling use appId as key 图片

jobStatuses use TrackId as key 图片

StreamPark Version

1.2.4-SNAPSHOT

Java Version

No response

Flink Version

1.14.5

Scala Version of Flink

2.12

Error Exception

Only one job is run, and the size of the jobStatuses cache is 2

To explain its impact, `FlinkJobStatusWatcher.touchApplicationJob()`  When jobDetails.isEmpty || jobDetails.get.jobs.isEmpty condition is true, inferApplicationFlinkJobStateFromK8sEvent() will change from 
`val latest: JobStatusCV = trackController.jobStatuses.get(trackId)`
... 

Screenshots

图片

Are you willing to submit PR?

Code of Conduct

wolfboys commented 2 years ago

Thanks for your feedback, really a bug. welcome to fix it.