apache / incubator-streampark

Make stream processing easier! Easy-to-use streaming application development framework and operation platform.
https://streampark.apache.org/
Apache License 2.0
3.91k stars 1.01k forks source link

[Bug] application start without savepoint, the savepoint in job info detail won't updated #4074

Open wjcwin opened 2 months ago

wjcwin commented 2 months ago

Search before asking

Java Version

jdk8

Scala Version

2.12.x

StreamPark Version

2.1.4

Flink Version

1.15.0

deploy mode

kubernetes-application

What happened

application start without savepoint, the savepoint in job info detail won't updated(我将一个作业启动时不勾选从sp/cp启动后,作业是正常运行的,但是在作业的详情页里的savepoint里,ck不再更新了还是以前的,数据库里也看了,确实没更新)

Error Exception

No details are displayed in logs

Screenshots

image I suspect this is due to a method in this class that compares only the chkid completion time, not the chk completion time. After the job restarts without sp/cp, the checkpoint id starts from 1 (我怀疑是这个类的这个方法导致的,这个方法里只比较了chkid,而不是chk的完成时间,在作业无sp/cp重启后,checkpoint的id又是从1开始的)

Are you willing to submit PR?

Code of Conduct

wjcwin commented 2 months ago

this function maybe return not the flink job latestCheckpointId,is application history jobs latestCheckpointId (这个方法对应新的作业的jobid而言是没有缓存ck的,所以会返回这个application在数据库中存储的最新的checkpointId,但是这个是之前历史job的,不应该与当前job的checkpoint进行比较了) image