auto start from savepoint when upgrade the image?

GoogleCloudPlatform / flink-on-k8s-operator

[DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.

Apache License 2.0

658 stars 266 forks source link

auto start from savepoint when upgrade the image? #440

Open jiamo opened 3 years ago

jiamo commented 3 years ago

I custom build flink image with jars. at now for savepoints

  autoSavepointSeconds: 300
  restartPolicy: FromSavepointOnFailure

This is only for OnFailture. Can we auto restore from latest savepoint when I re apply yaml or upgrade the image for the job.(Which is not failture but normal code update)

elanv commented 3 years ago

It is already supported feature. note: https://github.com/GoogleCloudPlatform/flink-on-k8s-operator/blob/master/docs/user_guide.md#update-flink-clusters-and-jobs

But I think the update policy need to be elaborated more. PR #420 is created for that.

jiamo commented 3 years ago

Thanks.

I already pull some fixs branch (which not merged to master) to make 1.19 eks work. This PR #420 conflict so much. It is possible to make priority for these waiting pull request. We have release version. The master may be radical than now time

I also have a suggestion for this project to be more general for k8s not aim at GCP.