WallarooLabs / wally

Distributed Stream Processing
https://www.wallaroolabs.com
Apache License 2.0
1.48k stars 69 forks source link

Expand checkpoint id logging #3060

Closed slfritchie closed 4 years ago

slfritchie commented 4 years ago

Prior to this commit, we would only store 2 pieces of info for local checkpoint state:

  1. last committed checkpoint #
  2. rollback checkpoint #

This commit adds a 3rd integer: current checkpoint #. Its purpose is to avoid reusing checkpoint #s, despite possible crashes by the initializer worker.

Fixes #3032