[Utility][Persistence][Consensus] Implement SavePoints & Rollbacks

[deblasis]

Objective

This issue is going to be an "umbrella" ticket/epic used to wrap and link all the intermediate steps/deliverables that are necessary to build Savepoints and Rollbacks as highlighted in the Design Document - Issue #493

Origin Document

This is the result of R&D work on #508 which was essentially asking the assignee to build savepoints and rollbacks, just with a different wording thanks to a more "practical" problem to solve.

Goals

• Implement an abstraction that can contain the operations performed on the various persistence datastores (as described in the design document) and apply/rollback them atomically
• Implement a way to serialize and deserialize the whole persistence state so that's possible to create snapshots and rehydrate them
• Implement the Moonshot parts of the design document (perhaps out-of-scope for now? I won't include the deliverables below but please let me know if I should)
• Ensure that the state of the modules is restored in case of a rollback

Deliverable

• Work stream A
  • [x] #563
  • [ ] #327
  • [ ] #564
  • [ ] #435
  • [ ] #567
  • [ ] #568
• Work stream B
  • [ ] #565
  • [ ] #566
• Work stream AB (when A & B are completed)
  • [ ] #570
  • [?] Moonshots TBD

Non-goals / Non-deliverables

• Changes in logic with particular focus to Consensus

General issue deliverables

• [ ] Update the appropriate CHANGELOG(s)
• [ ] Update any relevant local/global README(s)
• [ ] Update relevant source code tree explanations
• [ ] Add or update any relevant or supporting mermaid diagrams

Testing Methodology

• [ ] Task specific tests or benchmarks: make ...
• [ ] New tests or benchmarks: make ...
• [ ] All tests: make test_all
• [ ] LocalNet: verify a LocalNet is still functioning correctly by following the instructions at docs/development/README.md

---

Creator: @deblasis Co-Owners: @Olshansk

[Olshansk]

Implement the Moonshot parts of the design document (perhaps out-of-scope for now? I won't include the deliverables below but please let me know if I should)

@deblasis This is a goal? Are you implying that it's a stretch goal that may be possible, but you don't want to make it one of the deliverables?

[deblasis]

@deblasis This is a goal? Are you implying that it's a stretch goal that may be possible, but you don't want to make it one of the deliverables?

The goal was to have a discussion about it and here we are :) I was meant to raise this yesterday but I forgot.

I think that the moonshot part should be a separate issue in the backlog.

Thoughts?

[Olshansk]

I think that the moonshot part should be a separate issue in the backlog.

Agreed.

---

Side note: I accidentally just discovered that if I highlight part of your message and click "quote reply", it only quotes the part that I highlighted.