gchq / sleeper

A cloud-native, serverless, scalable, cheap key-value store
Apache License 2.0
53 stars 11 forks source link

Logic to delete old state store transactions #2752

Closed patchwork01 closed 1 week ago

patchwork01 commented 1 week ago

Background

Split from:

Description

We'd like to add a way to delete old state store transactions. This should include any transactions that are old enough that they are unlikely to be read. This should exclude any transactions that are more recent than the latest snapshot.

We will follow up with a separate issue to apply this in DynamoDB.

Analysis

See analysis on https://github.com/gchq/sleeper/issues/2640.

We can use an in-memory implementation of the transaction log store to unit test this before we implement it in DynamoDB.