Be live during state clone for full replays

mit-pdos / noria

Fast web applications through dynamic, partially-stateful dataflow

Apache License 2.0

4.98k stars 242 forks source link

Be live during state clone for full replays #100

Open jonhoo opened 5 years ago

jonhoo commented 5 years ago

When we need to do a full replay, we currently do a synchronous clone of the source operator's state. This holds up processing other writes and backfills through that operator, which is sad. If we could find some kind of data-structure that allowed us to efficiently capture a snapshot of it which we could then use for the backfill, that'd be awesome!

jonhoo commented 5 years ago

@ekmartin has been thinking about this I think.