Closed bartelink closed 10 months ago
Implemented in #238 - Cosmos now has a parallel impl of the Feed structures, and the FeedMonitor and interfaces live in the main Propulsion module
This opens up the chance to unify Propulsion.Kafka too. The Ingester/Submitter pieces and checkpointing responsibilities are currently 'where they landed'; this ad hoc structure can, with some thought, likely be simplified.
The chances are the changes will be relatively minor in terms of surface API impact; the payoff will be in being able to e.g. look at the Kafka impl (which can checkpoint via a synchronous write to an offset property), and contrast it with Cosmos and/or the Feed-based ones.
In order to be able to wait for reactions to complete In order to be able to stop runs of tools when the associated checkpoint has caught up As a dev, I want to be able to do a
RunUntilCaughtUp
and/orMonitor.AwaitCompletion
as I can for the other storesCosmos doesn't yet implement a Monitor for various reasons:
Ideas
One consideration is there's different SLA expectations depending on the use case, e.g.