Journalling of input batches - Githubissues

kaskada-ai / kaskada

Modern, open-source event-processing

https://kaskada.io/

Apache License 2.0

348 stars 15 forks source link

Journalling of input batches #841

Open bjchambers opened 10 months ago

bjchambers commented 10 months ago

[ ] Write batches to a journal
[ ] Recover batches from the journal
[ ] Checkpoint journal segments to a "prepared" file
[ ] Prepare files directly to journal checkpoints
[ ] Sources for reading from the input journal / checkpoints