koralium / flowtide

Streaming integration engine
https://koralium.github.io/flowtide/
Apache License 2.0
28 stars 2 forks source link

Add support for an append only B+ tree as a storage solution #475

Closed Ulimo closed 3 months ago

Ulimo commented 3 months ago

When implementing a distributed runtime there will be cases where having an append only log will be beneficial to store a log of events.

This storage should allow Append which appends to the most right page in the tree. It should also be able to do compaction where it removes entries from the most left page. Finally it should be possible to search the tree based on key.