xichen2020 / eventdb

Storage for discrete events such as log events or tracing events
Apache License 2.0
9 stars 1 forks source link

Query immutable segments #157

Closed xichen2020 closed 5 years ago

xichen2020 commented 5 years ago

cc @black-adder @cw9 @notbdu

This PR decouples segment implementation, storage implementation, and query execution for better separation of concerns. Additionally it changes the ingestion logic to convert each batch of writes as a new segment, and only queries immutable segments during query execution to completely remove contention during reads and writes.