search

influxdata / influxdb

Scalable datastore for metrics, events, and real-time analytics
https://influxdata.com
Apache License 2.0
28.17k stars 3.51k forks source link

Pull persisted parquet files out of segment state #25105

Closed pauldix closed 3 days ago

pauldix commented 4 days ago

Segment state should be for the real time ingestion buffer. That is, it should only be for data that has landed in the WAL and has yet to be persisted to object storage. Once it has been persisted to object storage, pointers to the parquet files should be moved into a separate structure.