questdb / roadmap

QuestDB Public Roadmap
6 stars 0 forks source link

Partition attach/detach workflows via SQL command #4

Closed bluestreak01 closed 2 years ago

bluestreak01 commented 2 years ago

Summary

Implementation of the mechanics of taking arbitrary partition OFFLINE and back ONLINE. Fundamental building block for future automation of data retention and cold storage management (https://github.com/questdb/roadmap/issues/5).

Intended outcome

Make partition invisible to table via SQL. This operation should be reliable, consistent and non-blocking from TableReader point of view. When partition is taken offline the relevant structures should be maintained such as if partition was never there. Similarly when partition is brought back online, everything works as if this data was inserted natively. Obviously without an overhead of inserting data again.