questdb / roadmap

QuestDB Public Roadmap
6 stars 0 forks source link

Partition by hour #20

Closed bluestreak01 closed 2 years ago

bluestreak01 commented 2 years ago

Summary

In some cases daily data volumes can exceed manageable block sizes. For example ingesting 10Bn records daily could put strain on O3 algorithm. It would be prudent to divide daily data further, perhaps hours or even minutes.

Expected outcome

New partition classifier such as HOUR. The data would be automatically partitioned into directories formatted as YYYT-MM-DDTHH.

bsmth commented 2 years ago

This was done in https://github.com/questdb/questdb/pull/1571

puzpuzpuz commented 2 years ago

This one was released in 6.1.2, so we could close the issue.

bluestreak01 commented 2 years ago

We add “shipped” label instead

lucgirardin commented 2 years ago

For my purpose, it would be useful to by able to partition by week!

gabrielmocan commented 1 year ago

For my purpose, it would be useful to by able to partition by week!

It is possible, docs were updated recently.