ILM | To be able to keep the data exactly x days, and no longer, but not with daily rollover

elastic / elasticsearch

Free and Open Source, Distributed, RESTful Search Engine

https://www.elastic.co/products/elasticsearch

Other

69.94k stars 24.74k forks source link

ILM | To be able to keep the data exactly x days, and no longer, but not with daily rollover #76485

Open JohannesMahne opened 3 years ago

JohannesMahne commented 3 years ago

Due to regulatory reasons, a user might only be allowed to keep data for 30 days. With low throughput and properly configured redundancy, a small cluster would be wasting a lot of JVM heap space by having lots of small daily shards.

The request is, to have a mechanism to keep data only for a maximum number of days, within ILM.

elasticmachine commented 3 years ago

Pinging @elastic/es-core-features (Team:Core/Features)