criteo / biggraphite

Simple Scalable Time Series Database
Apache License 2.0
129 stars 36 forks source link

Reduce TTL for existing data #588

Closed zerosoul13 closed 2 years ago

zerosoul13 commented 2 years ago

Hello BigGraphite team,

We would like to reduce the TTL for metrics. The original retention is 300s:30d,900s:2y and we would like to reduce it to 300s:30d,900s:1y.

Is this possible or would it fall into the same case as https://github.com/criteo/biggraphite/issues/575?

Thank you

geobeau commented 2 years ago

It's not great but you can trick biggraphite. The TTLs are handled by Cassandra, so you can modify the default_time_to_live of the table in question, the retention will still officially be 2y but in practice data will be discarded earlier

geobeau commented 2 years ago

@zerosoul13 did it work?

zerosoul13 commented 2 years ago

@geobeau Thank you for the follow-up. Our team didn't go through with the approach. It sounds safe, but I didn't want to risk any impact on the dataset.

geobeau commented 2 years ago

How much data do you have? Another solution is to: