dendro-monitoring / dendro

Dendro is an open-source, serverless monitoring framework for small, distributed applications. Stream logs and metrics from your various servers to a central time-series store, then explore using our default dashboards and set up alerting!
MIT License
4 stars 0 forks source link

Timestream data retention #61

Closed AndiLavera closed 3 years ago

AndiLavera commented 3 years ago

Each timestream table is set to store data 30 days in memory & 30 days on disk. This should be changed to 7 days for memory & something like 2-5 years for magnetic? @nlicalzi What are you thoughts?

nlicalzi commented 3 years ago

Yeah I think 7 days in memory is good, and we can make that the limit/timespan for our custom dashboards so we're not doing slow queries to populate those

AndiLavera commented 3 years ago

Cool. What do you think the magnet retention rate should be?

nlicalzi commented 3 years ago

Good question, we should do some estimating and costing for that. I'd say a year, so you can look at yearly performance since promotions and raises are on a yearly cycle and if you're hitting your SLAs you'll want to bring that up 😛