flitnetics / jaeger-objectstorage

Jaeger plugin for object storage datastore
Apache License 2.0
47 stars 7 forks source link

Retention Period #60

Closed sherifkayad closed 2 years ago

sherifkayad commented 2 years ago

How can one manage the desired retention period? let's assume I am only interested in keeping the trace data only for 14 days or say 30 days and then the data should be deleted from S3 .. how can we manage that?

muhammadn commented 2 years ago

This would be an interesting feature. Internally we leverage on loki (boltdb-shipper) which in turn leverages on cortex so to interface with s3.

We did work on the "compactor" - which is what you want but there still needs some work on this and we're still working out a new release.

muhammadn commented 2 years ago

@sherifkayad I've released v1.2.2 (sorry i mistakenly set the packages/docker to private and should be public), with a more complete implementation of the compactor.

More info on configuring retention is here.