matanolabs / matano

Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS
https://matano.dev
Apache License 2.0
1.42k stars 98 forks source link

Feature Request: Request for having a config option to set the log retention (cloudwatch, S3 Objects) #140

Open rams3sh opened 1 year ago

rams3sh commented 1 year ago

Request pertains to having an option as part of matano.config.yml for setting expiry to logs that are created by and generated from matano. The scope of request includes the following :-

  1. Cloudwatch Logs (from lambdas) Expiry
  2. S3 Bucket (Ingestion Bucket, Athena results etc..) Lifecycle Policy

This option will help comply with org's log retention policies and also in saving cost incurred from accumulation of huge amount of logs in longer run.