matanolabs / matano

Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS
https://matano.dev
Apache License 2.0
1.44k stars 97 forks source link

Support `key_pattern` in addition to `key_prefix` as an alterantive for advanced use cases when BYO bucket #90

Closed shaeqahmed closed 1 year ago

shaeqahmed commented 1 year ago

Sometimes your data across log sources is not written to a dedicate key prefix for each log source. To enable more advanced use cases, we can allow supplying a key_pattern instead which will be used to match the incoming object based on a known pattern (e.g. r'.*AWSLogs.*')