brexhq / substation

Substation is a toolkit for routing, normalizing, and enriching security event and audit logs.
https://substation.readme.io
MIT License
330 stars 21 forks source link

build: S3 Rehydration Python Script #99

Closed jshlbrd closed 1 year ago

jshlbrd commented 1 year ago

Description

Motivation and Context

This addresses a use case where teams need to rehydrate (re-ingest) data from an S3 bucket into Substation. No new infrastructure is required to use this (if the team is already using SNS notifications for S3), the script simulates the object notification that S3 sends to Lambda.

How Has This Been Tested?

Integration tested in a development AWS account using an S3 bucket, SNS topic, and Substation Lambda running the AWS_S3_SNS handler.

Types of changes

Checklist: