brexhq / substation

Substation is a toolkit for routing, normalizing, and enriching security event and audit logs.
https://substation.readme.io
MIT License
330 stars 21 forks source link

Kinesis Firehose Transformation Support #115

Closed jshlbrd closed 1 year ago

jshlbrd commented 1 year ago

Is your feature request related to a problem? Please describe. The Kinesis Firehose service can invoke a Lambda to perform data transformation -- is it possible to add support for this ein the AWS Lambda app?

Describe the solution you'd like The AWS Lambda for Go repository has an example function for transforming data in Firehose, I think something similar can be built without adding new internal code by using the inter-process communication setting of the gRPC sink. This may even be possible by copying the code from the synchronous Lambda ingest function.

Describe alternatives you've considered N/A

Additional context N/A

jshlbrd commented 1 year ago

This is in v1.0.0.