Move schema definitions out of template to avoid CFN template size limit

matanolabs / matano

Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS

https://matano.dev

Apache License 2.0

1.46k stars 100 forks source link

Move schema definitions out of template to avoid CFN template size limit #45

Closed Samrose-Ahmed closed 1 year ago

Samrose-Ahmed commented 1 year ago

Overview

We currently inline the table schema as a property in the CloudFormation template through CDK. Schemas can be quite long and when we have many tables, we'll run into the CFN 1MB template size limit.

Goals

Dont inline the schema as a property and instead have an asset publish asset file to S3 and use s3 path as property that the custom resource can download.

matanolabs / matano

Move schema definitions out of template to avoid CFN template size limit #45

Overview

Goals

Notes