elastic / elastic-serverless-forwarder

Elastic Serverless Forwarder
Other
34 stars 34 forks source link

policy size limits - max 44 log groups you can add #731

Open ioancatana opened 1 week ago

ioancatana commented 1 week ago

I have tried to split log groups into 2 lists:

ElasticServerlessForwarderCloudWatchLogsEvents = join(",", formatlist("%s:*", slice(local.log_groups_list, 0, local.log_groups_half_index)))
ElasticServerlessForwarderCloudWatchLogsEvents2 = join(",", formatlist("%s:*", slice(local.log_groups_list, local.log_groups_half_index, local.log_groups_count)))

But is still creating only 1 policy: https://github.com/elastic/elastic-serverless-forwarder/blob/befdd23dca45624b10c18c7d17bc30a87e8d1d1a/.internal/aws/cloudformation/macro.yaml#L164

This should create a second policy and attach it to the role, because we can add a maximum of 44 log groups to one serverless deployment.

The previous issue should have fixed this: https://github.com/elastic/elastic-serverless-forwarder/issues/560 but it's not.

For confirmed bugs, please report:

error from CloudFormation: Resource handler returned message: "The final policy size (20906) is bigger than the limit (20480). (Service: Lambda, Status Code: 400, Request ID:****-b3c8-4363-adc0-****)" (RequestToken: ****-b3c8-4363-adc0-****, HandlerErrorCode: InvalidRequest)