aws-samples / aws-lambda-extensions

A collection of sample extensions to help you get started with AWS Lambda Extensions
MIT No Attribution
445 stars 146 forks source link

[platform.logsDropped] Unable to process 1000 logs for each invocation #88

Open maxday opened 1 year ago

maxday commented 1 year ago

Hey team!

We're experiencing an issue while dealing with the Telemetry API when the function has 1k logs.

At some point, we're receiving a platform.logsDropped, likely because we're not succeeding to process the payload sent in a timely fashion (this is what I've understand from the doc)

To make it easier I've attached a PR with a full reproducer. If you invoke the function 10-30 times, you'll see a [dispatcher:Dispatch] LOG DROPPED! meaning that we have indeed received a platform.logsDropped

I've also tried different buffering options (playing with timeoutMs, maxBytes and maxItems) without any luck.

Thanks! Max