aws-samples / aws-lambda-extensions

A collection of sample extensions to help you get started with AWS Lambda Extensions
MIT No Attribution
446 stars 146 forks source link

Fluent Bit Lambda Extensions Example added #42

Closed youngjeong46 closed 1 year ago

youngjeong46 commented 3 years ago

Issue #, if available:

Description of changes:

Added extensions example for Fluent-Bit. Requesting Code Review.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

r0mdau commented 2 years ago

Thanks for this example.

Have you planned (or discussed with fluentbit maintainers) to develop directly a input plugin in fluentbit that implement the lambda logs API ?

PettitWesley commented 2 years ago

NOTE: For folks who find this and wonder why we abandoned it, it was because the extension tended to lose logs when the lambda function was invoked repeatedly with a very short runtime. It is possible that this solution can work well if you know that your function will always execute for at least 1 second.

@r0mdau We discussed building native support in FB but that would require a lot more work. It's very non-trivial.

julianwood commented 1 year ago

Closing based on submitter comments.