aws / aws-for-fluent-bit

The source of the amazon/aws-for-fluent-bit container image
Apache License 2.0
446 stars 133 forks source link

FEATURE REQUEST - Kinesis Input Plugin #852

Open justinhauer opened 3 weeks ago

justinhauer commented 3 weeks ago

Describe the question/issue

I have a request for an input plugin for fluent bit from kinesis data streams. Output plugins exist but it would be great to take in logs that are coming from a streaming buffer, kinesis data streams. Because there is not a direct ingestion from kinesis, shim code needs to accompany fluent to make this work (lambda).

Configuration

Not Relevant

Fluent Bit Log Output

Not relevant

Fluent Bit Version Info

Not Relevant

Cluster Details

justinhauer commented 3 weeks ago

@PettitWesley I read your firelens article from a few years back, nice work. it would be really, really amazing if AWS supported something like firelens more natively for all of the 'table stakes' compute platforms as well (lambda, ec2, eks). Does this request belong in this repo or is this more of an up stream fluent bit feature request?