fluent / fluent-plugin-s3

Amazon S3 input and output plugin for Fluentd
https://docs.fluentd.org/output/s3
314 stars 217 forks source link

enable multiline parsing #429

Open valentinacala opened 1 year ago

valentinacala commented 1 year ago

Is your feature request related to a problem? Please describe.

I noticed me and many users are wondering to be able to recognize logs that are on many lines.

Currently any plugin seemes to satisfy the thing, because:

Describe the solution you'd like

I propose to embed the multiline parser in the fluent-plugin-s3 as it works for in_tail input

Describe alternatives you've considered

I tried the flluent-plugin-concat plugin, but it ignore the multiline_start_regexp if it is not specified a fixed number of lines

I tried also applying the multiline parser with S3 source, but I got error

Additional context

No response