fluent-plugins-nursery / fluent-plugin-cloudwatch-logs

CloudWatch Logs Plugin for Fluentd
MIT License
201 stars 141 forks source link

read from all streams in source cloudwatch_logs #230

Closed markuman closed 3 years ago

markuman commented 3 years ago

Problem

We've got N streams. Is there a way to read from all streams instead to define explizit one streamname?

<source>
  @type cloudwatch_logs
  tag cloudwatch.in
  log_group_name fluentd/some_group
  log_stream_name *
  state_file fluent/some_group.state
</source>
markuman commented 3 years ago

Ok, it's possible


<source>
  @type cloudwatch_logs
  tag cloudwatch.in
  log_group_name fluentd/some_group
  use_log_stream_name_prefix true
  state_file fluent/some_group.state
</source>

https://github.com/fluent-plugins-nursery/fluent-plugin-cloudwatch-logs/pull/123#issuecomment-659305606