fluent-plugins-nursery / fluent-plugin-cloudwatch-logs

CloudWatch Logs Plugin for Fluentd
MIT License
201 stars 141 forks source link

Using a wildcard on log_stream name #252

Open yelaissaoui opened 1 year ago

yelaissaoui commented 1 year ago

Problem

I'm using the in_cloudwatch_logs to retrieve RDS logs from CW. I'm trying to retrieve logs from many databases, hence many log groups and log streams. Actually, the plugin only support the usage of prefixes for log_stream name. I'd like to retrieve all the log streams matching the log_group I've provided, is there a way to patch the code ?

log group: /aws/rds/instance//postgresql => Using "log_group /aws/rds/instance/" with prefix to true log_stream: -master.0 => wildcard on all RDS instances

Thanks ...

Using Fluentd and CloudWatchLogs plugin versions

jalvarez-outburst commented 1 year ago

I believe that implementing this feature would greatly improve the functionality of the project.