Closed minh-nguyenquang closed 3 years ago
I manage to solve the issue by updating code in this PR https://github.com/fluent-plugins-nursery/fluent-plugin-cloudwatch-logs/pull/218/files
Funny coincidence - I came here to ask about this problem, and this issue was created a few hours ago.
Out of interest: is this a regression? Is it working in some earlier version?
@PaulRudin Config param log_group_name_prefix
was added recently https://github.com/fluent-plugins-nursery/fluent-plugin-cloudwatch-logs/pull/215. This PR was merged on Dec 8, 2020.
So I guess the earlier versions doesn't work even the current latest release is v0.13.0
So when I start trying config param log_group_name_prefix
with use_log_stream_name_prefix
I get above issue.
Problem
I try to pull logs from AWS Cloudwatch with log group prefix is
/aws/lambda/prefix_string
In every log group with prefix/aws/lambda/
, there are many log streams with naming convention2021/01/13[$LATEST]...
So my case is I have to set bothuse_log_group_name_prefix
anduse_log_stream_name_prefix
config parameters totrue
After deploy, I get this warning logSteps to replicate
Use this config to replicate the issue
Expected Behavior or What you need to ask
I'm be able to collect log from all logs streams with both
use_log_group_name_prefix
anduse_log_stream_name_prefix
config parameters are set totrue
Using Fluentd and CloudWatchLogs plugin versions