fluent-plugins-nursery / fluent-plugin-cloudwatch-logs

CloudWatch Logs Plugin for Fluentd
MIT License
201 stars 141 forks source link

How do I use retention_in_days configurations #245

Open mukundjalan opened 2 years ago

mukundjalan commented 2 years ago

Problem

We have used these configurations to create the cloudwatch groups. Now we wish to update the retention period in all the places using the retention_in_days config. I updated the config map in kubernetes, but it had no impact. I am unable to understand if retention_in_days works only on create or am I using it wrongly for update.

While searching, I came across retention_in_days_key. From the description use specified field of records as retention period, I am unable to make any use of it. Also, there seems to be no example or additional documentation related to the same.

Expected Behavior or What you need to ask

I would like to know how can I update the cloudwatch log retention period by updating the fluentd configuration config map

hfinucane commented 2 years ago

Check your logs for something like

failed to flush the buffer. retry_times=0 next_retry_time=2022-08-04 21:36:46 +0000 chunk="5e5712512d03a1ab530441bceee19785" error_class=Aws::CloudWatchLogs::Errors::AccessDeniedException error="User:blahblahblah is not authorized to perform: logs:PutRetentionPolicy on resource: arn:aws:logs:yadayadayada: because no identity-based policy allows the logs:PutRetentionPolicy action"

Fluentd is going to need the logs:PutRetentionPolicy permission bit set to write that.