How to get logs for a specific range?

fluent-plugins-nursery / fluent-plugin-cloudwatch-logs

CloudWatch Logs Plugin for Fluentd

MIT License

201 stars 141 forks source link

How to get logs for a specific range? #173

Closed gcavalcante8808 closed 4 years ago

gcavalcante8808 commented 4 years ago

Problem

I'd like to get logs from a specific date range (startTime, endTime) and send to an fluentd output.

Steps to replicate

N/A

Expected Behavior or What you need to ask

N/A

Using Fluentd and CloudWatchLogs plugin versions

I'm using kubernetes with the image "gcr.io/google-containers/fluentd-elasticsearch:v2.4.0" and "fluent-plugin-cloudwatch-logs" installed

cosmo0920 commented 4 years ago

Currently, no way to handle it.

cosmo0920 commented 4 years ago

I think that this use case should be implemented with Embulk plugin and output file or something, and then, Fluentd tailing it.

cosmo0920 commented 4 years ago

I'd reconsidered about this. This feature request is reasonable for me but, in the future, we should provide CloudWatchLogs plugin for Embulk which is able to specify time range draining logs from CloudWatchLogs.