search

logstash-plugins / logstash-input-google_cloud_storage

Apache License 2.0
4 stars 9 forks source link

Feature request: prefix in bucket list. Limit list to specfic subdirectory #17

Open jalonsoa opened 3 years ago

jalonsoa commented 3 years ago

Hi, we have a bucket with many files from different applications and we want ingest only files from one directory. At this moment we can filter with include / exclude patterns, but we get the complete list of the bucket each interval.

We need a bucket_prefix option to limit lists to only this prefix.

I create a pull request with the changes #16

logicminds commented 2 years ago

Suffering from the same problem. We should be able to search the bucket instead of pull down everything and filter out what we don't want. Wonder if there is a query parameter.