add blob prefix support

aksakalmustafa commented 2 years ago

Release notes

What does this PR do?

Adds blob prefix support to listing storage objects with blob_prefix config

Why is it important/What is the impact to the user?

Checklist

[x] My code follows the style guidelines of this project
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have made corresponding changes to the documentation
[ ] I have made corresponding change to the default configuration files (and/or docker env variables)
[ ] I have added tests that prove my fix is effective or that my feature works

Author's Checklist

[x] My code doesn't break existing features
[x] When blob_prefix config is specified, only prefixed blobs are listed

How to test this PR locally

Related issues

Use cases

Screenshots

Logs

cla-checker-service[bot] commented 2 years ago

💚 CLA has been signed

aksakalmustafa commented 2 years ago

@jsvd CI is failing due to change 46ff388dd8c5470840b172eec92f8781aac786cb commit. Looks like the main branch is also failing. it is most probably related to the conflict between jruby & jar-dependencies dependency. ES 6.x is passing when jar-dependencies is 0.4.1. Who needs to address the CI issue? Thanks!

logstash-plugins / logstash-input-google_cloud_storage