logstash-plugins / logstash-input-s3

Apache License 2.0
57 stars 150 forks source link

Optionally include object properties inside of [@metadata][s3] #155

Closed brandonwestcott closed 6 years ago

brandonwestcott commented 6 years ago

This is a proposal to add a new configuration option include_object_properties that allows passing through the S3 object properties such as etag, content_type, content_encoding, metadata into the [metadata][s3]hash that already exists today.

For an example use case: we have a number of s3 objects with metadata that we want to use inside our logstash pipeline to target different elastic indices.

brandonwestcott commented 6 years ago

~Hello, have been trying to reproduce the error from travis, but haven't been able to locally. Even explicitly using the same seed doesn't cause a failure. Is this potentially a random / intermittent spec failure?~

The rebuild passed, thank you!

elasticsearch-bot commented 6 years ago

Rob Bavey merged this into the following branches!

Branch Commits
master 36e6eb5b7d01f311c1831b84b5b5b1f23eaebdce