cherweg / logstash-input-s3-sns-sqs

logstash input downloading files from s3 Bucket by OjectKey from SNS/SQS
Other
29 stars 35 forks source link

Issue in logger #25

Closed danielkasen closed 5 years ago

danielkasen commented 5 years ago

Looks like the logger creates 2 message fields. This can cause issues if you try to index the logstash log as well. It'll complain about a duplicate message field

{"level":"INFO","loggerName":"logstash.inputs.s3snssqs","timeMillis":1566239962207,"thread":"Ruby-0-Thread-4991: /usr/share/logstash/vendor/bundle/jruby/2.3.0/gems/aws-sdk-resources-2.11.177/lib/aws-sdk-resources/services/sqs/queue_poller.rb:331","logEvent":{"message":"Extending visibility for message","message":{"metaClass":{"metaClass":{"metaClass":{"message":"#<struct Aws::SQS::Types::Message message_id=\"

The error: Duplicate field 'message'\n at [Source: org.elasticsearch.common.bytes.BytesReference$MarkSupportingStreamInputWrapper@224c9d3d; line: 1, column: 314]