SQS input failing to pull whole message when payload contains multiple json objects. Only first object returned.

[whume]

Please post all product and debugging questions on our forum. Your questions will reach our wider community members there, and if we confirm that there is a bug, then we can open a new issue here.

Currently running into an issue with polling SQS. The SQS message contains multiple JSON objects but SQS is only returning the first object. The issue is describe here as well I was looking to see if the fix was merged but did not see it in the sqs.rb file.

https://discuss.elastic.co/t/sqs-input-plugin-only-pulls-one-json-object-from-sqs-payload/50352

stdout shows the first json in the message but I cannot get the other json objects.

For all general issues, please provide the following details for fast resolution:

• Version: 3.1.1
• Operating System: Centos 7.3
• Config File (if you have sensitive info, please remove it): input { sqs { access_key_id => secret_access_key => region => queue => codec => "json" } } filter { mutate { add_field => {"awslogtype" => "AWSVPCFlowLogs"} } }

output { stdout {codec => rubydebug} tcp { host => "" port => 514 codec => json_lines

}

}

• Sample Data: {"obj1": 1} {"obj2": 2} {"obj3": 3}

I have also tried [{"obj1": 1},{"obj2": 2},{"obj3": 3}] and {"obj1": 1},{"obj2": 2},{"obj3": 3} and {"obj1": 1}{"obj2": 2}{"obj3": 3}

• Steps to Reproduce: Just add the messages to a SQS then look at the stdout

Thanks