[SQS] Support message size over 256KB

[starred-gijs]

Just a quick question: do you have any plans to create an extended SQS client that will support messages over 256KB (by storing the message body on S3), like this Java client? https://docs.aws.amazon.com/AWSSimpleQueueService/latest/SQSDeveloperGuide/sqs-s3-messages.html

[Nyholm]

Hm. This is interesting.

It sounds like we should add an integration for SQS that supports this. I guess we should override the send and receive methods. Similar to SimpleS3.

[GromNaN]

The Java implementation is here: amazon-sqs-java-extended-client-lib

Notes from this implementation:

• The message size threshold to be used for storing in Amazon S3 is 256KB by default.
• Deleting the S3 object can be part of deleting the message from SQS queue. Otherwise, its the responsibility to the message producer to handle the clean up appropriately.
• There is some restrictions on message attributes (reserved name and total size).
• Usage of S3 to store message body can be automatic for large payloads, or for all messages.