search

logstash-plugins / logstash-output-sqs

Apache License 2.0
4 stars 22 forks source link

Dynamic batch_size #11

Closed NoumanSaleem closed 7 years ago

NoumanSaleem commented 8 years ago

Feature request for dynamic batch_size to work around SQS limitation of batch size max == single message size max

http://docs.aws.amazon.com/sdkforruby/api/Aws/SQS/Client.html#send_message_batch-instance_method

The maximum allowed individual message size is 256 KB (262,144 bytes). The maximum total payload size (i.e., the sum of all a batch's individual message lengths) is also 256 KB (262,144 bytes).

related issue: https://github.com/logstash-plugins/logstash-output-sqs/issues/10

ph commented 7 years ago

Since 4.0.0, there is a check in place for ajusting the batch size.