warpstreamlabs / bento

Fancy stream processing made operationally mundane. This repository is a fork of the original project before the license was changed.
https://warpstreamlabs.github.io/bento/
Other
1.06k stars 71 forks source link

add sqs large message compatible client to input aws_sqs #172

Open jem-davies opened 4 days ago

gregfurman commented 4 days ago

This is looking great! Can you add a test to the sqs integration test suite (with this large bucket option enabled) testing against LocalStack?

I'm thinking maybe pre-populate the SQS queue with some data that is more than 256Kb and let's see if this bad-boy works ðŸ¤