awslabs / payload-offloading-java-common-lib-for-aws

Shared library between AWS extended messaging clients to manage payloads larger than their limits.
Apache License 2.0
32 stars 15 forks source link

Add delete payload batch feature. #57

Open richardsmithsfdc opened 6 months ago

richardsmithsfdc commented 6 months ago

Issue #, if available:

Description of changes:

Add ability to delete a batch of offloaded payloads. By using S3 DeleteObjects, it can reduce the number of separate calls to S3 to one-per-bucket, which should improve efficiency.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

richardsmithsfdc commented 6 months ago

@ziyanli-amazon , can you take a look at this PR, and the related PR https://github.com/awslabs/amazon-sqs-java-extended-client-lib/pull/148 . I'm trying to fix that issue I pointed out when the sync/async delete in SQS extended client have slightly different behavior. This batch delete operation is something we are currently using in our code.