awslabs / aws-c-s3

C99 library implementation for communicating with the S3 service, designed for maximizing throughput on high bandwidth EC2 instances.
Apache License 2.0
101 stars 41 forks source link

Pool buffers for upload #359

Closed DmitriyMusatkin closed 11 months ago

DmitriyMusatkin commented 1 year ago

Issue #, if available:

Description of changes: Current logic of recreating buffers for every part results in a lot of memory acquire/free cycles. since each meta request will have the same sized buffers for each part, just keep them around and reuse

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.