search

alexmojaki / s3-stream-upload

Manages streaming of data to AWS S3 without knowing the size beforehand and without keeping it all in memory or writing to disk.
MIT License
208 stars 62 forks source link

compressing input data before sending to s3 #5

Closed SanthoshPrasad closed 6 years ago

SanthoshPrasad commented 6 years ago

Hi @alexmojaki, can it be extended to support input compression as well?, i created a gzip wrapper over byte array output stream, but it's failing with multiple parts even though it's working with single part.

alexmojaki commented 6 years ago

I don't know, you'd have to show me your code. I imagine it wouldn't work with multiple threads, but multiple parts probably shouldn't be a problem.