Add SplitUnzipStrategy - Githubissues

nejckorasa / s3-stream-unzip

Lightweight Java library to manage unzipping of large files and data in AWS S3 without knowing the size beforehand and without keeping it all in memory or writing to disk.

https://nejckorasa.github.io/posts/s3-unzip/

MIT License

38 stars 8 forks source link

Add SplitUnzipStrategy #4

Closed nejckorasa closed 2 years ago

nejckorasa commented 2 years ago

Add a strategy that allows larger files to be split to into multiple shards/files that are uploaded to S3.

it should handle possible headers (e.g. csv files)