search

cwhite92 / blog-comments

0 stars 0 forks source link

15-streaming-zip #4

Open utterances-bot opened 1 year ago

utterances-bot commented 1 year ago

Generating Large ZIP Exports From Files in S3

Just random stuff.

https://chriswhite.is/coding/generating-large-zip-exports-from-files-in-s3

ibraheem-ghazi commented 1 year ago

Does this works if I want to create a zip file with more than 50K files, or it will exhaust the resources?

ostrolucky commented 1 year ago

Beware that the way s3-php-sdk streaming actually works is that it writes the file to /tmp/ and uploads to s3 only when you close the stream

i1yaz commented 1 year ago

Thank you chris for writing this article. does this handle a zip than is more than 2gb in size ? thanks

robjbrain commented 1 year ago

@ostrolucky this seems to contradict the article "without ever saving the input files or the resulting ZIP file to disk".

Is that what you're saying?