wellcomecollection / editorial-photography-ingest

0 stars 0 forks source link

Improve handling of very large shoots #31

Closed paul-butcher closed 1 month ago

paul-butcher commented 1 month ago

The largest shoots fail to transfer because they are too large for a Lambda to hold all the images in storage and create the zips.

We need to either only partially download the shoots if they are large, or do more of the process in memory instead of storage.