Unzip a file from s3 and save contents into a new folder, returning a list of file urls

Edvardoh commented 9 months ago

We need a Lambda function which takes a .zip file that has already been uploaded to an s3 bucket, unzips the file, and saves the contents into a new subfolder in the bucket.

The subfolder should share the name of the original zip, and the contained files in the zip should preserve their paths/filenames relative to the original zip. With the exception of any strange characters such as ~ ñ é, to create a friendly URL.

When finished, the function should return a list of urls for all the files that were saved successfully, and a list of filenames that were not saved successfully (if any)

Sample input .zip: test_batch1.zip

Deliverables

[ ] A dockerized app which takes a url to a .zip file in an s3 bucket, unzips and saves the contents into a new subfolder in the same bucket, and outputs a list of successfully saved file urls
[ ] Instructions to configure the bucket - RAM and disk space needed, s3 configuration, etc.

Acceptance Criteria

[ ] It should accept a public-view s3 url to a .zip file as input
[ ] If subfolders inside the .zip folder, it should recursively create the same subfolder structure in the s3 bucket
[ ] It should output a list of successfully saved files' s3 urls
[ ] It should output a list of failed file names
[ ] original file names should be preserved - with the exception of any special characters, which should be removed to create friendly urls
[ ] do not compress or downsample the original files, preserve as much of the original file data as possible
[ ] Returns a descriptive error if the function fails - ie. memory exceeded, etc.