tnc-ca-geo / animl-ingest

Lambda function for processing camera trap images
Other
0 stars 1 forks source link

Pre-Parse Batch #56

Closed ingalls closed 1 year ago

ingalls commented 1 year ago

Context

The Ingest-Zip function will currently startup AWS infrastructure regardless of the contents or validity of an uploaded file ending in .zip This can lead to significant delay between when an invalid file is uploaded to when an error is displayed to the user.

This PR pre-parses the zip and calculated total entries before a CloudFormation call is initiated (the slowest part of the process) and does the following

Unknowns

cc/ @nathanielrindlaub

ingalls commented 1 year ago

Screenshot from 2023-05-09 13-09-29