Review the A/V copy/convert Lambda – should it really be a Lambda?

wellcomecollection / platform

Wellcome Collection Digital Platform

https://developers.wellcomecollection.org/

MIT License

48 stars 10 forks source link

Review the A/V copy/convert Lambda – should it really be a Lambda? #4287

Closed alexwlchan closed 2 years ago

alexwlchan commented 4 years ago

This is a Lambda created for the digitisation A/V workflows. When our external vendor uploads MXF video files to an S3 bucket, it:

Copies the file to an S3 bucket we own (so it can't be deleted accidentally by the vendor)
Creates an MP4 copy with Media Convert

Lambda isn‘t a great environment for this – some of these MXF files are enormous, and a Lambda may well time out. Moving it to a queue-backed ECS task would be more sustainable.

alexwlchan commented 2 years ago

Closing as not looked at; the current setup seems to have served us fine for now. We can open a new ticket if it ever returns as an issue.