Feature: trigger SVS metadata fetch and insert into table

VanAndelInstitute / virtual-slide-viewer-backend

Simplified digital pathology image viewer

The Unlicense

0 stars 0 forks source link

Feature: trigger SVS metadata fetch and insert into table #2

Closed rmontroy closed 4 years ago

rmontroy commented 4 years ago

Since we're using AWS DataSync to copy files into EFS, we now have the ability to log transferred files to CloudWatch and trigger a function using a CloudWatch subscription.

rmontroy commented 4 years ago

The CloudWatch events typically take ~10 minutes to arrive. Also, we need a robust way to process new files in case an event is missed (or fails). For both of these reasons, we should have an EventBridge trigger from DataSync, an on-demand trigger via APIG, and look for any files that have not yet been processed.