Assist Shawn in determining more efficient process to trigger the WRDS ingest step function when a new pgdump is uploaded

NOAA-OWP / hydrovis

Other

11 stars 8 forks source link

Assist Shawn in determining more efficient process to trigger the WRDS ingest step function when a new pgdump is uploaded #792

Open DrixTabligan-NOAA opened 1 month ago

DrixTabligan-NOAA commented 1 month ago

Determine best/more efficient way to get the SNS notification to trigger an SNS step function. SNS notification will be event driven by presence of new pgdumps in the WRDS dump location in the shared services.

DrixTabligan-NOAA commented 1 month ago

Deployed in DISS and TI using TF.

TI account is subscribed to existing SNS topic notification 5. There is a lambda shim that just takes the SNS message and passes it thru to the step function.

DrixTabligan-NOAA commented 2 weeks ago

Deployed in UAT and currently in the process of RFC/CCB approval for deployment in prod.

DrixTabligan-NOAA commented 4 days ago

RFC approved and have been deployed in Prod Region 1. Currently figuring a work around to allow subscription in Region 2