ASFHyP3 / hyp3

A processing environment for HyP3 Plugins in AWS.
BSD 3-Clause "New" or "Revised" License
37 stars 8 forks source link

Update UPLOAD_LOG, CHECK_PROCESSING_TIME, and HANDLE_BATCH_EVENT for multi-task job architecture #1167

Open jtherrmann opened 2 years ago

jtherrmann commented 2 years ago

See the description for https://github.com/ASFHyP3/hyp3/pull/1166

jtherrmann commented 2 years ago

Steps to verify https://github.com/ASFHyP3/hyp3/pull/1172:

It would have been nice to verify the expected behavior if there's an error during CHECK_PROCESSING_TIME (processing times remains as an empty list and the error message is recorded to a separate field in the step function JSON), but I couldn't think of an easy way to force that behavior.

jtherrmann commented 2 years ago

TODO: