search

navapbc / template-infra

A template to set up foundational infrastructure for your application in AWS
Apache License 2.0
11 stars 2 forks source link

Use step functions for jobs that are triggered manually #766

Open coilysiren opened 2 weeks ago

coilysiren commented 2 weeks ago

Manually triggered jobs can benefit from AWS Step Functions in the same way the scheduled (https://github.com/navapbc/template-infra/issues/525) and event (https://github.com/navapbc/template-infra/issues/744) jobs can. That step functions add a tracking layer that is incredibly useful for debugging failures.

coilysiren commented 2 weeks ago

TODO tech spec, options:

  1. exclusively using run-command as-is
  2. using run-command to create a step function dynamically
  3. creating a new manual_jobs config
  4. folding all the jobs into a shared jobs config
  5. a single step function that can dynamically run different commands based on inputs