[ ] Improve dependency association. Narrow down time association.
[ ] Add ways to check for calibration files dependency.
[ ] Implement data version tracking
[ ] Improve/Implement database backup and duplicate record checks, sync in create_schema stack - Ask Laura/Gavin for information
[ ] Add check to avoid kicking off duplicate batch job when two upstream dependency files are ingested which will only need to kickoff one downstream job.
[ ] Clean up imap_cli command line inputs. Define what’s needed and what’s not needed. Make update to batch starter and indexer lambda as needed based on this change. And line up with imap_processing changes.
[ ] Add timestamp to status tracking table. Some way to record time of when some processing was done.
These will be broken into individual issue:
imap_processingchanges.