search

NASA-IMPACT / csdap-cumulus

SmallSat Cumulus Deployment
Other
1 stars 1 forks source link

Add capability to generate a completion report of any changes to ORCA Buckets #269

Closed krisstanton closed 3 months ago

krisstanton commented 12 months ago

Add capability to generate a completion report of any changes to ORCA Buckets (and /or database within specified time frames) Ref: https://docs.google.com/spreadsheets/d/1Xznva0Upb9W9bTqdAndV4pDcwjV8jRRYKFVmgq_9i1c/edit#gid=0 Ref: 18.1 The system shall report completion of Cumulus/ORCA ingest workflow and summarize errors The idea here is to capture change logs during specified ingest time frames to ensure that ORCA did it's backup job. Is this a standalone python script? Bash? Or is this some sub process stood up inside of AWS that can do this and output it somewhere?? These questions of the architecture and/or access need to be answered. We need to think in regards of making this as easy as possible for 2 main use cases

krisstanton commented 3 months ago

Closing as unplanned since our direction has changed a bit. We will be processing the ORCA Manifest files on MCP as part of the continuous file deletions.