search

podaac / swodlr

swodlr (swaa·dler) is a system for generating on demand raster products from SWOT L2 data
Apache License 2.0
4 stars 2 forks source link

Implement check for required tiles prior to submitting SDS job #78

Open viviant100 opened 1 year ago

viviant100 commented 1 year ago

Per discussions: the reconciliation process will be event driven and integrated as part of the raster-create pipeline. The goal will be to perform a check to ensure that the required input granules are ingested before the process starts; the required granules will be queried from CMR to ensure that they're still available and compared against what is currently ingested in the SDS's internal stores. The process will then reconcile the differences between CMR (the source of truth) and the internal SDS store. Any granules that haven't been ingested yet will be ingested within the workflow.

frankinspace commented 10 months ago

Need to update to reflect recent discussions

joshgarde commented 7 months ago

Draft PR opened - https://github.com/podaac/swodlr-raster-create/pull/22