DSWx-S1 E2E FWD mode in the past

[sjlewis-jpl]

Run the DSWx-S1 pipeline in FWD mode, but using RTC-S1 data generated in the past (i.e. not using the latest data coming out of our RTC-S1 pipeline). This will allow us to know the expected results ahead of time, and repeat this test in the future. We should not try to deliver to the DAAC at this point, but we should have the system generate the CNM messages for inspection.

Dates for this test: 2023-10-24, for the first 12 hours of the day (midnight to noon).

For this test, follow the V&V instructions here: TestRail: E2E Tests for DSWx-S1 (excluding anything related to DAAC delivery or archival - we will test those later).

[sjlewis-jpl]

Until we're set up for testing with the DAAC, just the following test activities can/should be done now:

• Verify automated download and ingestion of input granules for product generation
• Verify automated generation of data products
• Verify ingestion of dynamic ancillary data
• Verify ingestion of static ancillary data
• Verify the production metrics for the product

[sjlewis-jpl]

For verifying the automated generation of data products, we will want to use the dswx_s1_validator script.

To do this for the test:

• Get a record the inputs ingested by the system (get from the retrieval time report)
• Get a record of the outputs generated by the system (get from the production time report)
• Use the dswx-s1-validator script to confirm the outputs
  • Make sure to use the same cutoff percentage as what was used in the test
  • Compare in 2 ways 1) Have the script query CMR over the same time period 2) Pass in the list of inputs ingested
  • Script just gives the MGRS Tile Set IDs... we will need to translate that into MGRS Tile IDs, and from there into output products (can't be the exact product name... since there's a ProductionDateTime... and the Acquisition Time might not be obvious)
• This will give 3 sets of output results
  • Want to show that these 3 sets all match and agree