nasa / opera-sds-pcm

Observational Products for End-Users from Remote Sensing Analysis (OPERA)
Apache License 2.0
16 stars 12 forks source link

[Bug]: DSWx-S1 Validator Tool Found Missing Tiles and Tilesets #942

Closed riverma closed 2 weeks ago

riverma commented 1 month ago

Checked for duplicates

Yes - I've already checked

Describe the bug

During a recent I&T test of DSWx-S1, the validator tool identified many entirely missing DSWx-S1 products (i.e. tile sets were not processed at all) and many tilesets that were missing tiles (less coverage than expected).

What did you expect?

The validator tool should have had zero discrepancies.

Reproducible steps

  1. Perform a DSWx-S1 processing campaign for the below dates: "2024-07-18T22:15:19Z" --end "2024-07-19T21:15:19Z"
  2. Run the validator tool using the below commands (notice the end date is shortened to account for the grace period):
    python dswx_s1_validator.py --start "2024-07-18T22:15:19Z" --end "2024-07-19T17:45:52Z" --db MGRS_tile_collection_v0.3.sqlite --matching_burst_count 4 --endpoint_dswx_s1 UAT --verbose --timestamp REVISION --validate > int-run-results-daac-delivery-validation.txt
  3. View discrepancy results.

Environment