Closed chrisjrd closed 1 month ago
@chrisjrd @hhlee445 - can we add this as an integration test case in https://github.com/nasa/opera-sds-pcm/blob/develop/tests/integration/test_integration.py or equivalent? In general - it's good software engineering practice to ensure bugs that are found are added to automated test cases to prevent regression in the future.
@chrisjrd have you verified that the corresponding SCIFLO triggering is also not deduped? Or does that also need to be changed up a bit?
Verified that the second job didn't get deduped and generated more DSWx-S1 products by later job
python3 ~/mozart/ops/opera-pcm/data_subscriber/daac_data_subscriber.py query -c OPERA_L2_RTC-S1_V1 --job-queue=opera-job_worker-rtc_data_download --chunk-size 1 --processing-mode=forward -s 2024-07-19T00:15:19Z -e 2024-07-19T01:15:19Z
MS_147_4 - 27 RTCs were used
python3 ~/mozart/ops/opera-pcm/data_subscriber/daac_data_subscriber.py query -c OPERA_L2_RTC-S1_V1 --job-queue=opera-job_worker-rtc_data_download --chunk-size 1 --processing-mode=forward -s 2024-07-19T07:15:19Z -e 2024-07-19T08:15:19Z
MS_147_4 - 41 RTCs were used
Purpose
Proposed Changes
Issues
Refs #939
Testing