When I performed OPERA-SDSVnV-17_3: Timed test for retrieval of input products (L1_CSLC_S1) action to trigger l1_cslc_s1 download queries, I noticed failed downloaded jobs are still being marked as TRUE under downloaded field.
[toandn@opera-int-mozart-pop1 ~]$ aws s3 cp s3://opera-int-triage-pop1/triaged_job-job-WF-slc_download-20230315T221415.498875Z_task-40ef7c7a-c1ca-4412-b166-b9edefaf1481/_stdout.txt .
download: s3://opera-int-triage-pop1/triaged_job-job-WF-slc_download-20230315T221415.498875Z_task-40ef7c7a-c1ca-4412-b166-b9edefaf1481/_stdout.txt to ./_stdout.txt
[toandn@opera-int-mozart-pop1 ~]$ cat _stdout.txt
args: --endpoint=OPS --batch-ids S1A_IW_SLC__1SDV_20201012T002639_20201012T002707_034756_040CB8_B3A3.zip --start-date=1900-01-01T00:00:00Z --end-date=2023-03-15T22:14:14Z --transfer-protocol=auto
##########################################
Running job to download ASFDAAC SLC data
Wed Mar 15 22:18:46 UTC 2023
python /home/ops/verdi/ops/opera-pcm/data_subscriber/daac_data_subscriber.py download -p ASF --endpoint=OPS --batch-ids S1A_IW_SLC__1SDV_20201012T002639_20201012T002707_034756_040CB8_B3A3.zip --start-date=1900-01-01T00:00:00Z --end-date=2023-03-15T22:14:14Z --transfer-protocol=auto 2>&1
Failed to run daac_data_subscriber.py
Wed Mar 15 22:19:41 UTC 2023
What did you expect?
failed downloaded jobs should be marked as FALSE under downloaded field.
Reproducible steps
1. Run multiple slc download jobs
2. Check for any failed jobs via Figaro
3. Check https://opera-int-mozart-pop1.jpl.nasa.gov/grq_es/ slc_catalog versus grq_1_l1_s1_slc.
Checked for duplicates
Yes - I've already checked
Describe the bug
When I performed OPERA-SDSVnV-17_3: Timed test for retrieval of input products (L1_CSLC_S1) action to trigger l1_cslc_s1 download queries, I noticed failed downloaded jobs are still being marked as TRUE under downloaded field.
https://opera-int-mozart-pop1.jpl.nasa.gov/grq_es/
What did you expect?
failed downloaded jobs should be marked as FALSE under downloaded field.
Reproducible steps
Environment