809 compressed cslc indexing - Githubissues

nasa / opera-sds-pcm

Observational Products for End-Users from Remote Sensing Analysis (OPERA)

Apache License 2.0

16 stars 12 forks source link

809 compressed cslc indexing #830

Closed philipjyoon closed 4 months ago

philipjyoon commented 4 months ago

Indexes compressed CSLCs in GRQ ES post PGE and queries it during download so that they can be provided to DISP-S1 PGE jobs
daac_data_subscriber.py query validation
Minor refactoring

hhlee445 commented 4 months ago

Verified with following commands. Triggered in order after DISP-S1 PGE generated the Compressed CSLC products.

python ~/mozart/ops/opera-pcm/data_subscriber/daac_data_subscriber.py query -c OPERA_L2_CSLC-S1_V1 --chunk-size=1 --k=4 --job-queue=opera-job_worker-cslc_data_download --processing-mode=reprocessing --native-id=OPERA_L2_CSLC-S1_T122-260017-IW1_20231202T011409Z_20231203T075232Z_S1A_VV_v1.0 --m=1

python ~/mozart/ops/opera-pcm/data_subscriber/daac_data_subscriber.py query -c OPERA_L2_CSLC-S1_V1 --chunk-size=1 --k=4 --job-queue=opera-job_worker-cslc_data_download --processing-mode=reprocessing --native-id=OPERA_L2_CSLC-S1_T122-260017-IW1_20231214T011409Z_20231215T075845Z_S1A_VV_v1.0 --m=2

python ~/mozart/ops/opera-pcm/data_subscriber/daac_data_subscriber.py query -c OPERA_L2_CSLC-S1_V1 --chunk-size=1 --k=4 --job-queue=opera-job_worker-cslc_data_download --processing-mode=reprocessing --native-id=OPERA_L2_CSLC-S1_T122-260017-IW1_20231226T011408Z_20231227T075548Z_S1A_VV_v1.0 --m=2

python ~/mozart/ops/opera-pcm/data_subscriber/daac_data_subscriber.py query -c OPERA_L2_CSLC-S1_V1 --chunk-size=1 --k=4 --job-queue=opera-job_worker-cslc_data_download --processing-mode=reprocessing --native-id=OPERA_L2_CSLC-S1_T122-260017-IW1_20240107T011407Z_20240108T225421Z_S1A_VV_v1.0 --m=2