search

aria-jpl / coseismic_enumerator

Submits a given AOI's enumeration jobs for all intersecting POEORB's
Apache License 2.0
1 stars 0 forks source link

AOITrack with No Acquisition Lists #21

Closed cmarshak closed 3 years ago

cmarshak commented 3 years ago

Describe the bug This AOITrack has no acquisition lists:

"AOITRACK_eq_usgs_neic_pdl_us6000diae_55_Kamrai_Greece_7"

https://mamba-grq.aria.hysds.io/search/?base64=eyJxdWVyeSI6eyJxdWVyeV9zdHJpbmciOnsicXVlcnkiOiJcIkFPSVRSQUNLX2VxX3VzZ3NfbmVpY19wZGxfdXM2MDAwZGlhZV81NV9LYW1yYWlfR3JlZWNlXzdcIiIsImRlZmF1bHRfb3BlcmF0b3IiOiJPUiJ9fSwic29ydCI6W3siX3RpbWVzdGFtcCI6eyJvcmRlciI6ImRlc2MifX1dLCJmaWVsZHMiOlsiX3RpbWVzdGFtcCIsIl9zb3VyY2UiXX0=

Contrast this with track 80 which has 9 acq-lists

https://mamba-grq.aria.hysds.io/search/?base64=eyJxdWVyeSI6eyJxdWVyeV9zdHJpbmciOnsicXVlcnkiOiJcIkFPSVRSQUNLX2VxX3VzZ3NfbmVpY19wZGxfdXM2MDAwZGlhZV81NV9LYW1yYWlfR3JlZWNlXzgwXCIiLCJkZWZhdWx0X29wZXJhdG9yIjoiT1IifX0sInNvcnQiOlt7Il90aW1lc3RhbXAiOnsib3JkZXIiOiJkZXNjIn19XSwiZmllbGRzIjpbIl90aW1lc3RhbXAiLCJfc291cmNlIl19

To Reproduce Run the enumerator on the 4 acquisition lists here:

https://mamba-grq.aria.hysds.io/search/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsiZGF0YXNldC5yYXciOiJhb2l0cmFjay1lYXJ0aHF1YWtlIn19LHsicXVlcnlfc3RyaW5nIjp7InF1ZXJ5IjoiXCJBT0l0cmFja1wiIiwiZGVmYXVsdF9vcGVyYXRvciI6Ik9SIn19XX19LCJzb3J0IjpbeyJfdGltZXN0YW1wIjp7Im9yZGVyIjoiZGVzYyJ9fV0sImZpZWxkcyI6WyJfdGltZXN0YW1wIiwiX3NvdXJjZSJdfQ==

Expected behavior There should be a nontrivial number of acquisition lists given this AOI has starttime January 2021.

Even with bad orbit files being passed over, there should be 3 months (February, March, April) of available orbit files which should provide at least (28 + 31 + 30 days) * (3 months) / (6 day repeat pass) = 14 orbits since February 1st over the AOITrack.

al-niessner commented 3 years ago

Find the _stdout.txt and find out why there are no acquisition lists for the AOI track. It may be normal result or, at least, allowed given all of the "ignore this error" conditions that have been added to the code.

cmarshak commented 3 years ago

How do we do this?

...
-> begin: AOITRACK_eq_usgs_neic_pdl_us6000diae_55_Kamrai_Greece_7
->   filling 0 of 3
->     found water masked location
->     found water masked location
->     download remote information
->     local file: S1B_OPER_AUX_POEORB_OPOD_20210305T111818_V20210212T225942_20210214T005942-v1.1/S1B_OPER_AUX_POEORB_OPOD_20210305T111818_V20210212T225942_20210214T005942.EOF
Extracting orbit from Orbit File:  S1B_OPER_AUX_POEORB_OPOD_20210305T111818_V20210212T225942_20210214T005942-v1.1/S1B_OPER_AUX_POEORB_OPOD_20210305T111818_V20210212T225942_20210214T005942.EOF
Extracting orbit from Orbit File:  S1B_OPER_AUX_POEORB_OPOD_20210305T111818_V20210212T225942_20210214T005942-v1.1/S1B_OPER_AUX_POEORB_OPOD_20210305T111818_V20210212T225942_20210214T005942.EOF
->     found water masked location
->     coverage: 87.1904554713014
->     not enough coverage
->   filling 0 of 3
->     found water masked location
->     found water masked location
Extracting orbit from Orbit File:  S1B_OPER_AUX_POEORB_OPOD_20210305T111818_V20210212T225942_20210214T005942-v1.1/S1B_OPER_AUX_POEORB_OPOD_20210305T111818_V20210212T225942_20210214T005942.EOF
->     download remote information
->     local file: S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942.EOF
Extracting orbit from Orbit File:  S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942.EOF
Extracting orbit from Orbit File:  S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942.EOF
Extracting orbit from Orbit File:  S1B_OPER_AUX_POEORB_OPOD_20210305T111818_V20210212T225942_20210214T005942-v1.1/S1B_OPER_AUX_POEORB_OPOD_20210305T111818_V20210212T225942_20210214T005942.EOF
Extracting orbit from Orbit File:  S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942.EOF
Extracting orbit from Orbit File:  S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942.EOF
->     found water masked location
->     coverage: 87.1904554713014
->     not enough coverage
->   filling 0 of 3
->     found water masked location
->     found water masked location
Extracting orbit from Orbit File:  S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942.EOF
Extracting orbit from Orbit File:  S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942.EOF
Extracting orbit from Orbit File:  S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942.EOF
Extracting orbit from Orbit File:  S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210227T121738_V20210206T225942_20210208T005942.EOF
->     found water masked location
->     coverage: 87.03067722485268
->     not enough coverage
->   filling 0 of 3
->     found water masked location
->     found water masked location
->     download remote information
->     local file: S1B_OPER_AUX_POEORB_OPOD_20210221T111748_V20210131T225942_20210202T005942-v1.1/S1B_OPER_AUX_POEORB_OPOD_20210221T111748_V20210131T225942_20210202T005942.EOF
Extracting orbit from Orbit File:  S1B_OPER_AUX_POEORB_OPOD_20210221T111748_V20210131T225942_20210202T005942-v1.1/S1B_OPER_AUX_POEORB_OPOD_20210221T111748_V20210131T225942_20210202T005942.EOF
Extracting orbit from Orbit File:  S1B_OPER_AUX_POEORB_OPOD_20210221T111748_V20210131T225942_20210202T005942-v1.1/S1B_OPER_AUX_POEORB_OPOD_20210221T111748_V20210131T225942_20210202T005942.EOF
->     found water masked location
->     coverage: 87.08119598756734
->     not enough coverage
->   filling 0 of 3
->     found water masked location
->     found water masked location
->     download remote information
->     local file: S1A_OPER_AUX_POEORB_OPOD_20210215T121728_V20210125T225942_20210127T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210215T121728_V20210125T225942_20210127T005942.EOF
Extracting orbit from Orbit File:  S1A_OPER_AUX_POEORB_OPOD_20210215T121728_V20210125T225942_20210127T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210215T121728_V20210125T225942_20210127T005942.EOF
Extracting orbit from Orbit File:  S1A_OPER_AUX_POEORB_OPOD_20210215T121728_V20210125T225942_20210127T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210215T121728_V20210125T225942_20210127T005942.EOF
Extracting orbit from Orbit File:  S1A_OPER_AUX_POEORB_OPOD_20210215T121728_V20210125T225942_20210127T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210215T121728_V20210125T225942_20210127T005942.EOF
Extracting orbit from Orbit File:  S1A_OPER_AUX_POEORB_OPOD_20210215T121728_V20210125T225942_20210127T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210215T121728_V20210125T225942_20210127T005942.EOF
->     found water masked location
->     coverage: 87.07139677704109
->     not enough coverage
->   filling 0 of 3
->     found water masked location
->     found water masked location
->     download remote information
->     local file: S1B_OPER_AUX_POEORB_OPOD_20210209T111836_V20210119T225942_20210121T005942-v1.1/S1B_OPER_AUX_POEORB_OPOD_20210209T111836_V20210119T225942_20210121T005942.EOF
Extracting orbit from Orbit File:  S1B_OPER_AUX_POEORB_OPOD_20210209T111836_V20210119T225942_20210121T005942-v1.1/S1B_OPER_AUX_POEORB_OPOD_20210209T111836_V20210119T225942_20210121T005942.EOF
Extracting orbit from Orbit File:  S1B_OPER_AUX_POEORB_OPOD_20210209T111836_V20210119T225942_20210121T005942-v1.1/S1B_OPER_AUX_POEORB_OPOD_20210209T111836_V20210119T225942_20210121T005942.EOF
Polynomial Order: 0 - by - 1 
0   0   
...

_stdout.txt

al-niessner commented 3 years ago

Clearly shows why there are no acquisitions lists. As required (aka not a bug) it did not include any area less than 90%. Even with the water masked out, the acquisitions covered only 87% of the area. Hence, no acquisitions met the usable criteria so the enumerator quietly moved onward. All as required.

cmarshak commented 3 years ago

So looking at another AOITrack we have something that looks like this:

-> begin: AOITRACK_eq_usgs_neic_pdl_us6000diae_55_Kamrai_Greece_80
->   filling 0 of 3
->     found water masked location
->     found water masked location
->     download remote information
->     local file: S1A_OPER_AUX_POEORB_OPOD_20210304T121844_V20210211T225942_20210213T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210304T121844_V20210211T225942_20210213T005942.EOF
Extracting orbit from Orbit File:  S1A_OPER_AUX_POEORB_OPOD_20210304T121844_V20210211T225942_20210213T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210304T121844_V20210211T225942_20210213T005942.EOF
Extracting orbit from Orbit File:  S1A_OPER_AUX_POEORB_OPOD_20210304T121844_V20210211T225942_20210213T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210304T121844_V20210211T225942_20210213T005942.EOF
->     found water masked location
->     coverage: 100.0
->   filling 1 of 3
->     found water masked location
->     found water masked location
->     download remote information
->     local file: S1B_OPER_AUX_POEORB_OPOD_20210226T111730_V20210205T225942_20210207T005942-v1.1/S1B_OPER_AUX_POEORB_OPOD_20210226T111730_V20210205T225942_20210207T005942.EOF
Extracting orbit from Orbit File:  S1B_OPER_AUX_POEORB_OPOD_20210226T111730_V20210205T225942_20210207T005942-v1.1/S1B_OPER_AUX_POEORB_OPOD_20210226T111730_V20210205T225942_20210207T005942.EOF
Extracting orbit from Orbit File:  S1B_OPER_AUX_POEORB_OPOD_20210226T111730_V20210205T225942_20210207T005942-v1.1/S1B_OPER_AUX_POEORB_OPOD_20210226T111730_V20210205T225942_20210207T005942.EOF
->     found water masked location
->     coverage: 100.0
->   filling 2 of 3
->     found water masked location
->     found water masked location
->     download remote information
->     local file: S1A_OPER_AUX_POEORB_OPOD_20210220T121814_V20210130T225942_20210201T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210220T121814_V20210130T225942_20210201T005942.EOF
Extracting orbit from Orbit File:  S1A_OPER_AUX_POEORB_OPOD_20210220T121814_V20210130T225942_20210201T005942-v1.1/S1A_OPER_AUX_POEORB_OPOD_20210220T121814_V20210130T225942_20210201T005942.EOFolynomial Order: 0 - by - 1

I will look for -> filling 0 of 3 and 1 of 2 and 2 of 3 without the coverage issues below them. Is that how you mean to read the _stdout in this context?

al-niessner commented 3 years ago

When they fill, yes that is how it counts. More importantly is to note the coverage when the fill index (index of count) does not increment.

riverma commented 3 years ago

Thanks @al-niessner. @cmarshak - if there aren't any other questions here, feel free to close the ticket.