For ARD generation, the processor.py script executes the following main steps:
select all scenes based on the user-defined search criteria
group the scenes by acquisition time (data take)
for each group:
select all overlapping MGRS tiles
for each tile:
start function ard.format
Inside ard.format, the function ard.get_datasets is called, which collects all relevant processed files and performs a check whether the part of the file overlapping with the MGRS tile contains any valid data. If it doesn't, the processed product is ignored and its files not returned by the function (because they are not relevant for creating the current ARD product).
As important as this is, it leads to the situation that the full list of ARD files that should exist can only be known if all processed SAR products exist. it would be good to know whether all ARD products exist from the source scene selection alone. Otherwise some scenes whose processing output had already been deleted are re-processed because the processor thinks some tiles are missing.
I currently see two options:
create dummy product folders with some note saying that the product was not created because the source products did not overlap with it
maintain some database/text file in ard_dir listing those products that were never created
For ARD generation, the
processor.pyscript executes the following main steps:ard.formatInside
ard.format, the functionard.get_datasetsis called, which collects all relevant processed files and performs a check whether the part of the file overlapping with the MGRS tile contains any valid data. If it doesn't, the processed product is ignored and its files not returned by the function (because they are not relevant for creating the current ARD product).As important as this is, it leads to the situation that the full list of ARD files that should exist can only be known if all processed SAR products exist. it would be good to know whether all ARD products exist from the source scene selection alone. Otherwise some scenes whose processing output had already been deleted are re-processed because the processor thinks some tiles are missing.
I currently see two options:
ard_dirlisting those products that were never created