Sentinel 2 ARD granules for all the years are packaged into one single directory as follows:
/g/data/if87/datacube/002/S2_MSI_ARD/packaged.
This breaks the orchestration process for dea-sync on S2 ard products. And would add more manual editing of serverless configuration file whenever new granules are packaged within the packaged directory.
Proposed solution
Update handler.js function to expand pathglob based on process environment variables and then pass the same to the ssh execution command string.
Add a delay of 1s before execution new ssh command. This is done to ensure that dea-sync does not fail while accessing same cache file when we schedule all the ssh command string without any delay.
Update handler.js function for processing Landsat scenes in lines with S2 ARD Granule changes.
Request for this pull request
Sentinel 2 ARD granules for all the years are packaged into one single directory as follows:
/g/data/if87/datacube/002/S2_MSI_ARD/packaged.This breaks the orchestration process for
dea-syncon S2 ard products. And would add more manual editing of serverless configuration file whenever new granules are packaged within thepackageddirectory.Proposed solution
handler.jsfunction to expandpathglobbased on process environment variables and then pass the same to thesshexecution command string.1sbefore execution newsshcommand. This is done to ensure thatdea-syncdoes not fail while accessing same cache file when we schedule all thesshcommand string without any delay.handler.jsfunction for processingLandsatscenes in lines withS2 ARD Granulechanges.