The scope of this PR is the configuration update to handle flexible catalogue structure. The following types of catalog structure configurations were tested:
In addition to serverless script that deploy the lambda function given in stac.py, there are four scripts that can be used to maintain the STAC catalog for all the products. The README.md explains in detail each of the scripts as well as configuration information. The default configuration file is stac_config.yaml.
Testing
The following are example runs that could be cross checked with the STAC catalog files in dea-public-data-devAWS bucket:
python notify_to_stac_queue.py -b dea-public-data-dev fractional-cover/fc/v2.2.0/ls8/x_-12/y_-12/2018/02/22/LS8_OLI_FC_3577_-12_-12_20180222125938.yaml
This will notify the lambda function to create the respective STAC item file. Check stac item file
python stac_parent_update.py -b dea-public-data-dev L2/sentinel-2-nrt/S2MSIARD/2018-09-06/S2A_OPER_MSI_ARD_TL_EPAE_20180906T015541_A016744_T54HUB_N02.06/ARD-METADATA.yaml
This will update parent catalogs corresponding to the given s3 object. Check three locations: collection1, catalog1, catalog2
python update_product_suit_catalogs.py -b dea-public-data-dev
This create the product suit level colloection catalogs. Currently WOfS, fractional-cover, and geomedian-australia are hard coded. Check WOfS, fractional-cover, geomedian-australia
Introduction
The scope of this PR is the configuration update to handle flexible catalogue structure. The following types of
catalog structureconfigurations were tested:In addition to serverless script that deploy the lambda function given in
stac.py, there are four scripts that can be used to maintain theSTAC catalogfor all the products. TheREADME.mdexplains in detail each of the scripts as well as configuration information. The default configuration file isstac_config.yaml.Testing
The following are example runs that could be cross checked with the
STAC catalogfiles indea-public-data-devAWS bucket:python notify_to_stac_queue.py -b dea-public-data-dev fractional-cover/fc/v2.2.0/ls8/x_-12/y_-12/2018/02/22/LS8_OLI_FC_3577_-12_-12_20180222125938.yamlThis will notify the lambda function to create the respectiveSTAC itemfile. Check stac item filepython stac_parent_update.py -b dea-public-data-dev L2/sentinel-2-nrt/S2MSIARD/2018-09-06/S2A_OPER_MSI_ARD_TL_EPAE_20180906T015541_A016744_T54HUB_N02.06/ARD-METADATA.yamlThis will update parent catalogs corresponding to the givens3 object. Check three locations: collection1, catalog1, catalog2python update_product_suit_catalogs.py -b dea-public-data-devThis create the product suit levelcolloection catalogs. CurrentlyWOfS, fractional-cover,andgeomedian-australiaare hard coded. Check WOfS, fractional-cover, geomedian-australia