Generate S2 ARD STAC from CEDA archive

[agstephens]

Data provenance (we think):

1. Baseline data, non-ARD, exists in CEDA archive, such as:

   • https://dap.ceda.ac.uk/neodc/sentinel2a/data/L1C_MSI/2023/08/01/S2A_MSIL1C_20230801T115411_N0509_R023_T29UPA_20230801T170945.manifest?download=1
   • MOLES: https://catalogue.ceda.ac.uk/uuid/9edbe5a1f7f5496cbc5863e53335b4a9

2. An ARD dataset is generated from the above:

   • Method: Processing used the following steps: reprojection to TM65 (EPSG:29902), band sharpening to 10m (removing the native 60m ESA Bands 1, 9 and 10), cloud probability calculation and cloud masking, atmospheric correction and topographic correction using the Aerial Photography Great Britain (APGB) and Ordnance Survey Northern Ireland (OSNI) 10m resolution DEM
   • As recorded in XML file: https://dap.ceda.ac.uk/neodc/sentinel_ard/data/sentinel_2/2023/08/01/S2A_20230801_latn545lonw0066_T29UPA_ORB023_20230801170945_utm29n_TM65_vmsk_sharp_rad_srefdem_stdsref_meta.xml?download=1
   • Other related image files (7 for each scene) exist under:
   • e.g.: https://data.ceda.ac.uk/neodc/sentinel_ard/data/sentinel_2/2023/08/01/
   • MOLES: https://catalogue.ceda.ac.uk/uuid/bf9568b558204b81803eeebcc7f529ef

3. A set of indices are generated by processing the S2 ARD data from above:

   • e.g.: https://data.ceda.ac.uk/neodc/sentinel_ard/indices/sentinel_2
   • which includes these indices: evi, nbr, nvdi, nmdi, nwdi
   • MOLES: there is a separate record for each index: e.g.: https://catalogue.ceda.ac.uk/uuid/102909b1d169469f85c099a6f1686bad

[agstephens]

@rhysrevans3 and @jackleland: Let's focus on generating STAC records for the components of (2) in the list above. You can use the "XML" file to get some metadata. And I reckon there should be 1 item for each group of 8 files that have the same prefix.

You should be able to find out what each of the suffixes mean by searching this doc, and any reports/docs linked to it:

https://data.jncc.gov.uk/data/dcb14a5e-301f-40ae-94c3-22b73fb4ec57/simple-ard-service-user-guide.pdf

Or asking Ed?

$ ls /neodc/sentinel_ard/data/sentinel_2/2023/08/01 -1 | grep  S2A_20230801_latn545lonw0066_T29UPA
S2A_20230801_latn545lonw0066_T29UPA_ORB023_20230801170945_utm29n_TM65_clouds_prob.tif
S2A_20230801_latn545lonw0066_T29UPA_ORB023_20230801170945_utm29n_TM65_clouds.tif
S2A_20230801_latn545lonw0066_T29UPA_ORB023_20230801170945_utm29n_TM65_sat.tif
S2A_20230801_latn545lonw0066_T29UPA_ORB023_20230801170945_utm29n_TM65_toposhad.tif
S2A_20230801_latn545lonw0066_T29UPA_ORB023_20230801170945_utm29n_TM65_valid.tif
S2A_20230801_latn545lonw0066_T29UPA_ORB023_20230801170945_utm29n_TM65_vmsk_sharp_rad_srefdem_stdsref_meta.xml
S2A_20230801_latn545lonw0066_T29UPA_ORB023_20230801170945_utm29n_TM65_vmsk_sharp_rad_srefdem_stdsref_thumbnail.jpg
S2A_20230801_latn545lonw0066_T29UPA_ORB023_20230801170945_utm29n_TM65_vmsk_sharp_rad_srefdem_stdsref.tif