Define Data Management items for GE01_MSI_L1B Maxar collection

[krisstanton]

Obtain the collection short name for the GE01 1B MSI Maxar collection and define the corresponding Cumulus Data Management Items according to the instructions in the section "Defining Cumulus Data Management Items" in docs/OPERATING.md.

Acceptance criteria:

• [x] new collection and rule definition files defined in the code base
• [x] new collection defined and loaded into dev
• [x] new rule definition(s) defined and loaded into dev
• [x] Successful Smoke Test Run in dev
• [x] new collection loaded into UAT, and Prod
• [x] new rule definition(s) defined and loaded into UAT, and Prod (if collection is "small enough," 1 rule may be sufficient to ingest entire collection, otherwise multiple rules spanning consecutive time periods will be required)
• [x] new test files for a single granule created for testing in a dev deployment (this must be a set of granule files for a single granule, named properly, but only the cmr.json file must be valid, and the rest of the files can be dummy files [i.e., contents don't matter, only the filenames matter])
• [x] test granule successfully ingested in a dev deployment (i.e., no errors during the discovery and ingest workflows, and the granule is visible via a UAT CMR query or a UAT Earthdata search)

[krisstanton]

Collection and Rules Loaded into Dev (Sandbox account). Smoke Test passed in Dev. Here are the console outs for Dev.

➜  csdap-cumulus git:(iss211__Define_DM_for_GE01_MSI_L1B) ✗ DOTENV=.env.sandbox make create-data-management-items
sha256:aaaaaaaa
WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested
Determining provider bucket...csda-cumulus-kris-sbx7894-provider-7894
Upserting providers maxar.json...done
Upserting providers planet.json...done
Upserting collections GE01_MSI_L1B___1.json...done
Upserting collections PSScene3Band___1.json...done
Upserting collections WV01_Pan_L1B___1.json...done
Upserting collections WV02_MSI_L1B___1.json...done
Upserting collections WV03_MSI_L1B___1.json...done
Upserting collections WV04_MSI_L1B___1.json...done
Upserting collections WV04_Pan_L1B___1.json...done
Upserting rules GE01_MSI_L1B___1_2009.json...done
Upserting rules GE01_MSI_L1B___1_2010.json...done
Upserting rules GE01_MSI_L1B___1_2011.json...done
Upserting rules GE01_MSI_L1B___1_2012.json...done
Upserting rules GE01_MSI_L1B___1_2013.json...done
Upserting rules GE01_MSI_L1B___1_2014.json...done
Upserting rules GE01_MSI_L1B___1_2015.json...done
Upserting rules GE01_MSI_L1B___1_2016.json...done
Upserting rules GE01_MSI_L1B___1_2017.json...done
Upserting rules GE01_MSI_L1B___1_2018.json...done
Upserting rules GE01_MSI_L1B___1_2019.json...done
Upserting rules GE01_MSI_L1B___1_2020.json...done
Upserting rules GE01_MSI_L1B___1_2021.json...done
Upserting rules GE01_MSI_L1B___1_2022.json...done
Upserting rules GE01_MSI_L1B___1_SmokeTest.json...done
Upserting rules PSScene3Band___1_2015.json...done
Upserting rules PSScene3Band___1_2016.json...done
Upserting rules PSScene3Band___1_2017.json...done
Upserting rules PSScene3Band___1_2018.json...done
Upserting rules PSScene3Band___1_2019.json...done
Upserting rules PSScene3Band___1_2019_H1.json...done
Upserting rules PSScene3Band___1_2019_H1_finish_link_updates.json...done
Upserting rules PSScene3Band___1_2019_H2.json...done
Upserting rules PSScene3Band___1_2019_Q3.json...done
Upserting rules PSScene3Band___1_2019_Q4.json...done
Upserting rules PSScene3Band___1_2020.json...done
Upserting rules PSScene3Band___1_2020_finish_link_updates.json...done
Upserting rules PSScene3Band___1_SmokeTest.json...done
Upserting rules WV01_Pan_L1B___1_2007.json...done
Upserting rules WV01_Pan_L1B___1_2008.json...done
Upserting rules WV01_Pan_L1B___1_2008__StartFeb16.json...done
Upserting rules WV01_Pan_L1B___1_2009.json...done
Upserting rules WV01_Pan_L1B___1_2010.json...done
Upserting rules WV01_Pan_L1B___1_2011.json...done
Upserting rules WV01_Pan_L1B___1_2012.json...done
Upserting rules WV01_Pan_L1B___1_2013.json...done
Upserting rules WV01_Pan_L1B___1_2014.json...done
Upserting rules WV01_Pan_L1B___1_2015.json...done
Upserting rules WV01_Pan_L1B___1_2016.json...done
Upserting rules WV01_Pan_L1B___1_2017.json...done
Upserting rules WV01_Pan_L1B___1_2018.json...done
Upserting rules WV01_Pan_L1B___1_2019.json...done
Upserting rules WV01_Pan_L1B___1_2020.json...done
Upserting rules WV01_Pan_L1B___1_2021.json...done
Upserting rules WV01_Pan_L1B___1_2022.json...done
Upserting rules WV01_Pan_L1B___1_SmokeTest.json...done
Upserting rules WV01_Pan_L1B___1_UAT.json...done
Upserting rules WV02_MSI_L1B___1_2009.json...done
Upserting rules WV02_MSI_L1B___1_2010.json...done
Upserting rules WV02_MSI_L1B___1_2011.json...done
Upserting rules WV02_MSI_L1B___1_2012.json...done
Upserting rules WV02_MSI_L1B___1_2013.json...done
Upserting rules WV02_MSI_L1B___1_2014.json...done
Upserting rules WV02_MSI_L1B___1_2015.json...done
Upserting rules WV02_MSI_L1B___1_2016.json...done
Upserting rules WV02_MSI_L1B___1_2017.json...done
Upserting rules WV02_MSI_L1B___1_2018.json...done
Upserting rules WV02_MSI_L1B___1_2019.json...done
Upserting rules WV02_MSI_L1B___1_2020.json...done
Upserting rules WV02_MSI_L1B___1_2021.json...done
Upserting rules WV02_MSI_L1B___1_2022.json...done
Upserting rules WV02_MSI_L1B___1_SmokeTest.json...done
Upserting rules WV02_MSI_L1B___1_UAT.json...done
Upserting rules WV03_MSI_L1B___1_2014.json...done
Upserting rules WV03_MSI_L1B___1_2015.json...done
Upserting rules WV03_MSI_L1B___1_2016.json...done
Upserting rules WV03_MSI_L1B___1_2017.json...done
Upserting rules WV03_MSI_L1B___1_2017_04.json...done
Upserting rules WV03_MSI_L1B___1_2017_05_onwards.json...done
Upserting rules WV03_MSI_L1B___1_2017_Q1.json...done
Upserting rules WV03_MSI_L1B___1_2017_Q2.json...done
Upserting rules WV03_MSI_L1B___1_2018.json...done
Upserting rules WV03_MSI_L1B___1_2019.json...done
Upserting rules WV03_MSI_L1B___1_2020.json...done
Upserting rules WV03_MSI_L1B___1_2021.json...done
Upserting rules WV03_MSI_L1B___1_2022.json...done
Upserting rules WV03_MSI_L1B___1_SmokeTest.json...done
Upserting rules WV03_MSI_L1B___1_UAT.json...done
Upserting rules WV04_MSI_L1B___1.json...done
Upserting rules WV04_MSI_L1B___1_SmokeTest.json...done
Upserting rules WV04_Pan_L1B___1_2017.json...done
Upserting rules WV04_Pan_L1B___1_2018.json...done
Upserting rules WV04_Pan_L1B___1_SmokeTest.json...done

➜  csdap-cumulus git:(iss211__Define_DM_for_GE01_MSI_L1B) ✗ DOTENV=.env.sandbox make create-test-data
sha256:aaaaaaaa
WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested
Determining provider bucket...csda-cumulus-kris-sbx7894-provider-7894
Generating dummy granule files based on cmr.json files...done
New or updated files: []
Syncing dummy files to provider bucket csda-cumulus-kris-sbx7894-provider-7894...done
upload: app/stacks/cumulus/resources/granules/.DS_Store to s3://csda-cumulus-kris-sbx7894-provider-7894/.DS_Store
upload: app/stacks/cumulus/resources/granules/css/.DS_Store to s3://csda-cumulus-kris-sbx7894-provider-7894/css/.DS_Store
upload: app/stacks/cumulus/resources/granules/css/nga/GE01/1B/2015/100/GE01_10504100127F6300_M1BS_502547447070_01/GE01_20150410011735_10504100127F6300_15APR10011735-M1BS-502547447070_01_P001.xml to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/GE01/1B/2015/100/GE01_10504100127F6300_M1BS_502547447070_01/GE01_20150410011735_10504100127F6300_15APR10011735-M1BS-502547447070_01_P001.xml
upload: app/stacks/cumulus/resources/granules/css/nga/GE01/1B/2015/100/GE01_10504100127F6300_M1BS_502547447070_01/GE01_20150410011735_10504100127F6300_15APR10011735-M1BS-502547447070_01_P001.ntf to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/GE01/1B/2015/100/GE01_10504100127F6300_M1BS_502547447070_01/GE01_20150410011735_10504100127F6300_15APR10011735-M1BS-502547447070_01_P001.ntf
upload: app/stacks/cumulus/resources/granules/css/nga/GE01/1B/2015/100/GE01_10504100127F6300_M1BS_502547447070_01/GE01_20150410011735_10504100127F6300_15APR10011735-M1BS-502547447070_01_P001.tar to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/GE01/1B/2015/100/GE01_10504100127F6300_M1BS_502547447070_01/GE01_20150410011735_10504100127F6300_15APR10011735-M1BS-502547447070_01_P001.tar
upload: app/stacks/cumulus/resources/granules/css/nga/WV04/1B/.DS_Store to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/1B/.DS_Store
upload: app/stacks/cumulus/resources/granules/css/nga/.DS_Store to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/.DS_Store
upload: app/stacks/cumulus/resources/granules/css/nga/GE01/1B/2015/100/GE01_10504100127F6300_M1BS_502547447070_01/GE01_20150410011735_10504100127F6300_15APR10011735-M1BS-502547447070_01_P001-cmr.json to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/GE01/1B/2015/100/GE01_10504100127F6300_M1BS_502547447070_01/GE01_20150410011735_10504100127F6300_15APR10011735-M1BS-502547447070_01_P001-cmr.json
upload: app/stacks/cumulus/resources/granules/css/nga/WV04/.DS_Store to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/.DS_Store
upload: app/stacks/cumulus/resources/granules/css/nga/GE01/1B/2015/100/GE01_10504100127F6300_M1BS_502547447070_01/GE01_20150410011735_10504100127F6300_15APR10011735-M1BS-502547447070_01_P001-thumb.jpg to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/GE01/1B/2015/100/GE01_10504100127F6300_M1BS_502547447070_01/GE01_20150410011735_10504100127F6300_15APR10011735-M1BS-502547447070_01_P001-thumb.jpg
upload: app/stacks/cumulus/resources/granules/css/nga/GE01/1B/2015/100/GE01_10504100127F6300_M1BS_502547447070_01/GE01_20150410011735_10504100127F6300_15APR10011735-M1BS-502547447070_01_P001-BROWSE.jpg to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/GE01/1B/2015/100/GE01_10504100127F6300_M1BS_502547447070_01/GE01_20150410011735_10504100127F6300_15APR10011735-M1BS-502547447070_01_P001-BROWSE.jpg
upload: app/stacks/cumulus/resources/granules/css/nga/WV04/1B/2017/124/WV04_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_X1BS_059102583020_01/WV04_20170504052349_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_17MAY04052349-M1BS-059102583020_01_P001.tar to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/1B/2017/124/WV04_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_X1BS_059102583020_01/WV04_20170504052349_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_17MAY04052349-M1BS-059102583020_01_P001.tar
upload: app/stacks/cumulus/resources/granules/css/nga/WV04/1B/2017/124/WV04_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_X1BS_059102583020_01/WV04_20170504052349_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_17MAY04052349-M1BS-059102583020_01_P001.tif to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/1B/2017/124/WV04_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_X1BS_059102583020_01/WV04_20170504052349_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_17MAY04052349-M1BS-059102583020_01_P001.tif
upload: app/stacks/cumulus/resources/granules/css/nga/WV04/1B/2017/124/WV04_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_X1BS_059102583020_01/WV04_20170504052349_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_17MAY04052349-M1BS-059102583020_01_P001.xml to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/1B/2017/124/WV04_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_X1BS_059102583020_01/WV04_20170504052349_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_17MAY04052349-M1BS-059102583020_01_P001.xml
upload: app/stacks/cumulus/resources/granules/css/nga/WV04/1B/2017/.DS_Store to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/1B/2017/.DS_Store
upload: app/stacks/cumulus/resources/granules/css/nga/WV04/1B/2017/124/.DS_Store to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/1B/2017/124/.DS_Store
upload: app/stacks/cumulus/resources/granules/css/nga/WV04/1B/2017/124/WV04_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_X1BS_059102583020_01/WV04_20170504052349_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_17MAY04052349-M1BS-059102583020_01_P001-cmr.json to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/1B/2017/124/WV04_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_X1BS_059102583020_01/WV04_20170504052349_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_17MAY04052349-M1BS-059102583020_01_P001-cmr.json
delete: s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/1B/2017/125/WV04_594e4035-a94b-4da5-a5a2-9593702d7739-inv_X1BS_059102583030_01/WV04_20170505053805_594e4035-a94b-4da5-a5a2-9593702d7739-inv_17MAY05053805-P1BS-059102583030_01_P001.rename
upload: app/stacks/cumulus/resources/granules/css/nga/WV04/1B/2017/125/.DS_Store to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/1B/2017/125/.DS_Store
upload: app/stacks/cumulus/resources/granules/css/nga/WV04/1B/2017/125/WV04_594e4035-a94b-4da5-a5a2-9593702d7739-inv_X1BS_059102583030_01/WV04_20170505053805_594e4035-a94b-4da5-a5a2-9593702d7739-inv_17MAY05053805-P1BS-059102583030_01_P001.xml to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/1B/2017/125/WV04_594e4035-a94b-4da5-a5a2-9593702d7739-inv_X1BS_059102583030_01/WV04_20170505053805_594e4035-a94b-4da5-a5a2-9593702d7739-inv_17MAY05053805-P1BS-059102583030_01_P001.xml
upload: app/stacks/cumulus/resources/granules/css/nga/WV04/1B/2017/125/WV04_594e4035-a94b-4da5-a5a2-9593702d7739-inv_X1BS_059102583030_01/WV04_20170505053805_594e4035-a94b-4da5-a5a2-9593702d7739-inv_17MAY05053805-P1BS-059102583030_01_P001.tif to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/1B/2017/125/WV04_594e4035-a94b-4da5-a5a2-9593702d7739-inv_X1BS_059102583030_01/WV04_20170505053805_594e4035-a94b-4da5-a5a2-9593702d7739-inv_17MAY05053805-P1BS-059102583030_01_P001.tif
upload: app/stacks/cumulus/resources/granules/css/nga/WV04/1B/2017/125/WV04_594e4035-a94b-4da5-a5a2-9593702d7739-inv_X1BS_059102583030_01/WV04_20170505053805_594e4035-a94b-4da5-a5a2-9593702d7739-inv_17MAY05053805-P1BS-059102583030_01_P001.tar to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/1B/2017/125/WV04_594e4035-a94b-4da5-a5a2-9593702d7739-inv_X1BS_059102583030_01/WV04_20170505053805_594e4035-a94b-4da5-a5a2-9593702d7739-inv_17MAY05053805-P1BS-059102583030_01_P001.tar
upload: app/stacks/cumulus/resources/granules/css/nga/WV04/1B/2017/124/WV04_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_X1BS_059102583020_01/WV04_20170504052349_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_17MAY04052349-M1BS-059102583020_01_P001-BROWSE.jpg to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/1B/2017/124/WV04_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_X1BS_059102583020_01/WV04_20170504052349_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_17MAY04052349-M1BS-059102583020_01_P001-BROWSE.jpg
upload: app/stacks/cumulus/resources/granules/css/nga/WV04/1B/2017/125/WV04_594e4035-a94b-4da5-a5a2-9593702d7739-inv_X1BS_059102583030_01/WV04_20170505053805_594e4035-a94b-4da5-a5a2-9593702d7739-inv_17MAY05053805-P1BS-059102583030_01_P001-cmr.json to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/1B/2017/125/WV04_594e4035-a94b-4da5-a5a2-9593702d7739-inv_X1BS_059102583030_01/WV04_20170505053805_594e4035-a94b-4da5-a5a2-9593702d7739-inv_17MAY05053805-P1BS-059102583030_01_P001-cmr.json
upload: app/stacks/cumulus/resources/granules/css/nga/WV04/1B/2017/124/WV04_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_X1BS_059102583020_01/WV04_20170504052349_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_17MAY04052349-M1BS-059102583020_01_P001-thumb.jpg to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/1B/2017/124/WV04_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_X1BS_059102583020_01/WV04_20170504052349_83bb16c4-7823-4319-b7c3-eb61ef75ff86-inv_17MAY04052349-M1BS-059102583020_01_P001-thumb.jpg
upload: app/stacks/cumulus/resources/granules/css/nga/WV04/1B/2017/125/WV04_594e4035-a94b-4da5-a5a2-9593702d7739-inv_X1BS_059102583030_01/WV04_20170505053805_594e4035-a94b-4da5-a5a2-9593702d7739-inv_17MAY05053805-P1BS-059102583030_01_P001-BROWSE.jpg to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/1B/2017/125/WV04_594e4035-a94b-4da5-a5a2-9593702d7739-inv_X1BS_059102583030_01/WV04_20170505053805_594e4035-a94b-4da5-a5a2-9593702d7739-inv_17MAY05053805-P1BS-059102583030_01_P001-BROWSE.jpg
upload: app/stacks/cumulus/resources/granules/css/nga/WV04/1B/2017/125/WV04_594e4035-a94b-4da5-a5a2-9593702d7739-inv_X1BS_059102583030_01/WV04_20170505053805_594e4035-a94b-4da5-a5a2-9593702d7739-inv_17MAY05053805-P1BS-059102583030_01_P001-thumb.jpg to s3://csda-cumulus-kris-sbx7894-provider-7894/css/nga/WV04/1B/2017/125/WV04_594e4035-a94b-4da5-a5a2-9593702d7739-inv_X1BS_059102583030_01/WV04_20170505053805_594e4035-a94b-4da5-a5a2-9593702d7739-inv_17MAY05053805-P1BS-059102583030_01_P001-thumb.jpg

➜  csdap-cumulus git:(iss211__Define_DM_for_GE01_MSI_L1B) ✗ DOTENV=.env.sandbox make bash
sha256:aaaaa
WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested
WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested
(csda-cumulus-sbx-7894:kris-sbx7894):/work $ cumulus rules enable --name GE01_MSI_L1B___1_SmokeTest
{
  "workflow": "DiscoverAndQueueGranules",
  "collection": {
    "name": "GE01_MSI_L1B",
    "version": "1"
  },
  "updatedAt": 1692997373043,
  "meta": {
    "endDate": "2015-04-11T00:00:00Z",
    "discoverOnly": false,
    "ingestedPathFormat": "'GE01_MSI_L1B___1/'yyyy/DDD",
    "rule": {
      "state": "ENABLED"
    },
    "providerPathFormat": "'css/nga/GE01/1B/'yyyy/DDD",
    "step": "P1D",
    "startDate": "2015-04-10T00:00:00Z"
  },
  "createdAt": 1692996657783,
  "provider": "maxar",
  "name": "GE01_MSI_L1B___1_SmokeTest",
  "rule": {
    "type": "onetime"
  },
  "state": "ENABLED"
}
(csda-cumulus-sbx-7894:kris-sbx7894):/work $ 
(csda-cumulus-sbx-7894:kris-sbx7894):/work $ 
(csda-cumulus-sbx-7894:kris-sbx7894):/work $ cumulus rules run --name GE01_MSI_L1B___1_SmokeTest
{
  "name": "GE01_MSI_L1B___1_SmokeTest",
  "workflow": "DiscoverAndQueueGranules",
  "provider": "maxar",
  "collection": {
    "name": "GE01_MSI_L1B",
    "version": "1"
  },
  "rule": {
    "type": "onetime"
  },
  "state": "ENABLED",
  "meta": {
    "rule": {
      "state": "ENABLED"
    },
    "step": "P1D",
    "endDate": "2015-04-11T00:00:00Z",
    "startDate": "2015-04-10T00:00:00Z",
    "discoverOnly": false,
    "ingestedPathFormat": "'GE01_MSI_L1B___1/'yyyy/DDD",
    "providerPathFormat": "'css/nga/GE01/1B/'yyyy/DDD"
  },
  "createdAt": 1692996657783,
  "updatedAt": 1692997373043
}
(csda-cumulus-sbx-7894:kris-sbx7894):/work $ 

Verified SmokeTest Passed, the files exist in S3
  https://s3.console.aws.amazon.com/s3/buckets/csda-cumulus-kris-sbx7894-protected-7894?region=us-west-2&prefix=GE01_MSI_L1B___1/2015/100/GE01_20150410011735_10504100127F6300_15APR10011735-M1BS-502547447070_01_P001/&showversions=false

[krisstanton]

There was a Cumulus related bug found where RelatedUrls were sometimes getting duplicated. Report was made here: https://bugs.earthdata.nasa.gov/browse/CSDAP-314 An example of the error message:

"errorMessage": "Failed to ingest, statusCode: 422, statusMessage: Unprocessable Entity, CMR error message: [{\"path\":[\"RelatedUrls\"],\"errors\":[\"Related Urls must be unique. This contains duplicates named [https://data.csda.uat.earthdata.nasa.gov/csdap-cumulus-uat-protected/GE01_MSI_L1B___1/2015/001/GE01_20150101154235_105041001201C700_15JAN01154235-M1BS-054356738030_01_P004/GE01_20150101154235_105041001201C700_15JAN01154235-M1BS-054356738030_01_P004-BROWSE.jpg, https://data.csda.uat.earthdata.nasa.gov/csdap-cumulus-uat-protected/GE01_MSI_L1B___1/2015/001/GE01_20150101154235_105041001201C700_15JAN01154235-M1BS-054356738030_01_P004/GE01_20150101154235_105041001201C700_15JAN01154235-M1BS-054356738030_01_P004.ntf, https://data.csda.uat.earthdata.nasa.gov/csdap-cumulus-uat-protected/GE01_MSI_L1B___1/2015/001/GE01_20150101154235_105041001201C700_15JAN01154235-M1BS-054356738030_01_P004/GE01_20150101154235_105041001201C700_15JAN01154235-M1BS-054356738030_01_P004.tar, https://data.csda.uat.earthdata.nasa.gov/csdap-cumulus-uat-protected/GE01_MSI_L1B___1/2015/001/GE01_20150101154235_105041001201C700_15JAN01154235-M1BS-054356738030_01_P004/GE01_20150101154235_105041001201C700_15JAN01154235-M1BS-054356738030_01_P004.xml].\"]}]",