search

NASA-IMPACT / veda-data

4 stars 0 forks source link

Verify integrated ingest api in staging and reconcile collection metadata #105

Open anayeaye opened 9 months ago

anayeaye commented 9 months ago

What

The integrated ingest-api has been promoted to the staging stack. Use the support script to run the ingest-api/collections endpoint to update the collections in the staging database without causing any existing collection summaries to be removed.

Refs

AC

Note: Because this change could impact downstream dashboards, it is a good candidate for a paired project executed during a maintenance window

  • [x] verify that new integrated ingest api is properly publishing collection metadata
  • [x] dry run update staging metadata
  • [x] update staging collections
slesaad commented 8 months ago

Updates need to be promoted to staging for new ingest fixes.

botanical commented 8 months ago

Dry run testing

Ran a dry run using the mcp-test backend stack which has a snapshot of the UAH staging db

Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/campfire-lst-night-diff Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/OMI_trno2-COG Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-tws Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1B2b_Natural_Gas_Processing Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/grdi-shdi-raster Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/conus-reach Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1B1a_Coal_Mining_Underground An error occurred for collectionId ndvi_diff_Ian_2022-09-30_2022-09-05: 404 Client Error: Not Found for url: https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/ndvi_diff_Ian_2022-09-30_2022-09-05 An error occurred for collectionId entropy_difference_2022-09-05_2022-09-30: 404 Client Error: Not Found for url: https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/entropy_difference_2022-09-05_2022-09-30 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/snow-projections-median-585 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-socioeconomic Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_4B_Manure_Management Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/geoglam Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/OMSO2PCA-COG Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-tws-trend Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_2B5_Petrochemical_Production Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1B2b_Natural_Gas_Production Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/facebook_population_density Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-tws-nonstationarity-index Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/modis-albedo-wsa-diff-2015-2022 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-overall Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/ceos-co2-flux-budgets-mean Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/grdi-v1-raster Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_6A_Landfills_Industrial Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_6B_Wastewater_Treatment_Domestic Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/snow-projections-median-245 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_6D_Composting Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/ecco-surface-height-change Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/hls-l30-002-ej-reprocessed Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/houston-aod Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/ls8-covid-19-example-data Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/IS2SITMOGR4-cog Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/hls-bais2-v2 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/recovery-proxy-maps-covid-19 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-swe Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_2C2_Ferroalloy_Production Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/campfire-ndvi-diff Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-gpp-trend Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/nightlights-500m-daily Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_4A_Enteric_Fermentation Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/eis_fire_newfirepix Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/barc-thomasfire Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/cygnss-watermask-ucar Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/nightlights-hd-1band Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/grdi-cdr-raster Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/modis-lst-night-diff-2015-2022 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-gpp Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-evap Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/houston-lst-day Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/landsat-c2l2-sr-antarctic-glaciers-pine-island Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/cygnss-watermask-ucberkeley Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-monthly-emissions_1B2b_Natural_Gas_Production Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-qs Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-qsb Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/blue-tarp-planetscope Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/landsat-c2l2-sr-lakes-aral-sea Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/damage_probability_2022-10-03 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/caldor-fire-burn-severity Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/houston-lst-diff Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/co2-mean Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/nceo_africa_2017 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/grdi-vnl-slope-raster Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/disturbance-probability-percentile Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/landsat-c2l2-sr-lakes-tonle-sap Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/disalexi-etsuppression Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-overall-nopop Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/houston-aod-diff Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-monthly-emissions_1A_Combustion_Stationary Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/nightlights-hd-monthly Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-household-nopop Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/slowdown-proxy-covid-19-changing-landscapes Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-daily-emissions_5_Forest_Fires Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/ceos-co2-flux-budgets Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/eis_fire_fireline Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_6A_Landfills_Municipal Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/houston-landcover Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/frp-max-thomasfire Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-minority Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/grdi-imr-raster Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/landsat-c2l2-sr-lakes-lake-balaton Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/modis-fire-anomalies-diff-covid-19-changing-landscape Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/landsat-nighttime-thermal Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1B2b_Natural_Gas_Transmission Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-totalprecip Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_6B_Wastewater_Treatment_Industrial Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/hls-bais2 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-tws-anomaly Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1B2a_Petroleum Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-monthly-emissions_4F_Field_Burning Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/CMIP585-winter-median-ta Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_5_Forest_Fires Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/grdi-vnl-raster Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/snow-projections-diff-245 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/campfire-nlcd Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1B2b_Natural_Gas_Distribution Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/togo-agriculture-covid-19 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/snow-projections-diff-585 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/houston-ndvi Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/eis_fire_perimeter Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/CMIP245-winter-median-ta Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/campfire-albedo-wsa-diff Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/houston-lst-night Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/co2-diff Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/blue-tarp-detection Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-etsuppression Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1B1a_Coal_Mining_Surface Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/caldor-fire-behavior Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-tvegsuppression Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/modis-annual-lai-2003-2020 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1A_Combustion_Mobile Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/hls-s30-002-ej-reprocessed Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-monthly-emissions_4B_Manure_Management Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-streamflow Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/pzd-anomaly-covid-19 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/houston-urbanization Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-housing Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/modis-lst-day-diff-2015-2022 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/hls-ndvi Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/modis_diff Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/landsat-c2l2-sr-lakes-vanern Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-global-da-gws Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/no2-monthly-diff Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/CMIP245-winter-median-pr Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1A_Combustion_Stationary Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-socioeconomic-nopop Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/landsat-c2l2-sr-antarctic-glaciers-thwaites Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/bangladesh-landcover-2001-2020 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/mtbs-burn-severity Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_4C_Rice_Cultivation Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/landsat-c2l2-sr-lakes-lake-biwa Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-monthly-emissions_1B2a_Petroleum Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/MO_NPP_npp_vgpm Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/fldas-soil-moisture-anomalies Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/modis-ndvi-diff-2015-2022 Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_1B1a_Abandoned_Coal Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/no2-monthly Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/oco2-geos-l3-daily Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-housing-nopop Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/lis-tws-trend Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/sport-lis-vsm0_100cm-percentile Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-monthly-emissions_4C_Rice_Cultivation Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-minority-nopop Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/social-vulnerability-index-household Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/grdi-filled-missing-values-count Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/hls-swir-falsecolor-composite Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/combined_CMIP6_daily_GISS-E2-1-G_tas_kerchunk_DEMO Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/grdi-v1-built Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/EPA-annual-emissions_4F_Field_Burning Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/campfire-lst-day-diff Request was successful. Find the updated collection at https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/CMIP585-winter-median-pr

You'll notice there are two errors, likely because those collections don't exist. Anyone know how I can remedy that?

An error occurred for collectionId ndvi_diff_Ian_2022-09-30_2022-09-05: 404 Client Error: Not Found for url: https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/ndvi_diff_Ian_2022-09-30_2022-09-05 An error occurred for collectionId entropy_difference_2022-09-05_2022-09-30: 404 Client Error: Not Found for url: https://e9xlhyjfhk.execute-api.us-west-2.amazonaws.com/api/stac/collections/entropy_difference_2022-09-05_2022-09-30

cc @anayeaye @slesaad @smohiudd

botanical commented 8 months ago

After input from Saadiq on slack, we'll only reconcile what exists in staging. I think then that reconciliation is good to go for early next week for "production" (staging on UAH) given that the dry run resolved the invalid STAC item issues (the invalid null values were removed or reconciled - see above links for proof).

botanical commented 8 months ago

Ran the notebook against staging this afternoon with support from @smohiudd (thanks!!) 🙇‍♀️

We verified the following:

Started a spreadsheet to record when we run collection metadata reconciliation https://docs.google.com/spreadsheets/d/1ygIOPrFJ6mgslfVrIFP6ln_-xn2CCELmXBof4aA6BR4/edit?usp=drive_link