earthcube / scheduler

Scheduling approaches related to gleaner tooling
Apache License 2.0
0 stars 0 forks source link

delete old files from s3 #136

Open valentinedwv opened 2 months ago

valentinedwv commented 2 months ago

There can be old files in the s3 bcuket. need to delete them

valentinedwv commented 2 months ago

The hitch is if there is an issue harvest due to netowrk issue, we do want to keep them. This needs to read the extras in the reports, and duplicates.

{
  "source": "wifire",
  "graph": null,
  "sitemap": "https://wifire-data.sdsc.edu/sitemap.xml",
  "date": "2024-08-26",
  "bucket": "test",
  "s3store": "oss.geocodes-aws-dev.earthcube.org:443",
  "sitemap_geturls_time": 0.6694564819335938,
  "s3_geturls_time": 8.887361288070679,
  "sitemap_count": 3510,
  "summoned_count": 3862,
  "missing_sitemap_summon_count": 0,
  "missing_sitemap_summon": [],
  "extra_in_summon_count": 352,
  "extra_in_summon": [
    "https://wifire-data.sdsc.edu/dataset/christchurch-and-selwyn-canterbury-new-zealand-2015",
    "https://wifire-data.sdsc.edu/dataset/3d-fuel-structure-in-relation-to-prescribed-fire-ca-2020",
    "https://wifire-data.sdsc.edu/dataset/whanganui-urban-manawatu-whanganui-new-zealand-2020-2021",
    "https://wifire-data.sdsc.edu/dataset/niwot-ridge-long-term-ecological-research-site-colorado",
    "https://wifire-data.sdsc.edu/dataset/boulder-creek-critical-zone-observatory-may-2010-snow-on-lidar-survey",
    "https://wifire-data.sdsc.edu/dataset/manawatu-whanganui-new-zealand-2015-2016",
    "https://wifire-data.sdsc.edu/dataset/yosemite-ca-spatial-temporal-patterns-of-nitrogen-export",
    "https://wifire-data.sdsc.edu/dataset/idaho-lidar-consortium-ilc-st-joe-national-forest",
    "https://wifire-data.sdsc.edu/dataset/usgs-1-meter-digital-elevation-model",
    "https://wifire-data.sdsc.edu/dataset/iml-critical-zone-observatory-clear-creek-aug-2014-lidar-survey",
    "https://wifire-data.sdsc.edu/dataset/mapleton-or-transient-landscape-evolution-in-the-oregon-coast-range",
    "https://wifire-data.sdsc.edu/dataset/snake-river-wyoming",
    "https://wifire-data.sdsc.edu/dataset/usbr-upper-columbia-river-basin-west",
    "https://wifire-data.sdsc.edu/dataset/sierra-national-forest-ca-soil-formation-and-transport",
    "https://wifire-data.sdsc.edu/dataset/teton-conservation-district-wyoming-lidar",
    "https://wifire-data.sdsc.edu/dataset/west-rainier-seismic-zone-wa",
    "https://wifire-data.sdsc.edu/dataset/2010-channel-islands-lidar-collection",
    "https://wifire-data.sdsc.edu/dataset/north-carolina-coast-quantifying-patterns-of-coastal-change-july-2007",
    "https://wifire-data.sdsc.edu/dataset/southwest-flank-of-mt-rainier-wa",
    "https://wifire-data.sdsc.edu/dataset/2014-usfs-tahoe-national-forest-lidar",
    "https://wifire-data.sdsc.edu/dataset/rio-puerco-river-nm-study-of-overbank-flood-dynamics",
    "https://wifire-data.sdsc.edu/dataset/balclutha-otago-new-zealand-2020",
    "https://wifire-data.sdsc.edu/dataset/earthscope-alaska-denali-totschunda-lidar-project",
    "https://wifire-data.sdsc.edu/dataset/auckland-south-new-zealand-2016-2017",
    "https://wifire-data.sdsc.edu/dataset/little-san-bernardino-mountains-joshua-tree-national-park-california",
    "https://wifire-data.sdsc.edu/dataset/2019-ridgecrest-ca-post-earthquake-digital-surface-model",
    "https://wifire-data.sdsc.edu/dataset/mapping-of-diamond-fork-river-ut-2017",
    "https://wifire-data.sdsc.edu/dataset/jemez-river-basin-snow-off-lidar-survey",
    "https://wifire-data.sdsc.edu/dataset/idaho-lidar-consortium-ilc-south-fork-salmon-and-secesh-rivers",
    "https://wifire-data.sdsc.edu/dataset/distribution-and-legacy-of-large-landslides-san-gabriel-mountains-ca-2017",
    "https://wifire-data.sdsc.edu/dataset/na-pali-coast-kauai-hawaii",
    "https://wifire-data.sdsc.edu/dataset/erosion-and-sedimentation-within-the-kern-river-canyon-ca",
    "https://wifire-data.sdsc.edu/dataset/el-mayor-cucapah-earthquake-rupture-terrestrial-laser-scan-site-2",
    "https://wifire-data.sdsc.edu/dataset/northern-california-coast-slope-failure-in-low-and-high-uplift-regions",
    "https://wifire-data.sdsc.edu/dataset/yosemite-national-park-ca-rockfall-studies",
    "https://wifire-data.sdsc.edu/dataset/august-24-2014-south-napa-earthquake",
    "https://wifire-data.sdsc.edu/dataset/hawaii-kauai-survey",
    "https://wifire-data.sdsc.edu/dataset/durham-nh-hyporheic-zone-extent-and-exchange-in-a-coastal-stream",
    "https://wifire-data.sdsc.edu/dataset/cheviot-and-hawarden-canterbury-new-zealand-2015",
    "https://wifire-data.sdsc.edu/dataset/lost-river-fault-at-doublespring-pass-rd-idaho-2015",
    "https://wifire-data.sdsc.edu/dataset/bald-point-fl-hurricane-frequency-and-storm-surge-archives-from-sinkholes",
    "https://wifire-data.sdsc.edu/dataset/alos-world-3d-30m",
    "https://wifire-data.sdsc.edu/dataset/b4-project-southern-san-andreas-and-san-jacinto-faults-classified-lidar",
    "https://wifire-data.sdsc.edu/dataset/topographic-stress-controls-san-bernardino-mountains-ca-2017",
    "https://wifire-data.sdsc.edu/dataset/pge-diablo-canyon-power-plant-dcpp-los-osos-ca-central-coast",
    "https://wifire-data.sdsc.edu/dataset/andrews-experimental-forest-and-willamette-national-forest-lidar-aug-2008",
    "https://wifire-data.sdsc.edu/dataset/wax-lake-delta-louisiana-usa-2013",
    "https://wifire-data.sdsc.edu/dataset/marlborough-north-marlborough-new-zealand-2020",
    "https://wifire-data.sdsc.edu/dataset/kohala-peninsula-hawaii-precipitation-effects-on-landscape-evolution",
    "https://wifire-data.sdsc.edu/dataset/calhoun-critical-zone-observatory-2016-leaf-off-lidar-survey",
    "https://wifire-data.sdsc.edu/dataset/santa-maria-river-az-vegetation-and-channel-form",
    "https://wifire-data.sdsc.edu/dataset/victor-harbour-south-australia-2011",
    "https://wifire-data.sdsc.edu/dataset/idaho-lidar-consortium-ilc-moscow-mountain",
    "https://wifire-data.sdsc.edu/dataset/westport-west-coast-new-zealand-2020",
    "https://wifire-data.sdsc.edu/dataset/queenstown-otago-new-zealand-2021",
    "https://wifire-data.sdsc.edu/dataset/israel-mediterranean-sharon-sea-cliff-2006",
    "https://wifire-data.sdsc.edu/dataset/abel-tasman-and-golden-bay-tasman-new-zealand-2016",
    "https://wifire-data.sdsc.edu/dataset/high-resolution-mapping-of-goat-rock-volcano-wa",
    "https://wifire-data.sdsc.edu/dataset/tauranga-and-coast-bay-of-plenty-new-zealand-2015",
    "https://wifire-data.sdsc.edu/dataset/auckland-north-new-zealand-2016-2018",
    "https://wifire-data.sdsc.edu/dataset/topographic-data-set-klamath-river-california-2018",
    "https://wifire-data.sdsc.edu/dataset/mapping-the-puuc-region-campeche-mexico",
    "https://wifire-data.sdsc.edu/dataset/airborne-laser-mapping-of-yosemite-national-park-ca-2007",
    "https://wifire-data.sdsc.edu/dataset/2005-san-diego-urban-region-lidar",
    "https://wifire-data.sdsc.edu/dataset/yellowstone-national-park-wy-quantifying-gravel-bed-rivers",
    "https://wifire-data.sdsc.edu/dataset/reynolds-creek-critical-zone-observatory-2015-post-soda-fire-lidar",
    "https://wifire-data.sdsc.edu/dataset/flathead-lake-biological-station-mt-september-2005",
    "https://wifire-data.sdsc.edu/dataset/surprise-valley-ca",
    "https://wifire-data.sdsc.edu/dataset/triangle-lake-or-earthquake-induced-landslide",
    "https://wifire-data.sdsc.edu/dataset/west-swanzey-nh-geomorphic-response-to-dam-removal-ashuelot-river-2010",
    "https://wifire-data.sdsc.edu/dataset/banks-peninsula-canterbury-new-zealand-2018-2019",
    "https://wifire-data.sdsc.edu/dataset/illinois-river-or-coast-ranges-2016",
    "https://wifire-data.sdsc.edu/dataset/quantifying-rock-strength-controls-in-guadalupe-mountains-nm-tx",
    "https://wifire-data.sdsc.edu/dataset/lake-bonneville-utah",
    "https://wifire-data.sdsc.edu/dataset/bay-of-plenty-northwest-new-zealand-2020-2021",
    "https://wifire-data.sdsc.edu/dataset/lost-river-fault-zone-near-borah-peak-idaho",
    "https://wifire-data.sdsc.edu/dataset/eagle-creek-fire-area-in-the-columbia-river-gorge-oregon",
    "https://wifire-data.sdsc.edu/dataset/earthscope-northern-california-lidar-project",
    "https://wifire-data.sdsc.edu/dataset/granite-dells-terrestrial-laser-scanning-dataset",
    "https://wifire-data.sdsc.edu/dataset/corpus-cristi-tx-influence-of-dunes-barrier-islands-on-hurricane-surge",
    "https://wifire-data.sdsc.edu/dataset/tuscaloosa-al-seasonal-inundation-dynamics-and-invertebrate-communities",
    "https://wifire-data.sdsc.edu/dataset/susquehanna-shale-hills-critical-zone-observatory-leaf-on-survey",
    "https://wifire-data.sdsc.edu/dataset/control-of-steepland-landscape-morphology-in-idaho-batholith",
    "https://wifire-data.sdsc.edu/dataset/2006-inegi-sierra-cucupah-empirically-corrected-lidar-dataset",
    "https://wifire-data.sdsc.edu/dataset/amberley-canterbury-new-zealand-2012",
    "https://wifire-data.sdsc.edu/dataset/landron-peak-new-mexico-survey",
    "https://wifire-data.sdsc.edu/dataset/state-of-utah-acquired-lidar-data-wasatch-front",
    "https://wifire-data.sdsc.edu/dataset/2014-2015-lidar-survey-of-the-mcmurdo-dry-valleys-antarctica",
    "https://wifire-data.sdsc.edu/dataset/slip-transfer-through-the-eastern-transverse-ranges-ca-2017",
    "https://wifire-data.sdsc.edu/dataset/2008-iowa-river-flood-lidar-iowa-city-and-the-clear-creek-watershed",
    "https://wifire-data.sdsc.edu/dataset/point-reyes-ca-landscape-response-to-tectonics",
    "https://wifire-data.sdsc.edu/dataset/2019-ridgecrest-ca-pre-earthquake-digital-surface-model-v2",
    "https://wifire-data.sdsc.edu/dataset/idaho-lidar-consortium-ilc-clear-creek",
    "https://wifire-data.sdsc.edu/dataset/clearwater-nf-id-effects-of-watershed-restoration-on-hillslope-stability",
    "https://wifire-data.sdsc.edu/dataset/north-sister-or-collier-cone-lava-flow",
    "https://wifire-data.sdsc.edu/dataset/canyon-lake-gorge-tx-mechanics-of-megaflood-erosion",
    "https://wifire-data.sdsc.edu/dataset/2011-2013-indiana-statewide-lidar",
    "https://wifire-data.sdsc.edu/dataset/rapid-response-to-2011-mississippi-flood",
    "https://wifire-data.sdsc.edu/dataset/grand-junction-co-roan-plateau",
    "https://wifire-data.sdsc.edu/dataset/idaho-falls-id-lidar-for-modeling-eolian-soil-transport",
    "https://wifire-data.sdsc.edu/dataset/kern-canyon-lidar-collection-ca-2008",
    "https://wifire-data.sdsc.edu/dataset/bay-of-plenty-new-zealand-2018-2019",
    "https://wifire-data.sdsc.edu/dataset/marlborough-new-zealand-2018",
    "https://wifire-data.sdsc.edu/dataset/central-utah-topographic-amplification-of-earthquake-ground-motions",
    "https://wifire-data.sdsc.edu/dataset/yosemite-rim-fire-lidar-2013",
    "https://wifire-data.sdsc.edu/dataset/2015-2017-state-of-utah-lidar-acquisition",
    "https://wifire-data.sdsc.edu/dataset/slumgullion-landslide-colorado",
    "https://wifire-data.sdsc.edu/dataset/apopka-fl-using-lidar-to-identify-optimal-gopher-tortoise-habitat",
    "https://wifire-data.sdsc.edu/dataset/jemez-river-basin-snow-on-lidar-survey",
    "https://wifire-data.sdsc.edu/dataset/fault-geometry-on-the-mission-creek-mill-creek-faults-ca-2017",
    "https://wifire-data.sdsc.edu/dataset/marsden-point-northland-new-zealand-2016",
    "https://wifire-data.sdsc.edu/dataset/wax-lake-delta-louisiana-usa-2009",
    "https://wifire-data.sdsc.edu/dataset/san-rafael-river-castle-dale-utah-2016",
    "https://wifire-data.sdsc.edu/dataset/el-mayor-cucapah-earthquake-4-april-2010-rupture-lidar-scan",
    "https://wifire-data.sdsc.edu/dataset/evaluating-area-volume-relationships-after-mass-wasting-event-nc-2020",
    "https://wifire-data.sdsc.edu/dataset/reporoa-and-upper-piako-river-waikato-new-zealand-2019",
    "https://wifire-data.sdsc.edu/dataset/neon-d17-pacific-southwest-california",
    "https://wifire-data.sdsc.edu/dataset/golden-gate-national-recreation-area-and-mt-tamalpais-state-park-ca",
    "https://wifire-data.sdsc.edu/dataset/powder-river-mt-2016",
    "https://wifire-data.sdsc.edu/dataset/illilouette-creek-basin-lidar-survey-yosemite-valley-ca-2018",
    "https://wifire-data.sdsc.edu/dataset/salsipuedes-punta-morro-baja-california-mexico-2014",
    "https://wifire-data.sdsc.edu/dataset/columbia-nc-modeling-coastal-plain-wetland-ecosystems",
    "https://wifire-data.sdsc.edu/dataset/west-coast-and-hauraki-plains-waikato-new-zealand-2015",
    "https://wifire-data.sdsc.edu/dataset/truckee-ca-sogehen-creek-snowpack-measurement",
    "https://wifire-data.sdsc.edu/dataset/west-swanzey-nh-geomorphic-response-to-dam-removal-ashuelot-river",
    "https://wifire-data.sdsc.edu/dataset/geomorphic-effects-of-landslide-dams-on-the-owyhee-river-oregon",
    "https://wifire-data.sdsc.edu/dataset/christina-river-basin-critical-zone-observatory-april-2010-lidar-survey",
    "https://wifire-data.sdsc.edu/dataset/thorton-nh-hydrologic-and-topographic-controls-on-organic-carbon-in-soils",
    "https://wifire-data.sdsc.edu/dataset/luquillo-czo-rio-blanco-and-rio-mameyes-lidar-survey-2010-2011",
    "https://wifire-data.sdsc.edu/dataset/palmerston-north-manawatu-whanganui-new-zealand-2018",
    "https://wifire-data.sdsc.edu/dataset/pellston-mi-effects-of-forest-canopy-structural-change-on-carbon-uptake",
    "https://wifire-data.sdsc.edu/dataset/west-bijou-creek-co",
    "https://wifire-data.sdsc.edu/dataset/north-carolina-coast-quantifying-patterns-of-coastal-change-june-2006",
    "https://wifire-data.sdsc.edu/dataset/marlborough-fault-system-south-island-new-zealand",
    "https://wifire-data.sdsc.edu/dataset/lake-placid-fl-lidar-survey-of-the-archibold-biological-station",
    "https://wifire-data.sdsc.edu/dataset/white-sands-national-monument-nm-lidar-survey-of-dune-fields-sept-2009",
    "https://wifire-data.sdsc.edu/dataset/idaho-lidar-consortium-ilc-jack-waite-mine",
    "https://wifire-data.sdsc.edu/dataset/mayapan-mexico",
    "https://wifire-data.sdsc.edu/dataset/lawrenceville-il-detecting-tectonically-deformed-shorelines",
    "https://wifire-data.sdsc.edu/dataset/abel-tasman-national-park-tasman-new-zealand-2020-2021",
    "https://wifire-data.sdsc.edu/dataset/austin-tx-rapid-response-2015",
    "https://wifire-data.sdsc.edu/dataset/coastal-dune-fields-of-garopaba-and-vila-nova-santa-catarina-state-brazil",
    "https://wifire-data.sdsc.edu/dataset/geologic-mapping-of-coal-beds-northeastern-montana",
    "https://wifire-data.sdsc.edu/dataset/ecosystem-structure-in-hetereogeneous-restored-wetlands-ca-2018",
    "https://wifire-data.sdsc.edu/dataset/post-fire-debris-flows-in-santa-monica-mountains-ca-2019",
    "https://wifire-data.sdsc.edu/dataset/piercy-ca-response-of-bedrock-river-to-base-level-lowering-sf-eel-river",
    "https://wifire-data.sdsc.edu/dataset/alteration-of-groundwater-flow-due-to-slow-landslide-failure-ca",
    "https://wifire-data.sdsc.edu/dataset/measuring-variations-in-bedrock-cliff-morphologies-idaho-2019",
    "https://wifire-data.sdsc.edu/dataset/change-detection-of-post-fire-runoff-events-ca-2019",
    "https://wifire-data.sdsc.edu/dataset/timaru-rivers-canterbury-new-zealand-2014",
    "https://wifire-data.sdsc.edu/dataset/medicine-bow-nf-wy-forest-ecosystem-impacts-by-mountain-pine-beetle",
    "https://wifire-data.sdsc.edu/dataset/woodland-encroached-sagebrush-ecosystem-nevada",
    "https://wifire-data.sdsc.edu/dataset/st-elias-mountains-and-gulf-of-alaska",
    "https://wifire-data.sdsc.edu/dataset/volcanic-tablelands-in-bishop-california",
    "https://wifire-data.sdsc.edu/dataset/usgs-1-arc-second-digital-elevation-model",
    "https://wifire-data.sdsc.edu/dataset/earthscope-intermountain-seismic-belt-lidar-project",
    "https://wifire-data.sdsc.edu/dataset/kremmling-co-blue-and-colorado-river-confluence",
    "https://wifire-data.sdsc.edu/dataset/mapping-of-san-gabriel-mountains-ca-2009-fire",
    "https://wifire-data.sdsc.edu/dataset/carrizo-plain-terrestrial-laser-scanning-dataset",
    "https://wifire-data.sdsc.edu/dataset/lake-tahoe-basin-lidar",
    "https://wifire-data.sdsc.edu/dataset/motueka-river-valley-tasman-new-zealand-2018-2019",
    "https://wifire-data.sdsc.edu/dataset/northern-rockies-montana-lidar-2016",
    "https://wifire-data.sdsc.edu/dataset/channel-avulsion-in-bishop-california",
    "https://wifire-data.sdsc.edu/dataset/gisborne-new-zealand-2018-2020",
    "https://wifire-data.sdsc.edu/dataset/dragons-back-ridge-san-andreas-fault-california",
    "https://wifire-data.sdsc.edu/dataset/tender-foot-mt-hydrological-processes-on-hill-slopes",
    "https://wifire-data.sdsc.edu/dataset/wellington-city-new-zealand-2019-2020",
    "https://wifire-data.sdsc.edu/dataset/poleta-folds-southern-deep-springs-valley-california",
    "https://wifire-data.sdsc.edu/dataset/post-hurricane-harvey-mapping-of-the-mission-river-texas-2018",
    "https://wifire-data.sdsc.edu/dataset/1959-hebgen-lake-rupture-montana",
    "https://wifire-data.sdsc.edu/dataset/parump-valley-california-nevada-state-line",
    "https://wifire-data.sdsc.edu/dataset/walker-fault-system-nevada-2015",
    "https://wifire-data.sdsc.edu/dataset/raplee-ridge-utah",
    "https://wifire-data.sdsc.edu/dataset/harper-lake-fault-slip-distribution-central-mojave-ca",
    "https://wifire-data.sdsc.edu/dataset/3d-landscape-reconstruction-and-land-use-modeling-chaco-canyon-nm-2016",
    "https://wifire-data.sdsc.edu/dataset/cache-nf-ut-predicting-bonneville-cutthroat-trout-spawning-hotspots",
    "https://wifire-data.sdsc.edu/dataset/world-bank-imagecat-inc-rit-haiti-earthquake-lidar-dataset",
    "https://wifire-data.sdsc.edu/dataset/merritt-island-fl-identification-of-florida-scrub-jay-habitat",
    "https://wifire-data.sdsc.edu/dataset/pge-diablo-canyon-power-plant-dcpp-san-simeon-and-cambria-faults-ca",
    "https://wifire-data.sdsc.edu/dataset/lidar-survey-of-parts-of-potomac-and-susquehanna-rivers",
    "https://wifire-data.sdsc.edu/dataset/very-high-resolution-airborne-lidar-at-strathalbyn-in-queensland-australia",
    "https://wifire-data.sdsc.edu/dataset/aircraft-measurement",
    "https://wifire-data.sdsc.edu/dataset/kaikoura-canterbury-new-zealand-2012",
    "https://wifire-data.sdsc.edu/dataset/hite-ut-quantifying-evolution-and-stability-of-coarse-alluvial-channels",
    "https://wifire-data.sdsc.edu/dataset/san-isabel-nf-co-debris-flow-mechanics-and-landscape-evolution",
    "https://wifire-data.sdsc.edu/dataset/queenstown-otago-new-zealand-2016",
    "https://wifire-data.sdsc.edu/dataset/oregon-department-of-geology-and-mineral-industries-lidar-program-data",
    "https://wifire-data.sdsc.edu/dataset/lidar-survey-of-the-malheur-national-forest-oregon",
    "https://wifire-data.sdsc.edu/dataset/otago-new-zealand-2016",
    "https://wifire-data.sdsc.edu/dataset/sea-grass-beds-apalachicola-fl",
    "https://wifire-data.sdsc.edu/dataset/merced-ca-origin-and-evolution-of-the-mima-mounds",
    "https://wifire-data.sdsc.edu/dataset/boulder-creek-critical-zone-observatory-august-2010-lidar-survey",
    "https://wifire-data.sdsc.edu/dataset/blind-canyon-and-box-canyon-twin-falls-id",
    "https://wifire-data.sdsc.edu/dataset/california-coast-big-creek-vincente-arroyo-seco-scotts-creek-ucsc",
    "https://wifire-data.sdsc.edu/dataset/fault-systems-in-the-eastern-california-shear-zone-ca",
    "https://wifire-data.sdsc.edu/dataset/post-fire-debris-flow-detection-and-erosion-oregon-2020",
    "https://wifire-data.sdsc.edu/dataset/yucaipa-ridge-san-bernardino-mountains-ca",
    "https://wifire-data.sdsc.edu/dataset/loma-mar-ca-lidar-survey-of-the-san-jose-mountains",
    "https://wifire-data.sdsc.edu/dataset/southern-san-andreas-fault-from-painted-canyon-to-bombay-beach-ca",
    "https://wifire-data.sdsc.edu/dataset/umd-nasa-carbon-mapping-sonoma-county-vegetation-mapping-and-lidar-program",
    "https://wifire-data.sdsc.edu/dataset/golden-bay-tasman-new-zealand-2017",
    "https://wifire-data.sdsc.edu/dataset/flathead-lake-biological-station-mt-may-2005",
    "https://wifire-data.sdsc.edu/dataset/oroville-ca-middle-fork-of-the-feather-river-sierra-nevada-foothills",
    "https://wifire-data.sdsc.edu/dataset/yosemite-national-park-poopenaut-valley-and-wawona",
    "https://wifire-data.sdsc.edu/dataset/christina-river-basin-critical-zone-observatory-july-2010-lidar-survey",
    "https://wifire-data.sdsc.edu/dataset/wellington-new-zealand-2013-2014",
    "https://wifire-data.sdsc.edu/dataset/point-classification-for-hazard-applications-mammoth-lakes-ca",
    "https://wifire-data.sdsc.edu/dataset/solfatara-plateau-obsidian-lava-flow-yellowstone-national-park-wy",
    "https://wifire-data.sdsc.edu/dataset/laytonville-ca-lidar-2015",
    "https://wifire-data.sdsc.edu/dataset/kilauea-volcano-hi-june-2018-acquisition",
    "https://wifire-data.sdsc.edu/dataset/hyak-wa-cedar-river-municipal-watershed-snow-modeling",
    "https://wifire-data.sdsc.edu/dataset/chaco-canyon-nm-simulating-dynamic-hydrological-processes",
    "https://wifire-data.sdsc.edu/dataset/eel-river-critical-zone-observatory-july-2014-lidar-survey",
    "https://wifire-data.sdsc.edu/dataset/raleigh-peak-colorado-may-2010",
    "https://wifire-data.sdsc.edu/dataset/auckland-new-zealand-2013",
    "https://wifire-data.sdsc.edu/dataset/high-resolution-topography-of-house-range-fault-utah",
    "https://wifire-data.sdsc.edu/dataset/richmond-and-motueka-tasman-new-zealand-2015",
    "https://wifire-data.sdsc.edu/dataset/surface-expression-of-the-1886-charleston-south-carolina-earthquake",
    "https://wifire-data.sdsc.edu/dataset/gabilan-mesa-ca-valley-alluviation-effects-on-hillslope-channel-coupling",
    "https://wifire-data.sdsc.edu/dataset/southern-sierra-nevada-critical-zone-observatory-snow-on",
    "https://wifire-data.sdsc.edu/dataset/earthscope-yakima-lidar-project",
    "https://wifire-data.sdsc.edu/dataset/lunar-crater-volcanic-field-central-nevada",
    "https://wifire-data.sdsc.edu/dataset/new-madrid-seismic-zone",
    "https://wifire-data.sdsc.edu/dataset/mapping-of-displacements-near-parkfield-california",
    "https://wifire-data.sdsc.edu/dataset/high-resolution-topography-near-santa-cruz-ca-2017",
    "https://wifire-data.sdsc.edu/dataset/hawaii-big-island-survey",
    "https://wifire-data.sdsc.edu/dataset/south-fork-eel-river-ca-understanding-terrace-formation-and-abandonment",
    "https://wifire-data.sdsc.edu/dataset/2013-baluchistan-pakistan-pre-earthquake-stereogrammetric-dems",
    "https://wifire-data.sdsc.edu/dataset/susquehanna-shale-hills-critical-zone-observatory-leaf-off-survey",
    "https://wifire-data.sdsc.edu/dataset/mapping-the-kaibab-plateau-az",
    "https://wifire-data.sdsc.edu/dataset/iml-critical-zone-observatory-sangamon-river-il-aug-2014",
    "https://wifire-data.sdsc.edu/dataset/wheeler-ridge-ca",
    "https://wifire-data.sdsc.edu/dataset/landers-surface-rupture-terrestrial-laser-scanning-dataset",
    "https://wifire-data.sdsc.edu/dataset/death-valley-national-park-ca-badwater-basin",
    "https://wifire-data.sdsc.edu/dataset/southern-california-bedrock-landscapes-2015-airborne-lidar",
    "https://wifire-data.sdsc.edu/dataset/big-sky-mt-patterns-of-nitrogen-export-land-use-change",
    "https://wifire-data.sdsc.edu/dataset/sw-montana-beavers-as-geomorphic-agents-in-small-rocky-mountain-streams",
    "https://wifire-data.sdsc.edu/dataset/straight-cliffs-formation-south-central-utah-2016",
    "https://wifire-data.sdsc.edu/dataset/bitterroot-nf-id-transient-hillslope-response-to-knickpoint-migration",
    "https://wifire-data.sdsc.edu/dataset/blenheim-marlborough-new-zealand-2014",
    "https://wifire-data.sdsc.edu/dataset/white-canyon-and-hite-lake-powell-utah",
    "https://wifire-data.sdsc.edu/dataset/lemhi-watershed-us-bureau-of-reclamation",
    "https://wifire-data.sdsc.edu/dataset/napa-watershed-ca",
    "https://wifire-data.sdsc.edu/dataset/global-bathymetry-and-topography-at-15-arc-sec-srtm15-v2-1",
    "https://wifire-data.sdsc.edu/dataset/airborne-laser-mapping-of-independence-lake-ca",
    "https://wifire-data.sdsc.edu/dataset/mojave-desert-ca-precariously-balanced-rocks-in-seismic-hazard-analysis",
    "https://wifire-data.sdsc.edu/dataset/everglades-national-park",
    "https://wifire-data.sdsc.edu/dataset/calhoun-critical-zone-observatory-2014-leaf-on-survey",
    "https://wifire-data.sdsc.edu/dataset/hope-fault-nz-2010",
    "https://wifire-data.sdsc.edu/dataset/mojave-desert-ca-evolution-of-the-hector-mine-earthquake-surface-rupture",
    "https://wifire-data.sdsc.edu/dataset/lincoln-national-forest-nm-floodplains-in-fluvial-networks",
    "https://wifire-data.sdsc.edu/dataset/california-arra-lidar",
    "https://wifire-data.sdsc.edu/dataset/canterbury-new-zealand-2016-2017",
    "https://wifire-data.sdsc.edu/dataset/san-bernardino-mountains-ca-2016",
    "https://wifire-data.sdsc.edu/dataset/monitoring-woodland-ecosystems-utah-2018",
    "https://wifire-data.sdsc.edu/dataset/meteor-crater-az",
    "https://wifire-data.sdsc.edu/dataset/mount-shasta-ca-quaternary-debris-avalanche",
    "https://wifire-data.sdsc.edu/dataset/2013-usfs-tahoe-national-forest-lidar",
    "https://wifire-data.sdsc.edu/dataset/northern-san-andreas-fault-ca",
    "https://wifire-data.sdsc.edu/dataset/repeat-mapping-of-antelope-valley-ranch-ca-2019",
    "https://wifire-data.sdsc.edu/dataset/missisquoi-watershed-lidar",
    "https://wifire-data.sdsc.edu/dataset/southern-sierra-nevada-critical-zone-observatory-snow-off",
    "https://wifire-data.sdsc.edu/dataset/san-gabriel-mountains-ca-tectonics-and-topography",
    "https://wifire-data.sdsc.edu/dataset/dixie-valley-fault-rupture-terrestrial-laser-scanning-dataset-site-2",
    "https://wifire-data.sdsc.edu/dataset/tushar-mountains-utah",
    "https://wifire-data.sdsc.edu/dataset/white-sands-national-monument-nm-lidar-survey-of-dune-fields",
    "https://wifire-data.sdsc.edu/dataset/meandering-channels-in-death-valley-ca-2019",
    "https://wifire-data.sdsc.edu/dataset/truro-and-provincetown-ma-lidar-in-salt-march-environments",
    "https://wifire-data.sdsc.edu/dataset/eel-river-ca-landsliding-and-the-evolution-of-mountainous-landscapes",
    "https://wifire-data.sdsc.edu/dataset/oregon-coast-range-sediment-storage-in-debris-flows",
    "https://wifire-data.sdsc.edu/dataset/noaa-isemp-watershed-sciences-bridge-creek-oregon-lidar-survey-2005",
    "https://wifire-data.sdsc.edu/dataset/earthscope-southern-eastern-california-lidar-project",
    "https://wifire-data.sdsc.edu/dataset/topography-of-normal-faults-in-the-volcanic-tablelands-ca-2018",
    "https://wifire-data.sdsc.edu/dataset/huntly-waikato-new-zealand-2015-2019",
    "https://wifire-data.sdsc.edu/dataset/big-creek-california",
    "https://wifire-data.sdsc.edu/dataset/dixie-valley-fault-rupture-terrestrial-laser-scanning-dataset-site-1",
    "https://wifire-data.sdsc.edu/dataset/2019-ridgecrest-ca-pre-earthquake-digital-surface-model",
    "https://wifire-data.sdsc.edu/dataset/el-mayor-cucapah-earthquake-pleiades-2014",
    "https://wifire-data.sdsc.edu/dataset/2016-solana-beach-ca-bluff-characterization-survey",
    "https://wifire-data.sdsc.edu/dataset/high-resolution-topography-over-gabilan-mesa-ca-2003",
    "https://wifire-data.sdsc.edu/dataset/yosemite-ca-el-portal-mariposa-grove-yosemite-canyon-tuolumne-meadows",
    "https://wifire-data.sdsc.edu/dataset/santa-clarita-topography",
    "https://wifire-data.sdsc.edu/dataset/greybull-wy-sheep-mountain-anticline",
    "https://wifire-data.sdsc.edu/dataset/haiti-digital-terrain-model-2014-2016",
    "https://wifire-data.sdsc.edu/dataset/photogrammetric-model-of-the-tecolote-volcano-sonora-mexico",
    "https://wifire-data.sdsc.edu/dataset/mapping-of-hydrothermal-explosion-craters-in-yellowstone-n-p-wy-2017",
    "https://wifire-data.sdsc.edu/dataset/inyo-domes-ca-lidar-2016",
    "https://wifire-data.sdsc.edu/dataset/thames-waikato-new-zealand-2017-2019",
    "https://wifire-data.sdsc.edu/dataset/paleo-outburst-floods-in-the-truckee-river-canyon-ca",
    "https://wifire-data.sdsc.edu/dataset/study-in-erosion-response-horse-linto-ca-2019",
    "https://wifire-data.sdsc.edu/dataset/niobrara-river-nebraska",
    "https://wifire-data.sdsc.edu/dataset/silver-plume-co",
    "https://wifire-data.sdsc.edu/dataset/2013-balochistan-earthquake-pakistan",
    "https://wifire-data.sdsc.edu/dataset/nantahala-nf-nc-forest-leaf-structure-terrain-and-hydrophysiology",
    "https://wifire-data.sdsc.edu/dataset/lidar-transects-along-yucatan-peninsula-and-san-gervasio-mexico",
    "https://wifire-data.sdsc.edu/dataset/san-rafael-ut-survey-of-exposed-subsurface-volcanic-features",
    "https://wifire-data.sdsc.edu/dataset/white-sands-national-monument-nm-lidar-survey-of-dune-fields-jan-2009",
    "https://wifire-data.sdsc.edu/dataset/2019-ridgecrest-ca-post-earthquake-lidar-collection",
    "https://wifire-data.sdsc.edu/dataset/2010-salton-sea-lidar-collection",
    "https://wifire-data.sdsc.edu/dataset/idaho-lidar-consortium-ilc-lolo-creek-and-slate-creek",
    "https://wifire-data.sdsc.edu/dataset/great-smokey-mountains-nc",
    "https://wifire-data.sdsc.edu/dataset/plum-island-ma",
    "https://wifire-data.sdsc.edu/dataset/normal-fault-comparisons-utah-2019",
    "https://wifire-data.sdsc.edu/dataset/characterizing-forest-structure-changes-and-effects-on-snowpack-az-2017",
    "https://wifire-data.sdsc.edu/dataset/boise-nf-id-avalanche-forecasting-and-acoustic-detection",
    "https://wifire-data.sdsc.edu/dataset/high-resolution-mapping-of-antelope-valley-ranch-ca",
    "https://wifire-data.sdsc.edu/dataset/owens-valley-ca-late-pleistocene-slip-rates-on-the-white-mountain-fault",
    "https://wifire-data.sdsc.edu/dataset/henry-mountains-ut-hillslope-channel-coupling-in-a-bedrock-landscape",
    "https://wifire-data.sdsc.edu/dataset/furnace-creek-and-fish-lake-valley-fault-zones-death-valley-national-park",
    "https://wifire-data.sdsc.edu/dataset/south-fork-eel-river-ca-watershed-morphology",
    "https://wifire-data.sdsc.edu/dataset/interpreting-fluvial-processes-from-channel-belt-deposits-utah-2018",
    "https://wifire-data.sdsc.edu/dataset/granite-dells-az",
    "https://wifire-data.sdsc.edu/dataset/2013-baluchistan-pakistan-post-earthquake-stereogrammetric-dems",
    "https://wifire-data.sdsc.edu/dataset/survey-of-sheepscot-narragaugus-and-pleasant-rivers-maine",
    "https://wifire-data.sdsc.edu/dataset/christchurch-and-ashley-river-canterbury-new-zealand-2018-2019",
    "https://wifire-data.sdsc.edu/dataset/whangarei-heads-northland-new-zealand-2016",
    "https://wifire-data.sdsc.edu/dataset/hamilton-waikato-new-zealand-2019",
    "https://wifire-data.sdsc.edu/dataset/lake-isabella-lidar-collection-ca-2015",
    "https://wifire-data.sdsc.edu/dataset/usbr-upper-columbia-river-basin-east",
    "https://wifire-data.sdsc.edu/dataset/furnace-creek-wash-death-valley-national-park-california",
    "https://wifire-data.sdsc.edu/dataset/perry-mesa-az-ancient-agricultural-features-and-landscape-transformation",
    "https://wifire-data.sdsc.edu/dataset/lidar-survey-of-the-black-hills-experimental-forest-south-dakota",
    "https://wifire-data.sdsc.edu/dataset/canterbury-new-zealand-2018-2019",
    "https://wifire-data.sdsc.edu/dataset/nw-nevada-modeling-of-meander-channel-evolution",
    "https://wifire-data.sdsc.edu/dataset/stanley-id-linkages-between-hydrologic-complexity-and-nutrient-export",
    "https://wifire-data.sdsc.edu/dataset/preserving-mountains-with-forest-management-ca-2020",
    "https://wifire-data.sdsc.edu/dataset/high-resolution-topography-along-the-lost-river-valley-idaho-2019",
    "https://wifire-data.sdsc.edu/dataset/hurunui-rivers-canterbury-new-zealand-2013",
    "https://wifire-data.sdsc.edu/dataset/2019-ridgecrest-ca-trona-argus-area-post-earthquake-lidar",
    "https://wifire-data.sdsc.edu/dataset/northern-walker-lane-ca-airborne-lidar-dataset",
    "https://wifire-data.sdsc.edu/dataset/trinity-river-texas-2015",
    "https://wifire-data.sdsc.edu/dataset/high-resolution-sfm-topography-of-the-central-san-andreas-fault-california",
    "https://wifire-data.sdsc.edu/dataset/idaho-lidar-consortium-ilc-nez-perce-reservation",
    "https://wifire-data.sdsc.edu/dataset/pge-diablo-canyon-power-plant-dcpp-diablo-canyon-ca-central-coast",
    "https://wifire-data.sdsc.edu/dataset/south-florida-everglades",
    "https://wifire-data.sdsc.edu/dataset/bishop-ca-morphological-characteristics-of-the-bishop-tuff",
    "https://wifire-data.sdsc.edu/dataset/idaho-lidar-consortium-ilc-emerald-creek",
    "https://wifire-data.sdsc.edu/dataset/b4-project-southern-san-andreas-and-san-jacinto-faults",
    "https://wifire-data.sdsc.edu/dataset/mackenzie-canterbury-new-zealand-2015",
    "https://wifire-data.sdsc.edu/dataset/jemez-river-basin-nm-post-fire-landscape-response",
    "https://wifire-data.sdsc.edu/dataset/lassen-volcanic-national-park-ca-2019",
    "https://wifire-data.sdsc.edu/dataset/el-mayor-cucapah-earthquake-rupture-terrestrial-laser-scan-site-1",
    "https://wifire-data.sdsc.edu/dataset/central-u-s-arra-lidar-new-madrid-seismic-zone",
    "https://wifire-data.sdsc.edu/dataset/university-of-colorado-boulder-may-2010",
    "https://wifire-data.sdsc.edu/dataset/sunset-crater-volcano-national-monument-az",
    "https://wifire-data.sdsc.edu/dataset/rangiora-canterbury-new-zealand-2014",
    "https://wifire-data.sdsc.edu/dataset/john-day-watershed-2006-us-bureau-of-reclamation",
    "https://wifire-data.sdsc.edu/dataset/greys-river-wy-bathymetric-lidar",
    "https://wifire-data.sdsc.edu/dataset/agua-blanca-fault-baja-california-mexico",
    "https://wifire-data.sdsc.edu/dataset/topography-of-normal-faults-in-the-volcanic-tablelands-ca-2019",
    "https://wifire-data.sdsc.edu/dataset/wellington-fault-nz-2010",
    "https://wifire-data.sdsc.edu/dataset/utah-geological-survey-lidar"
  ]
}