daniellecrobinson / Data-Rescue-PDX

Volunteer guide, and other materials for DATA RESCUE PDX
30 stars 6 forks source link

Metadata: Billion-Dollar Weather and Climate Disasters #20

Open junosuarez opened 7 years ago

junosuarez commented 7 years ago

Climate Mirror dataset title: Billion-Dollar Weather and Climate Disasters

Climate Mirror issue: https://github.com/climate-mirror/datasets/issues/14

Link to datafile: https://www.ncdc.noaa.gov/billions

Agency: National Oceanic & Atmospheric Administration (NOAA)

Agency Division: (NESDIS)

Agency Subdivision: (NCEI)

Agency Sub-Subdivision: (NCDC)

Bulk Download Link: ???

Size Estimate: ???

Data Type: "Quantification of dollar costs of climate disasters. Includes tabular and time series data of climate disasters, geographic data of disasters by state, pdf reports of individual disaster events, and research papers published from this data."

Citation: NOAA National Centers for Environmental Information (NCEI) U.S. Billion-Dollar Weather and Climate Disasters (2017). https://www.ncdc.noaa.gov/billions/

Other URLS:

JSON:

{
  "name": "billion-dollar-weather-and-climate-disasters",
  "title": "Billion-Dollar Weather and Climate Disasters",
  "maintainer": "NOAA National Centers for Environmental Information (NCEI)",
  "maintainer_email": "",
  "id": "",
  "metadata_created": "",
  "metadata_modified": "",
  "author": null,
  "author_email": null,
  "type": "dataset",
  "notes": "Quantification of dollar costs of climate disasters. Includes tabular and time series data of climate disasters, geographic data of disasters by state, pdf reports of individual disaster events, and research papers published from this data.",
  "license_id": "public domain",
  "organization": {
    "description": "",
    "created": "",
    "title": "NOAA",
    "name": "",
    "is_organization": true,
    "image_url": "",
    "type": "organization",
    "id": null
  },
  "resources": [
    {
      "url": "https://www.ncdc.noaa.gov/billions/time-series.csv",
      "describedBy": "https://www.ncdc.noaa.gov/billions/time-series",
      "hash": "",
      "format": "csv",
      "mimetype": "",
      "name": "Billion-Dollar Disasters by Event Type and Year (1980-2016)",
      "created": ""
    },
    {
      "url": "https://www.ncdc.noaa.gov/billions/state-frequency-data.csv",
      "describedBy": "https://www.ncdc.noaa.gov/billions/mapping",
      "hash": "",
      "format": "csv",
      "mimetype": "",
      "name": "1980-2016 Billion-Dollar Weather and Climate Disasters By State",
      "created": ""
    },
    {
      "url": "https://www.ncdc.noaa.gov/billions/events.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "hash": "",
      "format": "pdf",
      "mimetype": "",
      "name": "Weather and Climate Billion-Dollar Disasters to affect the U.S. from 1980-2016",
      "created": ""
    },
    {
      "url": "https://www.ncdc.noaa.gov/billions/events",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "hash": null,
      "format": "html",
      "mimetype": null,
      "name": "Weather and Climate Billion-Dollar Disasters to affect the U.S. from 1980-2016",
      "created" : null
    },
    {
      "url": "https://www.ncdc.noaa.gov/monitoring-content/billions/docs/smith-and-matthews-2015.pdf",
      "describedBy": "http://dx.doi.org/10.1007/s11069-015-1678-x",
      "hash": null,
      "format": "pdf",
      "mimetype": null,
      "name": "Smith, A., and J. Matthews, 2015: Quantifying Uncertainty and Variable Sensitivity within the U.S. Billion-dollar Weather and Climate Disaster Cost Estimates. Natural Hazards. DOI: 10.1007/s11069-015-1678-x",
      "created": null
    },
    {
      "url": "https://www.ncdc.noaa.gov/monitoring-content/billions/docs/smith-and-katz-2013.pdf",
      "describedBy": "http://dx.doi.org/10.1007/s11069-013-0566-5",
      "hash": null,
      "format": "pdf",
      "mimetype": null,
      "name": "Smith, A., and R. Katz, 2013: U.S. Billion-dollar Weather and Climate Disasters: Data Sources, Trends, Accuracy and Biases. Natural Hazards. DOI: 10.1007/s11069-013-0566-5",
      "created": null      
    },
    {
      "url": "https://www.ncdc.noaa.gov/monitoring-content/billions/docs/lott-and-ross-2006.pdf",
      "describedBy": null,
      "hash": null,
      "format": "pdf",
      "mimetype": null,
      "name": "Lott, N., and T. Ross, 2006: Tracking and evaluating U. S. billion dollar weather disasters, 1980-2005. Preprints. AMS Forum: Environmental Risk and Impacts on Society: Successes and Challenges, Atlanta, GA, Amer. Meteor. Soc., 1.2.",
      "created": null
    },
    {
      "url": "https://www.ncdc.noaa.gov/monitoring-content/billions/docs/lott-and-ross-2003.pdf",
      "describedBy": null,
      "hash": null,
      "format": "pdf",
      "mimetype": null,
      "name": "Lott, N., and T. Ross, 2003: A Climatology of 1980-2003 Extreme Weather and Climate Events, Technical Report.",
      "created": null
    },
    {
      "name": "Colorado Flooding September 10-16 2013",
      "url": "http://www.nws.noaa.gov/oh/hdsc/aep_storm_analysis/8_Colorado_2013.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Sandy October 2012",
      "url": "http://www.nhc.noaa.gov/data/tcr/AL182012_Sandy.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Hurricane Isaac August 2012",
      "url": "http://www.nhc.noaa.gov/data/tcr/AL092012_Isaac.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Midwest Flooding Summer 2008",
      "url": "https://www1.ncdc.noaa.gov/pub/data/extremeevents/specialreports/2008-Midwestern-US-Floods.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Spring Freeze April 2007",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr200801/tech-report-200801.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Hurricane Katrina August 2005",
      "url": "https://www.ncdc.noaa.gov/oa/reports/tech-report-200501z.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Hurricane Lili October 2002",
      "url": "http://www.nhc.noaa.gov/data/tcr/AL132002_Lili.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Western/ Eastern Severe Weather and Flooding Winter-Spring 1998",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9802/tr9802.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "West Coast Flooding December 1996-January 1997",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9701/tr9701.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Pacific Northwest Severe Flooding February 1996",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9602/tr9602.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Blizzard/ Floods January 1996",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9602/tr9602.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Hurricane Opal October 1995",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9502/tr9502.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "California Flooding January-March 1995",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9501/tr9501.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Tropical Storm Alberto July 1994",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9403/tr9403.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Southeast Ice Storm February 1994",
      "url": "https://www.ncdc.noaa.gov/oa/pub/data/special/iwais96.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Southeast Drought/ Heat Wave Summer 1993",
      "url": "https://www.ncdc.noaa.gov/oa/climate/research/papers/summer93/weather.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Midwest Flooding Summer 1993",
      "url": "https://www.ncdc.noaa.gov/oa/climate/research/papers/summer93/weather.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "East Coast Blizzard and Severe Weather March 1993",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9301/tr9301.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Colorado Flooding September 10-16 2013",
      "url": "http://www.nws.noaa.gov/oh/hdsc/aep_storm_analysis/8_Colorado_2013.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Sandy October 2012",
      "url": "http://www.nhc.noaa.gov/data/tcr/AL182012_Sandy.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Hurricane Isaac August 2012",
      "url": "http://www.nhc.noaa.gov/data/tcr/AL092012_Isaac.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Midwest Flooding Summer 2008",
      "url": "https://www1.ncdc.noaa.gov/pub/data/extremeevents/specialreports/2008-Midwestern-US-Floods.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Spring Freeze April 2007",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr200801/tech-report-200801.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Hurricane Katrina August 2005",
      "url": "https://www.ncdc.noaa.gov/oa/reports/tech-report-200501z.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Hurricane Lili October 2002",
      "url": "http://www.nhc.noaa.gov/data/tcr/AL132002_Lili.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Western/ Eastern Severe Weather and Flooding Winter-Spring 1998",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9802/tr9802.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "West Coast Flooding December 1996-January 1997",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9701/tr9701.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Pacific Northwest Severe Flooding February 1996",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9602/tr9602.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Blizzard/ Floods January 1996",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9602/tr9602.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Hurricane Opal October 1995",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9502/tr9502.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "California Flooding January-March 1995",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9501/tr9501.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Tropical Storm Alberto July 1994",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9403/tr9403.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Southeast Ice Storm February 1994",
      "url": "https://www.ncdc.noaa.gov/oa/pub/data/special/iwais96.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Southeast Drought/ Heat Wave Summer 1993",
      "url": "https://www.ncdc.noaa.gov/oa/climate/research/papers/summer93/weather.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "Midwest Flooding Summer 1993",
      "url": "https://www.ncdc.noaa.gov/oa/climate/research/papers/summer93/weather.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    },
    {
      "name": "East Coast Blizzard and Severe Weather March 1993",
      "url": "https://www1.ncdc.noaa.gov/pub/data/techrpts/tr9301/tr9301.pdf",
      "describedBy": "https://www.ncdc.noaa.gov/billions/events",
      "format": "pdf"
    }
  ]
}
junosuarez commented 7 years ago

Many of the resources were extracted from https://www.ncdc.noaa.gov/billions/events with the following script in the chrome console:

copy(jQuery('a[href$=".pdf"]').closest('td').toArray().map(e => {e=jQuery(e); var name =  e.text().trim().replace(/\s\s+/g, ' ').replace('†',''); var url=e.find('a').attr('href'); if (url.startsWith('/')) url = 'https://www.ncdc.noaa.gov' + url; return {name, url, describedBy: 'https://www.ncdc.noaa.gov/billions/events', format: 'pdf'} }).map(i => JSON.stringify(i, null, 2)).join(',\n'))