daniellecrobinson / Data-Rescue-PDX

Volunteer guide, and other materials for DATA RESCUE PDX
30 stars 6 forks source link

Issue #220(subset) NASA GSFC Reflectivity Monitoring Data #13

Open serverless-mom opened 7 years ago

serverless-mom commented 7 years ago

Climate Mirror dataset title: NASA GSFC Ozone Monitoring Data #220

Climate Mirror issue: https://github.com/climate-mirror/datasets/issues/220

Link to datafiles: ftp://toms.gsfc.nasa.gov/pub/omi/data/reflectivity/

Agency: NASA

Agency Division:

Agency Subdivision:

Agency Sub-Subdivision:

Bulk Download Link: e.g. ftp://toms.gsfc.nasa.gov/pub/omi/data/reflectivity/

Size Estimate:

Data Type: data/reflectivity/Yyyyy/L3_reflc_omi_yyyyMMDD.txt Daily reflectivity data. Format similar to that of ozone data.

 The vales are in 3 digit groups 111222333444555
 Sample reflectivity value: `_83 = 83%          999=fill value`

Other URLS: https://mirrors.asun.co/climate-mirror/toms.gsfc.nasa.gov/pub/omi/data/ozone

JSON:

{
  "name": "Ozone Monitoring Instrument (OMI) / AURA level 3e Ozone data",
  "title": "Ozone Monitoring Instrument (OMI) / AURA",
  "maintainer": "Dr. Richard D. McPeters",
  "maintainer_email": "mcpeters@wrabbit.gsfc.nasa.gov",
  "id": "",
  "metadata_created": "2017-02-03T00:00:00.228971",
  "metadata_modified": "2017-02-03T00:00:00.228971",
  "author": null,
  "author_email": null,
  "type": "dataset",
  "description": "
data/reflectivity/Yyyyy/L3_reflc_omi_yyyyMMDD.txt
     Daily reflectivity data. Format similar to that of ozone data.

     The vales are in 3 digit groups 111222333444555
     Sample reflectivity value: `_83 = 83%          999=fill value`",
  "notes":  " data source is ftp://toms.gsfc.nasa.gov/pub/omi/data/Level3e/ozone/ The following was copied from some similar-looking metadata for a differentlfy formatted dataset from the same probe source, but apparently stored in a different format. That URL:\n https://catalog.data.gov/dataset/omi-aura-surface-reflectance-climatology-level-3-global-0-5deg-lat-lon-grid-v003-56908 \n\n copypaste follows {"@type": "dcat:Dataset", "_id": {"$oid": "55942ab5c63a7fe59b49a710"}, "accessLevel": "public", "accrualPeriodicity": "irregular", "bureauCode": ["026:00"], "contactPoint": {"fn": "JENNIFER WEI, PH. D", "hasEmail": "mailto:jennifer.c.wei@nasa.gov"}, "description": "The OMI Earth Surface Reflectance Climatology product, OMLER (Global 0.5deg Lat/Lon grid) which is based on Version 003 Level-1B top of atmosphere upwelling radiance and incoming irradiance, is now available ( http://disc.gsfc.nasa.gov/Aura/OMI/omler_v003.shtml ) from the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). \n                        \nOMI calibrated and geolocated radiances from 159 channels in UV1(264-311 nm), 557 channels in UV2 (307-383 nm) and 751 channels in VIS (349-504) spectral  regions, spectral irradiances, calibration measurements, and all derived geophysical atmospheric products (Level-2 and 3) are archived at the NASA Goddard DAAC.\n                              \n(The shortname for this OMI Level-3 Product is OMLER) \nThe lead algorithm scientists for this product are KNMI scientists Dr. Quintus Kleipool and Dr. Marcel Dobber.      \n                              \nOMLER spectral surface reflectance product contains monthly and yearly climatology of the Earth's surface Lambert Equivalent Reflectance (LER) for 23 wavelengths in the spectral range 309 to 500 nm, at a spatial resolution of 0.5 by 0.5 degrees. This LER is defined as the required reflectance of an isotropic surface needed to match the observed top of the atmosphere (TOA) reflectance in a pure Rayleigh scattering atmosphere under cloud free conditions and no aerosols. The climatology is based on statistical analysis of the three years of OMI version 03 radiance data (Oct 2004-Oct 2007).  This product also provides minimum spectral surface reflectivity observed for each 0.5 deg Lat/Lon grid during the three years period. \n                         \nThe OMLER product file is produced in Hierarchical Data Format (HDF-EOS5). It is roughly 300 MB in size. For browsing and extracting data from Aura data files, some software and tools have been made available from the Aura GES DISC tools site:    http://disc.gsfc.nasa.gov/Aura/tools.shtml\n                        \nA Readme document containing brief algorithm description and file spec provided by the OMLER Algorithm lead is available from the GES DISC data product site  http://disc.gsfc.nasa.gov/Aura/OMI/omler_v003.shtml", "distribution": [{"accessURL": "http://aura.gsfc.nasa.gov/instruments/omi/", "mediaType": "application/octet-stream"}], "identifier": "C180129150-GSFCS4PA__5", "isPartOf": "C180129150-GSFCS4PA", "issued": "2008-09-08T00:00:00.000Z", "keyword": ["EARTH SCIENCE", "ATMOSPHERE", "ATMOSPHERIC RADIATION"], "landingPage": "http://reverb.echo.nasa.gov/reverb?selected=C180129150-GSFCS4PA", "language": ["en-US"], "license": "http://www.usa.gov/publicdomain/label/1.0/", "modified": "2015-06-04T00:00:00.000Z", "programCode": ["026:001"], "publisher": {"name": "GESDISC", "subOrganizationOf": {"name": "National Aeronautics and Space Administration", "subOrganizationOf": {"name": "U.S. Government"}}}, "spatial": "-180.0 -90.0 180.0 90.0", "temporal": "2005-01-01T00:00:00Z/2009-12-31T23:59:59Z", "theme": ["geospatial"], "title": "OMI/Aura Surface Reflectance Climatology Level 3 Global 0.5deg Lat/Lon Grid V003"}",
  "license": "http://www.usa.gov/publicdomain/label/1.0/",
  "modified": "2014-06-11T11:36:24Z",
  "programCode": [
    "026:001"
  ],
  "publisher": {
    "@type": "org:Organization",
    "name": "National Aeronautics and Space Administration"
  },
  "organization": {
    "description": "",
    "created": "",
    "title": "NASA",
    "name": "National Aeronautics and Space Administration",
    "is_organization": true,
    "image_url": "https://www.nasa.gov/sites/all/themes/custom/nasatwo/images/nasa-logo.svg",
    "type": "organization",
    "id": ""
  },
  "resources": []
}
max-mapper commented 7 years ago

@tobyfee I get this validation error on JSONLint.com for the JSON above, looks like there are some invalid multiline strings:

Error: Parse error on line 12:
...t",  "description": "    data / reflectivi
----------------------^
Expecting 'STRING', 'NUMBER', 'NULL', 'TRUE', 'FALSE', '{', '[', got 'undefined'