search

ropensci / rnoaa

R interface to many NOAA data APIs
https://docs.ropensci.org/rnoaa
Other
330 stars 84 forks source link

(ISD) Integrated surface database data #54

Closed sckott closed 9 years ago

sckott commented 10 years ago

http://www.ncdc.noaa.gov/oa/climate/isd/index.php

brian-may commented 10 years ago

ISD is available in a "legacy" service.

http://www7.ncdc.noaa.gov/rest/

sckott commented 10 years ago

@brian-may Thanks. Do you know if legacy means don't use it, or that it just doesn't get updates/fixes to code base, etc.

brian-may commented 10 years ago

There is a replacement planned, but no timeline. Until then no updates/fixes.

sckott commented 10 years ago

Ok, thanks

sckott commented 10 years ago

@brian-may What is the difference between data available via this REST API http://www.ncdc.noaa.gov/cdo-web/webservices/v2 and the ISD data?

brian-may commented 10 years ago

The ISD dataset is made up of sub-hourly(5min, 15min), hourly, and synoptic (3hr, 6hr, 9hr) observations. The ISD dataset will eventually be made available in the CDO v2 API, but there is no timeline for when that will happen. Currently, only the precipitation datasets in the CDO v2 API provide subdaily data.

sckott commented 10 years ago

Okay, thanks @brian-may . That's great ISD data will eventually be in the CDO v2 API - it's a nice API

sckott commented 10 years ago

@brian-may I don't see any documentation for rate limits for this API. It seems as though it may be one call every 60 seconds. True? If true, any chance of making this something more useable, like 10 seconds? or 3 seconds?

sckott commented 10 years ago

@brian-may Any idea what the headers are for the data given back by this legacy API? I can guess correctly at some of the fields, but not all

brian-may commented 10 years ago

I seem to recal that there is a rate limit on this endpoint, but I am not sure. I will look into the headers.

sckott commented 10 years ago

@brian-may thanks

brian-may commented 10 years ago

In the CSV output for ISD values the fields are: aws id, wban id, yyyymmdd, hhmm, variable id, element field 1, element field 2, element field 3, element field 4, element field 5, element field 6, element field 7, element field 8, element field 9, element field 10, element field 11, element field 12, element field 13, data source, report type.

Explanations of what these are can be found in the documentation: ftp://ftp.ncdc.noaa.gov/pub/data/noaa/ish-format-document.pdf. The number of fields a variable will have is variable so many of them will be null. The meaning of these fields is also variable, and they are defined in the documentation.

sckott commented 10 years ago

thanks @brian-may ! Any idea who I could talk to about the 60 second rate limit for the legacy API?

brian-may commented 9 years ago

You can contact Rich.Baldwin@noaa.gov, but due to the deprecated status I doubt there will be any change made.

sckott commented 9 years ago

@brian-may thanks, emailed Rich.

sckott commented 9 years ago

closing, in favor of #76