davidcarslaw / worldmet

Easy access to NOAA Integrated Surface Database (ISD) surface meteorological observations
http://davidcarslaw.github.io/worldmet/
GNU General Public License v2.0
54 stars 17 forks source link

"HTTP 502 error and "site not exist"" #19

Closed jmcord closed 5 months ago

jmcord commented 3 years ago

Hello,

I am having trouble downloading some NOAA data using importNOAA(). Firstly an error of the type "Error HTTP 502" appeared, then I unstalled worldmet and installed again from CRAN and the message changed to "site not exists". This happens for all the stations in Madrid, but some months ago it worked. The stations appear when using getMeta() function. So I do not know if I am doing something wrong or what,

I would highly appreciate some guidance on solving this.

By example, this made the error:

dat <- importNOAA(code = "082220-99999", year = 2015)

Missing data for site 082220-99999 and year 2015 [1] "site(s) do not exist."

oscar-one commented 3 years ago

I am also having this problem. I tried about 10 random codes and none of them worked.

It looks like the issue is at NOAA's end - they have an error message on their website https://www.ncdc.noaa.gov/isd/data-access and the direct download is failing.

If anyone has a read on when a fix is likely, I'd be very grateful! Working towards a deadline in a week.

jmcord commented 3 years ago

The error persists. If the issue is at the NOAAs end I hope they fix it soon.

davidcarslaw commented 3 years ago

I just checked this and it seems that year is missing. Data appears to be available from mid-2017 onwards?

dat <- importNOAA(code = "082220-99999", year = 2017)
> dat
# A tibble: 4,138 x 15
   code     station   date                latitude longitude  elev    ws    wd air_temp atmos_pres
   <fct>    <fct>     <dttm>                 <dbl>     <dbl> <dbl> <dbl> <dbl>    <dbl>      <dbl>
 1 082220-… MADRID R… 2017-07-12 14:00:00     40.4     -3.68   667   2.4   228     36.6      1013.
 2 082220-… MADRID R… 2017-07-12 15:00:00     NA       NA       NA  NA      NA     NA          NA 
 3 082220-… MADRID R… 2017-07-12 16:00:00     40.4     -3.68   667   2.6   227     36.7      1013.
 4 082220-… MADRID R… 2017-07-12 17:00:00     40.4     -3.68   667   2.8   257     36        1012.
 5 082220-… MADRID R… 2017-07-12 18:00:00     NA       NA       NA  NA      NA     NA          NA 
 6 082220-… MADRID R… 2017-07-12 19:00:00     40.4     -3.68   667   2     279     33.2      1013.
 7 082220-… MADRID R… 2017-07-12 20:00:00     40.4     -3.68   667   1.3   290     31.1      1014.
 8 082220-… MADRID R… 2017-07-12 21:00:00     NA       NA       NA  NA      NA     NA          NA 
 9 082220-… MADRID R… 2017-07-12 22:00:00     40.4     -3.68   667   1.8   324     28.5      1015.
10 082220-… MADRID R… 2017-07-12 23:00:00     40.4     -3.68   667   1.5   326     27.1      1016.
# … with 4,128 more rows, and 5 more variables: visibility <dbl>, dew_point <dbl>, RH <dbl>,
#   ceil_hgt <dbl>, pwc <chr>
minato-zaki commented 1 year ago

I've been having the same problem for a while, though the site data always shows the latest update. Maybe there's something wrong with the download function of NOAA.

davidcarslaw commented 1 year ago

I think the NOAA website might be down. I will check again later...

Thanks

minato-zaki commented 1 year ago

It does work! I really appreciate that