ropensci / rnoaa

R interface to many NOAA data APIs
https://docs.ropensci.org/rnoaa
Other
330 stars 84 forks source link

Error in curl::curl_fetch_memory(url, handle = handle) : Timeout was reached #224

Closed marclos closed 7 years ago

marclos commented 7 years ago

Hello, I am new to using this package and hope to have students using it in the fall. However, I am getting an error at the starting gate and am not sure why.

library(rNOAA) ncdc_locs(locationcategoryid='CITY', sortfield='name', sortorder='desc')

Error in curl::curl_fetch_memory(url, handle = handle) : Timeout was reached

NOTE: I deleted my token.

sckott commented 7 years ago

thanks for the report @marclos sorry for delay was on vacation

looking at it.

what do you mean by

I deleted my token

sckott commented 7 years ago

works for me - reran a bunch of times - it's likely that Timeout error was a problem on NOAA's server end, so was a temporary problem.

also note that the noaa*() functions have paging, so to get all results you need to cycle through results with limit/offset parameters

can you try again, and let me know if working or not

marclos commented 7 years ago

I deleted my token from the code to avoid it being used by others, since the repository is public.

Sent from my iPhone

On Jul 12, 2017, at 10:35 AM, Scott Chamberlain notifications@github.com<mailto:notifications@github.com> wrote:

works for me - reran a bunch of times - it's likely that Timeout error was a problem on NOAA's server end, so was a temporary problem.

also note that the noaa*() functions have paging, so to get all results you need to cycle through results with limit/offset parameters

can you try again, and let me know if working or not

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/ropensci/rnoaa/issues/224#issuecomment-314841651, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ATLt3GZ0k96bdgnQP9WxCTIGTdA2baV1ks5sNQPAgaJpZM4OOkZR.

sckott commented 7 years ago

ah, good thinking - let me know if it works for you now

marclos commented 7 years ago

Hi there,

Yes, I still get the error – However! The problem seems to be with Rstudio server – NOT your package. I used a local install of R and had no problem. I used Rstudio on a local install – NO problem.

I am doing this with students, so using Rstudio server is pretty useful, it avoids spending weeks trying to teach students how to use files and folders and Macs and PCs which often are old and don’t work…

I am still getting the error with Rstudio server – is there some trouble shooting I can do to see if NOAA is responding (e.g. ping?). I suspect it’s a problem with letting our server talk to NOAA or NOAA not liking the Rstudio server gateway…not that I have any idea of what this means or how to fix it…

Marc

Marc Los Huertos Associate Professor, Environmental Analysis

Office: Seeley G. Mudd, Room 130A Pomona College (909) 607-7787 (Note: Change of Number)

Mail: Environmental Analysis Program Seeley G. Mudd, Pomona College 640 N College Ave, Rm. 130C Claremont CA 91711-7003

From: Scott Chamberlain [mailto:notifications@github.com] Sent: Wednesday, July 12, 2017 10:35 AM To: ropensci/rnoaa Cc: Marc William Los Huertos; Mention Subject: Re: [ropensci/rnoaa] Error in curl::curl_fetch_memory(url, handle = handle) : Timeout was reached (#224)

works for me - reran a bunch of times - it's likely that Timeout error was a problem on NOAA's server end, so was a temporary problem.

also note that the noaa*() functions have paging, so to get all results you need to cycle through results with limit/offset parameters

can you try again, and let me know if working or not

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/ropensci/rnoaa/issues/224#issuecomment-314841651, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ATLt3GZ0k96bdgnQP9WxCTIGTdA2baV1ks5sNQPAgaJpZM4OOkZR.

sckott commented 7 years ago

Try the request again with curl verbose output and paste in the output of that, so do > ncdc_locs(locationcategoryid='CITY', sortfield='name', sortorder='desc', config=httr::verbose())

Of course, make sure to replace/remove your API token from the output

marclos commented 7 years ago

Same error… ☹

ncdc_locs(locationcategoryid='CITY', sortfield='name', sortorder='desc', config=httr::verbose()) Error in curl::curl_fetch_memory(url, handle = handle) : Timeout was reached

Marc Los Huertos Associate Professor, Environmental Analysis

Office: Seeley G. Mudd, Room 130A Pomona College (909) 607-7787 (Note: Change of Number)

Mail: Environmental Analysis Program Seeley G. Mudd, Pomona College 640 N College Ave, Rm. 130C Claremont CA 91711-7003

From: Scott Chamberlain [mailto:notifications@github.com] Sent: Thursday, July 13, 2017 11:21 AM To: ropensci/rnoaa Cc: Marc William Los Huertos; Mention Subject: Re: [ropensci/rnoaa] Error in curl::curl_fetch_memory(url, handle = handle) : Timeout was reached (#224)

Try the request again with curl verbose output and paste in the output of that, so do > ncdc_locs(locationcategoryid='CITY', sortfield='name', sortorder='desc', config=httr::verbose())

Of course, make sure to replace/remove your API token from the output

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/ropensci/rnoaa/issues/224#issuecomment-315160895, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ATLt3OQolvk_NgOZZ5Hh1DD9h6B90WGAks5sNl_xgaJpZM4OOkZR.

sckott commented 7 years ago

that should have printed out some messages about the http request, like for example:

-> GET /cdo-web/api/v2/locations?token=xxxxx&sortfield=name&sortorder=desc&limit=25&locationcategoryid=CITY HTTP/1.1
-> Host: www.ncdc.noaa.gov
-> User-Agent: libcurl/7.51.0 r-curl/2.7 httr/1.2.1
-> Accept-Encoding: gzip, deflate
-> Accept: application/json, text/xml, application/xml, */*
-> token: xxxxx
->
<- HTTP/1.1 200 OK
<- Date: Thu, 13 Jul 2017 20:58:38 GMT
<- Server: Apache-Coyote/1.1
<- Access-Control-Allow-Origin: *
<- Access-Control-Allow-Methods: GET
<- Access-Control-Allow-Headers: token
<- Content-Type: application/json;charset=UTF-8
<- Strict-Transport-Security: max-age=31536000
<- Connection: close
<- Transfer-Encoding: chunked

paste in that info, removing your token

sckott commented 7 years ago

closing due to inactivity