search

NEONScience / NEON-utilities

Utilities and scripts for working with NEON data. Currently: an R package with functions to join (stack) the month-by-site files in downloaded NEON data, to convert data to geoCSV format, and to download data from the API.
GNU Affero General Public License v3.0
57 stars 36 forks source link

new error in loadByProduct() #121

Open kellyaho opened 2 years ago

kellyaho commented 2 years ago

Function Which of the functions in the neonUtilities package is this bug found in? loadByProduct()

Describe the bug A clear and concise description of what the bug is. Error: lexical error: invalid char in json text. <!DOCTYPE html> <html lang="en" (right here) ------^

To Reproduce What function inputs revealed the bug? loadByProduct(dpID = "DP1.20190.001", site = "POSE", check.size = FALSE)

Expected behavior A clear and concise description of what you expected to happen. Normally, my data loads as is expected.

System (please complete the following information):

Additional context Add any other context about the problem here. This issue just started in code that I have been successfully using for a couple of months. I've tried updating neonUtilities from both CRAN and Github, and get the same error for both. I am using jsonlite 1.7.2.

cklunch commented 2 years ago

@kellyaho I haven't been able to replicate this error. Let me know if you're still seeing it today, and let's troubleshoot offline.

cklunch commented 2 years ago

We determined this was due to some sort of firewall/security issue on the local machine. Leaving this issue open for now in case other users run into the same problem, but it is not a neonUtilities code problem. If users run into this, please get in touch with NEON, either by commenting on this issue or through the Contact Us page.

BrennanTHays commented 2 years ago

I also had a similar issue today. I've run this code with no issue for a roughly a year and it suddenly threw out an error.

Code: SRER.site.data <- loadByProduct(dpID = "DP1.10022.001", site = c( "SRER"), startdate = "2017-05", enddate = "2019-09")

Error message: Error in getZipUrls(month.urls, avg = avg, package = package, dpID = dpID, : No files found. This indicates either your internet connection failed, or the API is temporarily unavailable, or the data available for DP1.10022.001 are all hosted elsewhere. Check the data portal data.neonscience.org for outage alerts, and check the DP1.10022.001 data download page for external links.

OS: macOS Big Sur version 11.1

After seeing the post here about it being a local issue I threw the same code over to a colleague and had them run it. It worked fine for them so I realized it was a local issue. Updating my Rstudio fixed it. Not sure exactly what that solved, but just throwing it up here in case anyone runs into a similar issue.