PecanProject / pecan

The Predictive Ecosystem Analyzer (PEcAn) is an integrated ecological bioinformatics toolbox.
www.pecanproject.org
Other
202 stars 231 forks source link

Interim PEcAn.data.remote::download.thredds.AGB failing #2415

Open serbinsh opened 4 years ago

serbinsh commented 4 years ago

Bug Description

when running example in PEcAn.data.remote::download.thredds.AGB

 outdir <- "~/scratch/abg_data/"
results <- PEcAn.data.remote::download.thredds.AGB(outdir=outdir, site_ids = c(676, 678, 679, 755, 767, 1000000030, 1000000145, 100Loading required package: doParallels = 8)

Im getting

2019-09-12 10:42:38 INFO   [PEcAn.data.remote::download.thredds.AGB] :
   Running in parallel with: 8
Error in get_data(i) : task 1 failed - "cannot open the connection"

Trying to ping the data: https://thredds.daac.ornl.gov/thredds/dodsC/ornldaac/1221/agb_5k.nc4 I get

Error {
    code = 400;
    message = "Unrecognized request";
};

To Reproduce

 outdir <- "~/scratch/abg_data/"
results <- PEcAn.data.remote::download.thredds.AGB(outdir=outdir, site_ids = c(676, 678, 679, 755, 767, 1000000030, 1000000145, 100Loading required package: doParallels = 8)

Expected behavior

Download the data

serbinsh commented 4 years ago

@bailsofhay maybe the URLs have changed, for example: https://thredds.daac.ornl.gov/thredds/catalog/ornldaac/1221/catalog.html?dataset=1221/agb_5k.nc4

May need to update URLs through this site: https://thredds.daac.ornl.gov/thredds/catalog.html

serbinsh commented 4 years ago

From @para2x "Seems like the address has not changed and the reason you can't look up the address is that it's associated with opendap protocol not http server. So if you go ncdf4::nc_open you should be able to open the file in that address. But in the case of CRUNCEP something probably inside ncdf files has changed bc this ncdf4::ncvar_get breaks. I'm trying to figure out what happened. "

github-actions[bot] commented 3 years ago

This issue is stale because it has been open 365 days with no activity.