search

CUAHSI / HydroServer

BSD 3-Clause "New" or "Revised" License
8 stars 4 forks source link

GetSites Fails: GHCN #143

Open Castronova opened 4 years ago

Castronova commented 4 years ago

GetSites fails using suds and ulmo in Python3:

Server raised fault: 'Object reference not set to an instance of an object.
Castronova commented 4 years ago

I've encountered this type of issue repeatedly for this service and it breaks one of our popular JupyterHub examples.

Castronova commented 4 years ago

This service is still broken. Any updates?

image

martinseul commented 4 years ago

the problem with downloading data is a NOAA issue the service that we need to call to get the original data does not respond. Typically the dataprovider fixes these issues in a timely manner , i'll check on it to see iwhen it is back.

The issue with the GETSITES call mentioned first in 143 is not related to the downloading issue. I tried the call several times from my dev environment and it returns correctly in ~7 seconds, also retested in hiscentrals service testing tool and it also returned within seconds. I also use it regularly to harvest the data and did not have issues with it ,it is however a large service with 78000 sites equals ~45mb. I have not worked with ULMO and SUDS but it points to an issue with the library itself maybe related to the size and not the HIS service. What call does actually break download, parsing.or other?

Castronova commented 4 years ago

The problem also exists in data.cuahsi.org

martinseul commented 4 years ago

these are unrelated as they utilize different request, again could you be more specific which function fails in ulmo/suds and or poitn me to the notebook

Castronova commented 4 years ago

Just try to download GHCN data into your data.cuahsi.org workspace as shown in the image above. This fails. I believe this is calling GetValues, so it's not just GetSites that's failing. Also, data.cuahsi.org does not use ULMO or SUDS so it most likely is not a problem with these libraries.