search

NOAA-OWP / hydrovis

Other
11 stars 10 forks source link

Test Site Issues in NRLDB #370

Open CoreyKrewson-NOAA opened 1 year ago

CoreyKrewson-NOAA commented 1 year ago

We are currently masking a bunch of test sites in our rfc_max_stage and catfim services. These test sites seemed to spring up and they get caught on our services as we do blanket queries from the WRDS API. We need to figure out how to not query those at all (similar to how we assume NWPS is doing it) and also how to stop getting test sites in the NRLDB which is driving the WRDS API.

@TylerSchrag-NOAA is going to see how the NWPS team is not getting those sites @derekgiardino is going to figure out where these test sites are coming from and try to get a handle on who is doing it.

I have attached the spreadsheet containing all the sites we do not process and why. NRLDB_invalid_sites.csv

TylerSchrag-NOAA commented 1 year ago

Tim at Orion said they use the NLRDB "riverstat" table for their location data (which apparently has the legit gauges), and not the location table (which apparently has the extra junk).

I don't see any reference to this difference in the WRDS location API results. @ChipGobs-NOAA said that WRDS recently switched to using riverstat + the location table, and that he'd check with Gautum to see if they can include which source it comes from in the metadata (so we can filter).