Q/C of Mountain Hub observations

communitysnowobs / cso-api

0 stars 2 forks source link

Q/C of Mountain Hub observations #15

Open aaarendt opened 4 years ago

aaarendt commented 4 years ago

Geolocation errors in the MtnHub app result in incorrect data being ingested into our database. We need to develop accurate, quantitative Q/C approaches. We can do this at least for large errors.

Ideas:

Dave has grids of min/max/mean from SNODAS. We could query the grid for all new CSO points and see if those fall within the reasonable climatology, otherwise reject. Could this be implemented on the fly?

dfosterhill commented 4 years ago

FYI. Each grid (1 km spacing) is 46 mb. Multiply by 365 days of year and 3 stats (min, mean, max), and that is 46 GB of data to be hosted.

As a test of this, I could take the complete CONUS CSO dataset and run it through and see how the 'flagging' worked?