RTIInternational / teehr

Tools for Exploratory Evaluation in Hydrologic Research
https://rtiinternational.github.io/teehr/
MIT License
8 stars 10 forks source link

Validation performance is not good with real data #244

Closed mgdenno closed 1 month ago

mgdenno commented 2 months ago

After running one small example with two sites, it seems that we may need a different approach to dealing with the concept of foreign keys and data validadtion.

mgdenno commented 1 month ago

I ran some tests and while I never like to add more deps to a project, Pandera seems to do much of what I was writing my own code to do as far as 1) validating the schema, and 2) validating the data in the columns.