Validate model groups all have results for same/full set of end times

dssg / triage

General Purpose Risk Modeling and Prediction Toolkit for Policy and Social Good Problems

Other

185 stars 60 forks source link

Validate model groups all have results for same/full set of end times #326

Open jesteria opened 6 years ago

jesteria commented 6 years ago

From @shaycrk on August 15, 2017 20:17

If the model groups we're considering haven't all been tested on the same set of test sets, we might not be making fair comparisons for model selection, so we should check the input to ensure the a uniform set of test sets are used throughout.

Copied from original issue: dssg/audition#18

thcrock commented 6 years ago

@tweddielin this is something you've been working on with pre-audition work, right? But there's still a part that has to be written?