data2health / DREAM-Challenge

EHR DREAM Challenge
7 stars 2 forks source link

Validate deterministic models #58

Closed tschaffter closed 4 years ago

tschaffter commented 4 years ago
tschaffter commented 4 years ago

See slides Validating deterministic models

tschaffter commented 4 years ago

@trberg Could you have a look at the slides and let me know if you could implement the test proposed and run it on the results from Round 3? Depending on the fraction of non-deterministic models, we can decide whether or not implement this step for the Validation Phase. For now I wouldn't do it and keep the pipeline as similar as possible between the Leaderboard and Validation phase. However this is something that would valuable to implement as part of the model validation step before running the models on the EHR data on multiple sites.