Evaluate the performance of the final models in the competitive phase

data2health / DREAM-Challenge

EHR DREAM Challenge

7 stars 2 forks source link

Evaluate the performance of the final models in the competitive phase #65

Closed tschaffter closed 4 years ago

tschaffter commented 4 years ago

Depends on #64

tschaffter commented 4 years ago

Update

From Tim:

I'm waiting to hear back from the HELM team to resubmit and I'm trying PnP_India again I had rerun one of their older submissions, I'm trying a more recent submission on the new data

tschaffter commented 4 years ago

Update

There are still two submission failing: one that places 5th in the leaderboard phase and one with poor performance in the leaderboard phase
@trberg will reach out to the developers of these teams to see if they can fix their model after Tim has identified more info about the issues. Dev would then resubmit the method.
If one of the two methods places in top 3, double check that their submission is not "unfair"