Deploy and test challenge infrastructure at NCATS

[tschaffter]

Justin mentioned that NCATS will host the synthetic data (Synpuf and/or Wash U) while the challenge data will be hosted at UW.

Notes:

• If we want to automatically run the models on Synpuf data before running on the real data, then a copy of Synpuf data must be hosted on UW cloud.
  • [x] Is it really beneficial to run model on Synpuf data before running on the challenge data? The answer depends on the amount of time we expect the model to take to make prediction for all the subject in the evaluation set.
  • [x] If the purpose of NCATS is to host only the Synpuf data, why not use only UW cloud? (I understand that in the long run we want to make our infrastructure available on NCATS so that anyone could host a challenge).

Depending on the above answers:

• [x] Contact Usman Sheikh Usman.Sheikh@axleinfo.com and Raju Hemadri raju.hemadri@nih.gov (NCATS) to initial the deployment of the infrastructure at NCATS
• [ ] Connect to NCATS (AWS?) resources allocated to this project
• [ ] Deploy the Synapse Workflow Hook + Synpuf data
• [ ] Test the infrastructure

[tschaffter]

Ask to get access to the NCATS machines so we could deploy ourselves.

[tschaffter]

I have contacted NCATS today in an attempt to identify the resources that they could provide for this project.

[tschaffter]

Update: James and I had calls with the NCATS teams several times in the past 3 weeks. Last week, we clarified the resources that we need NCATS to provide for this EHR DREAM Challenge. We also agreed on a timeline for getting access to these resources.

Here is the document that I share with NCATS and that describes the challenge infrastructure, required resources and timeline: NCATS Infrastructure Proposal for the EHR DREAM Challenge: Patient Mortality Prediction.