Get Leave One Image Out Probabilities

[roshankern]

In get_LOIO_probabilities.ipynb, we use the optimal hyperparameters from each final logistic regression model (DP, CP, CP_and_DP) to fit and evaluate new models in a Leave One Image Out (LOIO) fashion. The LOIO evaluation procedure is as follows:

• Load in entire MitoCheck labeled cell dataset (from labeled_data.csv.gz).
• For each image in MitoCheck labeled cell dataset (as specified by the Metadata_DNA field):
  • Train a logistic regression model with optimal hyperparameters (C and l1_ratio, saved with model data in models/) on every cell that is not in the specific image.
  • Predict probabilities on every cell that is in the specific image.

The probabilities are saved to LOIO_probas/.

[review-notebook-app[bot]]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB

[roshankern]

Forgot to mention that it seems like running the entire notebook will take a very long time (~9hrs), so the entire notebook will be run and the last couple of lines deleted after this PR has been reviewed. That way, if there are any suggestions the entire notebook will not need to be rerun.