Analysis plan specificity

[ksedivyhaley]

Analysis plan of action needs to be more detailed and specific. You want to have a step by step outline of what you're going to do. See Tiffany's example (introduction paragraphs 3 and after) for the level of detail. In particular:

• You shouldn't refer to “models such as... etc.” Pick specific models and say why. Keep scope in mind!
• What model metric will you use for hyperparameter optimization during tuning?
• How many folds are you using for cross-validation?
• “Once we believe we've developed a suitable model ” : how will you determine whether you have a suitable model?
• Your EDA description says you are checking for outliers and multicollinearity – what do you do if you find them?

[ksedivyhaley]

Related note - you say output will be "A table of the top predictors with a measure of importance". Make sure you clearly convey what measure you're using and what it conveys about the predictor in your final report.