Overall discussion for Tip 7

[SiminaB]

This is to discuss outstanding issues for Tip 7: Address deep neural networks’ increased tendency to overfit the dataset. https://github.com/Benjamin-Lee/deep-rules/blob/master/content/09.overfitting.md

[SiminaB]

• I'm not super sure about the figure here. It does a good job showing overfitting, but in general analysts are taught to be super cautious when extrapolating models outside of the range of the training data, so I wouldn't continue drawing the linear regression outside that range either.

• I'm not sure the last sentence belongs here:

  Futhermore, be cognizant of the danger of skewed or biased data artificially inflating accuracy

[Benjamin-Lee]

I think you're right; it belongs in the "know your data" tip. It does inflate accuracy, but it's not due to memorization.