section-engineering-education / engineering-education

“Section's Engineering Education (EngEd) Program is dedicated to offering a unique quality community experience for computer science university students."
Apache License 2.0
363 stars 889 forks source link

Evaluating Machine Learning Model Performance #633

Closed collins-a closed 3 years ago

collins-a commented 3 years ago

Brief Summary:

Machine learning models are expected to provide accurate and trustworthy predictions. In order to confidently trust their predictions, it is important to assess how machine learning models generalize on test data. We look at how to evaluate model performance.

Key Takeaways:

The reader should:

  1. Understand the need to evaluate model performance
  2. Get to learn the main model evaluation techniques
  3. Explore a few model evaluation metrics (both regression and classification)

References:

https://heartbeat.fritz.ai/introduction-to-machine-learning-model-evaluation-fa859e1b2d7f#:~:text=The%20above%20issues%20can%20be%20handled%20by%20evaluating,accuracy%20of%20a%20model%20on%20future%20%28unseen%2Fout-of-sample%29%20data.

https://towardsdatascience.com/various-ways-to-evaluate-a-machine-learning-models-performance-230449055f15

https://www.jeremyjordan.me/evaluating-a-machine-learning-model/

https://towardsdatascience.com/machine-learning-how-to-evaluate-your-model-1dabbdc849a4

https://machinelearningmastery.com/how-to-evaluate-machine-learning-algorithms/

ninjaginja commented 3 years ago

good topic @collins-a - approved