dotnet / machinelearning-modelbuilder

Simple UI tool to build custom machine learning models.
Creative Commons Attribution 4.0 International
263 stars 56 forks source link

Additional Optimizing Metrics for Binary Classification: Precision or Recall #2797

Open judahr opened 9 months ago

judahr commented 9 months ago

In binary classification, there are situations where the data are imbalanced and only false positives or only false negatives are costly, we would want to tune the model on simply Precision or Recall. This would better optimize models based on these scenarios.

In Advanced training options, under the optimizing metric include a Precision option and a Recall option. Use this to tune the Model Builder for higher precision or higher recall.

LittleLittleCloud commented 9 months ago

@JakeRadMSFT @luisquintanilla

luisquintanilla commented 9 months ago

Makes sense to me. @LittleLittleCloud is it just a matter of adding those options in the UI or is work required in the AutoML API?

LittleLittleCloud commented 9 months ago

Just adding options on UI