dotnet / machinelearning-modelbuilder

Simple UI tool to build custom machine learning models.
Creative Commons Attribution 4.0 International
269 stars 59 forks source link

Additional Optimizing Metrics for Binary Classification: Precision or Recall #2797

Open judahr opened 12 months ago

judahr commented 12 months ago

In binary classification, there are situations where the data are imbalanced and only false positives or only false negatives are costly, we would want to tune the model on simply Precision or Recall. This would better optimize models based on these scenarios.

In Advanced training options, under the optimizing metric include a Precision option and a Recall option. Use this to tune the Model Builder for higher precision or higher recall.

LittleLittleCloud commented 12 months ago

@JakeRadMSFT @luisquintanilla

luisquintanilla commented 12 months ago

Makes sense to me. @LittleLittleCloud is it just a matter of adding those options in the UI or is work required in the AutoML API?

LittleLittleCloud commented 12 months ago

Just adding options on UI