search

squaredev-io / whitebox

[Not Actively Maintained] Whitebox is an open source E2E ML monitoring platform with edge capabilities that plays nicely with kubernetes
https://squaredev.io/whitebox/
MIT License
183 stars 5 forks source link

Confusion matrix schema alignment #143

Open stavrostheocharis opened 1 year ago

stavrostheocharis commented 1 year ago

Description In schema "PerformanceMetric" there is a misalignment between the BinaryClassificationMetricsPipelineResult and the MultiClassificationMetricsPipelineResult.

In the first one the true_negative, false_positive, etc. are on the outer level. On the other side we have them inside a confusion matrix attribute: confusion_matrix: Dict[str, ConfusionMatrix]

Solution Make them aligned. Add in BinaryClassificationMetricsPipelineResult a new attribute confusion_matrix and include inside the corresponding metrics.

Note: Maybe changes inside other parts of the code may be needed!

sinnec commented 1 year ago

Changes will be needed in run_create_alerts_pipeline as well to match the changed schema.