Lite Semantic Segmentation

[czaloom]

Implements Semantic Segmentation evaluation in Valor Lite.

Metrics

• Precision
• Recall
• Accuracy
• F1
• IoU
• mIoU
• ConfusionMatrix

IoU Confusion Matrix

{
    "type": "ConfusionMatrix",
    "value": {
        "confusion_matrix": {
            "v1": {
                "v1": {
                    "iou": 5000 / (10000 + 10000 - 5000)
                },  # 50% overlap
                "v2": {"iou": 0.0},
            },
            "v2": {
                "v1": {"iou": 0.0},
                "v2": {
                    "iou": 1 / (14999 + 4999 + 1)  # overlaps 1 pixel
                },
            },
        },
        "hallucinations": {
            "v1": {"percent": 5000 / 10000},  # 50% overlap
            "v2": {
                "percent": 4999 / 5000
            },  # overlaps 1 pixel out of 5000 predictions
        },
        "missing_predictions": {
            "v1": {"percent": 5000 / 10000},
            "v2": {
                "percent": 14999 / 15000
            },  # overlaps 1 pixel out of 15,000 groundtruths
        },
    },
    "parameters": {},
}