Closed thomashopkins32 closed 1 year ago
It looks like the image segmentation metric for the competition uses a separate evaluation script that operates on the encoded mask. We can add this to our repo to evaluate our results prior to submission but re-implementing this for something like cross-validation might be too expensive.
Actually it seems to be mAP at an IoU thresholds > 0.6. This should be available in some package.
It seems like pycocotools
has the best implementation to use for this.
Look into different metrics for evaluating image segmentation problems. The most common one I can think of (which will also be used by Kaggle for scoring the competition) is IoU (Intersection over Union).
We may need custom implementations for this but we also might be able to use the COCO package to do this work.