chainer / chainercv

ChainerCV: a Library for Deep Learning in Computer Vision
MIT License
1.48k stars 304 forks source link

possible bug in the way that mIoU is computed #950

Open seyeeet opened 3 years ago

seyeeet commented 3 years ago

I notice that the results for miou does not match with miou that I manually compute. here is an example, lets say pres and labels are two lists including the predictions and gt data I can compute the confusion matrix via chainercv.evaluations.calc_semantic_segmentation_confusion I also can compute the miou via chainercv.evaluations.eval_semantic_segmentation(preds, labels)

the miou based on confusion matrix can be computed as np.nanmean(np.diag(confusion) / (confusion.sum(axis=1) + confusion.sum(axis=0) - np.diag(confusion))) and these results dont match with np.nanmean(chainercv.evaluations.eval_semantic_segmentation(preds, labels)['iou'])