How to evaluate mAP with no instances detected?

mcordts / cityscapesScripts

README and scripts for the Cityscapes Dataset

MIT License

2.19k stars 608 forks source link

How to evaluate mAP with no instances detected? #75

Closed fabvio closed 5 years ago

fabvio commented 5 years ago

Hi, we have a network that has been trained in a particular way, and sometimes it hasn't a great accuracy. We noticed that, for the mAP calculation in instance segmentation, the script requires at least one prediction per frame. However, there are frames where we fail to detect any instance. How can we run an evaulation on those? Thanks in advance.

mcordts commented 5 years ago

Hi, did you try to create an empty .txt file for those frames where you have no prediction?

fabvio commented 5 years ago

Yes, the script crashes.

mcordts commented 5 years ago

What is the error message/stacktrace?