google / automl

Google Brain AutoML
Apache License 2.0
6.25k stars 1.45k forks source link

Problem with mAP values #1133

Open aljed opened 2 years ago

aljed commented 2 years ago

I have a dataset that has huge discrepancies in number of elements in different categories. Sometimes in evaluation set there are no representatives of some classes. What I found is that function evaluate in coco_metric.py loops only over exisiting classes and as a result mAP values are not assigned to proper classes so some very similar classes have very different mAP scores. Am I doing something wrong or is it a bug?