search

Siyu-C / ACAR-Net

[CVPR 2021] Actor-Context-Actor Relation Network for Spatio-temporal Action Localization
Apache License 2.0
205 stars 39 forks source link

parameter in calc_mAP #28

Open chaobinzhang opened 3 years ago

chaobinzhang commented 3 years ago

hello @junting @Siyu-C I am sorry to bother you. I have a problem with calc_mAP.py. In line 39, the parameter: capacity=0(capacity: Maximum number of labeled boxes allowed for each example. Default is 0 where there is no limit.) whether has a special role or it will not affect the final mAP? Thanks!!!!

Siyu-C commented 3 years ago

Hi @chaobinzhang , we follow official AVA evaluation and set this parameter to 50 when reading detections (see here). If this is set to 0, i.e. no limit, the performance should slightly increase, but it would be unfair.

chaobinzhang commented 3 years ago

by the way, the number 50 is only suitable for AVA, right? If I use other datasets, Are there still restrictions on parameters? Where can I find this parameter restriction?

Siyu-C commented 3 years ago

For another dataset, it is the best to find its official evaluator implementation if there is one, or refer to settings of other works which include the same dataset.