search

hasanirtiza / Pedestron

[Pedestron] Generalizable Pedestrian Detection: The Elephant In The Room. @ CVPR2021
https://openaccess.thecvf.com/content/CVPR2021/papers/Hasan_Generalizable_Pedestrian_Detection_The_Elephant_in_the_Room_CVPR_2021_paper.pdf
Apache License 2.0
682 stars 159 forks source link

What's ignore_other_vru in ECP evaluation? #162

Closed 123dddd closed 1 year ago

123dddd commented 1 year ago

Hello thanks again for the great repo! A small question towards the evaluation on eurocity persons dataset: what is the meaning of ignore_other_vru in the 117th line of tools/ECPB/eval.py? More specific, what's vru?

From the experiments I found setting this variable to True (ignore something) will bring lower LAMR. What's more, the server of ECP used 'False' by default but in pedestron 'True' is used.

Thanks in advance!

hasanirtiza commented 1 year ago

In short: param ignore_other_vru: - If true, other VRU ground truth boxes are used during the matching process, therefore other classes (e.g. riders) which are detected and classified as the primary detection class (e.g. pedestrians) do not cause a false positive.

Have a look here.

Very probably, when we cloned that code it was set to True or may be we set it to true for some debugging and just overlooked. In anyways, you can follow numbers of Pedestron on the ECP server. I would suggest to use the params given in the official ECP eval repo.

123dddd commented 1 year ago

Thank you for your answer!