search

chengche6230 / ReST

[ICCV 2023] ReST: A Reconfigurable Spatial-Temporal Graph Model for Multi-Camera Multi-Object Tracking
MIT License
130 stars 15 forks source link

Fix Evaluation #11

Open tteepe opened 3 months ago

tteepe commented 3 months ago

Hi,

this is just an appendix to my last pull request. All results reported in this paper deviate from the regular evaluation protocol.

Here are some correct results, recomputed by us:

  1. Wildtrack ground plane evaluation results:

    IDF1   IDP   IDR  Rcll  Prcn GT MT PT ML FP FN IDs  FM  MOTA  MOTP IDt IDa IDm
0 86.7% 85.0% 88.4% 96.0% 92.3% 41 36  3  2 75 37  29  10 84.9% 0.159   8  24   3

  2. Wildtrack image view

    IDF1   IDP   IDR  Rcll  Prcn GT MT PT ML  FP  FN IDs   FM  MOTA  MOTP IDt IDa IDm
0 84.1% 85.4% 83.2% 90.5% 92.5% 41 33  6  2 379 491 223  265 78.9% 0.182 101  34   3

As they are no further instructions given on how to prepare the other datasets, I was too lazy to recompute them.

Could you consider updating the results in the arXiv version? Or post the other results here?

Best, Torben

chengche6230 commented 3 months ago

Hi,

Thanks for your great effort. I'll update the result soon.

B.R. Cheng-che