search

zhengthomastang / 2018AICity_TeamUW

The winning method in Track 1 and Track 3 at the 2nd AI City Challenge Workshop in CVPR 2018 - Official Implementation
http://openaccess.thecvf.com/content_cvpr_2018_workshops/w3/html/Tang_Single-Camera_and_Inter-Camera_CVPR_2018_paper.html
550 stars 198 forks source link

How to evaluate the accuracy of tracking? #17

Open Ujang24 opened 4 years ago

Ujang24 commented 4 years ago

I have tried performing cell tracking. In some cases, the tracker failed (wrongly assigned object ID). It also sometimes makes new IDs for the reappeared object. What I need to know is how to evaluate the accuracy of tracking so that we can compare this algorithm with other algorithms?

Any help would be appreciated.

zhengthomastang commented 4 years ago

You can use the development kit of MOTChallenge to evaluate MOT accuracy: https://bitbucket.org/amilan/motchallenge-devkit/src

Ujang24 commented 4 years ago

Thank you for the reply. I will try

Ujang24 commented 4 years ago

Dear @zhengthomastang, I understand the MOT format. This is a part of the object tracking result on my case.

3,1,134.41580265761496,224.69136445843338,27,49,-1.0,-1,-1,-1
3,2,396.6789570731805,108.36863251197143,50,40,-1.0,-1,-1,-1
3,3,549.7969768455899,99.47926879000138,34,39,-1.0,-1,-1,-1
3,4,94.19406152469674,51.525359351150456,44,50,-1.0,-1,-1,-1
3,5,615.4856666429795,327.65653638397293,25,52,-1.0,-1,-1,-1
3,6,167.2113931164552,429.2636305271329,35,51,-1.0,-1,-1,-1
4,1,134.14753737604008,224.81261967933906,27,49,-1.0,-1,-1,-1
4,2,390.16552676753264,107.47192528936425,50,40,-1.0,-1,-1,-1
4,3,559.7366143525005,103.41172563985658,37,42,-1.0,-1,-1,-1
4,4,90.01565942207596,46.51782117986036,42,49,-1.0,-1,-1,-1
4,5,617.2992342006079,321.2408219230135,26,54,-1.0,-1,-1,-1
4,6,164.73957559451765,432.5662963510689,34,49,-1.0,-1,-1,-1
5,1,134.39082445349632,224.75806429933732,27,49,-1.0,-1,-1,-1
5,2,382.84423012463776,102.90794791830113,49,39,-1.0,-1,-1,-1
5,3,567.2248342967941,105.54151914544637,36,42,-1.0,-1,-1,-1
5,4,89.30526296225021,40.89595546059299,41,48,-1.0,-1,-1,-1
5,5,620.6859651927404,321.6601971994576,23,50,-1.0,-1,-1,-1
5,6,164.64499741051898,442.0245415393972,27,38,-1.0,-1,-1,-1

But how to make the ground truth of the tracking? Is there something like object-tracking annotation tools for doing this? The tools for assigning ID's for each object in a video.