search

JonathonLuiten / TrackEval

HOTA (and other) evaluation metrics for Multi-Object Tracking (MOT).
MIT License
965 stars 239 forks source link

Negative metrics value #147

Closed almex-m-bulbul closed 5 months ago

almex-m-bulbul commented 6 months ago

I have been testing bunch of tracker algorithms, for one I found an interesting result where MOTA score is negative.

What does that even mean? What could be the possible issue?

| MOTA   | MOTP  | MODA   | CLR_Re | CLR_Pr | MTR  | PTR   | MLR    | CLR_TP | CLR_FN | CLR_FP | IDSW | MT  | PT  | ML  | Frag | sMOTA | IDF1   | IDR    | IDP   | IDTP | IDFN  | IDFP   | Dets  | GT_Dets | IDs   | GT_IDs |
|--------|-------|--------|--------|--------|------|-------|--------|--------|--------|--------|------|-----|-----|-----|------|-------|--------|--------|-------|------|-------|--------|-------|---------|-------|--------|
| -35.286| 59.934| -35.256| 1.0831 | 2.8944 | 0    | 5.6777| 94.322 | 3649   | 333242 | 122424 | 99   | 0   | 93  | 1545| 220  | -35.72| 0.84153| 0.57823| 1.5451| 1948 | 334943| 124125 | 126073| 336891  | 362   | 1638   |
JonathonLuiten commented 5 months ago

yes, MOTA can be negative. Read the HOTA paper for why MOTA is not a great metric.