Open ssbilakeri opened 1 year ago
I evaluated the track results of ByteTrack using Bytetrack evaluation code itself and with your code but the results are so different. could you please suggest the reason for such difference ?
ByteTrack result: IDF1 IDP IDR Rcll Prcn GT MT PT ML FP FN IDs FM MOTA MOTP IDt IDa IDm num_objects MOT17-02-FRCNN 58.2% 68.0% 50.9% 64.4% 86.0% 53 18 26 9 1033 3515 56 172 53.4% 0.195 39 18 6 9880 MOT17-11-FRCNN 70.8% 73.6% 68.2% 81.4% 87.8% 44 22 11 11 512 842 11 28 69.8% 0.128 4 9 2 4517 MOT17-04-FRCNN 90.9% 91.5% 90.4% 93.5% 94.6% 69 61 6 2 1288 1578 17 90 88.1% 0.128 8 10 2 24178 MOT17-10-FRCNN 66.8% 74.8% 60.4% 75.6% 93.6% 36 16 18 2 304 1448 26 88 70.0% 0.219 17 15 6 5923 MOT17-05-FRCNN 76.2% 82.3% 70.9% 81.8% 95.0% 71 37 26 8 144 611 28 50 76.7% 0.180 26 11 13 3357 MOT17-09-FRCNN 77.9% 85.2% 71.7% 83.9% 99.6% 22 16 5 1 10 464 11 25 83.2% 0.152 10 4 4 2879 MOT17-13-FRCNN 83.4% 92.3% 76.0% 80.1% 97.2% 44 29 8 7 72 627 16 17 77.3% 0.196 16 2 4 3156 OVERALL 79.2% 83.9% 74.9% 83.1% 93.0% 339 199 100 40 3363 9085 165 470 76.6% 0.155 120 69 37 53890
TrackEval results: CLEAR: LPC_MOT-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag MOT17-02-FRCNN -19.902 64.323 -19.525 9.8326 25.089 0 16.129 83.871 -23.41 1827 16754 5455 70 0 10 52 116 MOT17-04-FRCNN -18.683 73.508 -18.548 15.617 31.371 1.2048 21.687 77.108 -22.82 7427 40130 16248 64 1 18 64 87 MOT17-05-FRCNN -29.854 63.486 -29.377 6.1298 14.722 0.75188 5.2632 93.985 -32.092 424 6493 2456 33 1 7 125 41 MOT17-09-FRCNN -38.329 65.742 -38.141 3.6995 8.1237 0 7.6923 92.308 -39.596 197 5128 2228 10 0 2 24 6 MOT17-10-FRCNN -35.525 59.615 -35.462 0.88013 2.3645 0 0 100 -35.88 113 12726 4666 8 0 0 57 13 MOT17-11-FRCNN -31.804 61.31 -31.549 6.4116 14.449 0 2.6667 97.333 -34.284 605 8831 3582 24 0 2 73 43 MOT17-13-FRCNN -21.56 62.691 -21.397 0.47243 2.1146 0 0.90909 99.091 -21.736 55 11587 2546 19 0 1 109 14 COMBINED -23.831 70.493 -23.628 9.482 22.263 0.3663 7.326 92.308 -26.628 10648 101649 37181 228 2 40 504 320
I evaluated the track results of ByteTrack using Bytetrack evaluation code itself and with your code but the results are so different. could you please suggest the reason for such difference ?
ByteTrack result: IDF1 IDP IDR Rcll Prcn GT MT PT ML FP FN IDs FM MOTA MOTP IDt IDa IDm num_objects MOT17-02-FRCNN 58.2% 68.0% 50.9% 64.4% 86.0% 53 18 26 9 1033 3515 56 172 53.4% 0.195 39 18 6 9880 MOT17-11-FRCNN 70.8% 73.6% 68.2% 81.4% 87.8% 44 22 11 11 512 842 11 28 69.8% 0.128 4 9 2 4517 MOT17-04-FRCNN 90.9% 91.5% 90.4% 93.5% 94.6% 69 61 6 2 1288 1578 17 90 88.1% 0.128 8 10 2 24178 MOT17-10-FRCNN 66.8% 74.8% 60.4% 75.6% 93.6% 36 16 18 2 304 1448 26 88 70.0% 0.219 17 15 6 5923 MOT17-05-FRCNN 76.2% 82.3% 70.9% 81.8% 95.0% 71 37 26 8 144 611 28 50 76.7% 0.180 26 11 13 3357 MOT17-09-FRCNN 77.9% 85.2% 71.7% 83.9% 99.6% 22 16 5 1 10 464 11 25 83.2% 0.152 10 4 4 2879 MOT17-13-FRCNN 83.4% 92.3% 76.0% 80.1% 97.2% 44 29 8 7 72 627 16 17 77.3% 0.196 16 2 4 3156 OVERALL 79.2% 83.9% 74.9% 83.1% 93.0% 339 199 100 40 3363 9085 165 470 76.6% 0.155 120 69 37 53890
TrackEval results: CLEAR: LPC_MOT-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag
MOT17-02-FRCNN -19.902 64.323 -19.525 9.8326 25.089 0 16.129 83.871 -23.41 1827 16754 5455 70 0 10 52 116
MOT17-04-FRCNN -18.683 73.508 -18.548 15.617 31.371 1.2048 21.687 77.108 -22.82 7427 40130 16248 64 1 18 64 87
MOT17-05-FRCNN -29.854 63.486 -29.377 6.1298 14.722 0.75188 5.2632 93.985 -32.092 424 6493 2456 33 1 7 125 41
MOT17-09-FRCNN -38.329 65.742 -38.141 3.6995 8.1237 0 7.6923 92.308 -39.596 197 5128 2228 10 0 2 24 6
MOT17-10-FRCNN -35.525 59.615 -35.462 0.88013 2.3645 0 0 100 -35.88 113 12726 4666 8 0 0 57 13
MOT17-11-FRCNN -31.804 61.31 -31.549 6.4116 14.449 0 2.6667 97.333 -34.284 605 8831 3582 24 0 2 73 43
MOT17-13-FRCNN -21.56 62.691 -21.397 0.47243 2.1146 0 0.90909 99.091 -21.736 55 11587 2546 19 0 1 109 14
COMBINED -23.831 70.493 -23.628 9.482 22.263 0.3663 7.326 92.308 -26.628 10648 101649 37181 228 2 40 504 320