search

JonathonLuiten / TrackEval

HOTA (and other) evaluation metrics for Multi-Object Tracking (MOT).
MIT License
951 stars 232 forks source link

Evaluate on custom video #67

Open amindehnavi opened 2 years ago

amindehnavi commented 2 years ago

Hi I want to use one of the MOTChallenge videos randomly e.g. MOT17-11-SDP to test my tracker's performance. ( i use videos that are for training, so I can get the evaluation metrics like HOTA since the ground truth files are available). I test some trackers like ByteTrack on custom data and want to use TrackEval for evaluation. I'm sure that the output file of the ByteTrack is compatible with what TrackEval requires. As I use their pretrained models and just test the model on MOTChallenge training videos, I expect to get results almost the same as what they said in their paper (MOTA = 80, IDF1 = 77.3, and HOTA=63.1). but after evaluation using this repository, I get strange results as shown in the following image. I searched a lot for this problem but couldn't find any helpful advice. is there any step or preprocessing which I forgot to handle?? or the problem is related to the TrackEval?? thanks WhatsApp Image 2021-11-27 at 6 44 27 PM

Ali96528 commented 1 year ago

Hello，amindehnav Do you know the reason why you got this result? I have encountered the same situation. Thank you.

hellosuer commented 8 months ago

Hello，amindehnav Do you know the reason why you got this result? I have encountered the same situation. Thank you.

Hello, I would like to ask, have you solved this problem? I also met this problem, looking forward to your reply, thank you!