DonDominic / MP2Net

The official code of our TGRS'24 paper MP2Net: Mask Propagation and Motion Prediction Network for Multi-Object Tracking in Satellite Videos
MIT License
15 stars 0 forks source link

A question about object association at different time steps #3

Closed lebron-2016 closed 4 months ago

lebron-2016 commented 4 months ago

Dear author,

In testDis.py , I found that you used Kalman filter when predicting the state of the target in the next frame, instead of the tracking_dis predicted by the model. Why can't we directly use the offset predicted by the model? What is the significance of the offset(or inter-frame displacement) of the target here?

Thanks!!

DonDominic commented 4 months ago

Thanks for your attention to our work.

In our previous experiments, we found that incorporating a Kalman filter results in more stable tracking performance compared to using only inter-frame displacement. Consequently, we released this version that combines both the Kalman filter and inter-frame displacement. Additionally, we provided a test using the Kalman filter (SORT) alone in the 'testTrackingSort.py' script. You might find it helpful to run this testing script to see the impact of inter-frame displacement clearly.

lebron-2016 commented 4 months ago

Thanks for your attention to our work.

In our previous experiments, we found that incorporating a Kalman filter results in more stable tracking performance compared to using only inter-frame displacement. Consequently, we released this version that combines both the Kalman filter and inter-frame displacement. Additionally, we provided a test using the Kalman filter (SORT) alone in the 'testTrackingSort.py' script. You might find it helpful to run this testing script to see the impact of inter-frame displacement clearly.

Thanks for your quick reply!

I have three more questions that I would like to confirm.

  1. Are you just using the inter-frame offset as a result correction? (as shown below)

image

  1. Are you only using Kalman filter when predicting the state of the object in the next frame?

  2. About testTrackingSort.py, is it equivalent to modifying testDis.py as follows?

image

Thanks!!

DonDominic commented 4 months ago

Yes, for questions 1 and 2, in this setting we use inter-frame displacement as result correction and incorporate the Kalman filter to conduct state updates. For question 3, that's correct.

lebron-2016 commented 4 months ago

Yes, for questions 1 and 2, in this setting we use inter-frame displacement as result correction and incorporate the Kalman filter to conduct state updates. For question 3, that's correct.

Got it! Thanks!