dyhBUPT / StrongSORT

[TMM 2023] StrongSORT: Make DeepSORT Great Again
GNU General Public License v3.0
771 stars 78 forks source link

Multi camera tracking #51

Closed faizan1234567 closed 2 years ago

faizan1234567 commented 2 years ago

Thanks for the nice work, is this support multi camera tracking? I am integrating yolov5 with strong sort, I want to know if it is possible to track an object across multiple cameras with unique id.

dyhBUPT commented 2 years ago

Hi, thanks for your interest in our work.

StrongSORT (and other common MOT methods) only support single-camera tracking. For cross-camera tracking, the simplest way is:

  1. generate single-camera tracklets using StrongSORT.
  2. associate these tracklets across cameras with appearance features and spatio-temporal constraints.

Best wishes.

faizan1234567 commented 2 years ago

Is there any implementation for step 2, i am stuck here. I have generated local tracklets, but matching those tracklets is challenging. I will be thankful for your recommendation.

dyhBUPT commented 2 years ago

the simplest way is to use the same appearance features as in step 1. Maybe you should refer to some MCMOT works. For example: https://openaccess.thecvf.com/content/CVPR2022W/AICity/html/Yang_Box-Grained_Reranking_Matching_for_Multi-Camera_Multi-Target_Tracking_CVPRW_2022_paper.html