Tracking errors with cotracker2

facebookresearch / co-tracker

CoTracker is a model for tracking any point (pixel) on a video.

https://co-tracker.github.io/

Other

2.52k stars 175 forks source link

Tracking errors with cotracker2 #64

Open Soooooda69 opened 5 months ago

Soooooda69 commented 5 months ago

Hi, I noticed that when the camera rolls, tracked points which should move out of the scene are accumulated at the edge. As shown in this picture, when the camera roll to the right side, a bunch of points clustered at the left edge. This situation is more obvious when I changed from cotracker to cotracker2. Is there any tricks to address this? Thanks!

nikitakaraevv commented 5 months ago

Hi @Soooooda69, what about visibility predictions for these points? Are they still predicted as visible?

Soooooda69 commented 5 months ago

Hi @Soooooda69, what about visibility predictions for these points? Are they still predicted as visible?

No, these are all visible points. I filtered out points predicted as invisible.