Tracking ability with a small number of frames

SysCV / sam-pt

SAM-PT: Extending SAM to zero-shot video segmentation with point-based tracking.

https://arxiv.org/abs/2307.01197

Apache License 2.0

950 stars 60 forks source link

Tracking ability with a small number of frames #25

Closed georgeYanch closed 3 months ago

georgeYanch commented 10 months ago

Hi again :) Your work is truly amazing, although, I wonder If model won't be able to work correctly with, for example, 3-5 frame video?

For now, I have an issue when for short sequences I get zero masks and trajectories, scores are -inf.

Could It be a consequence of no object motion?

m43 commented 9 months ago

Hi, thanks for your questions and issues, and sorry for the delay! I've not covered an edge case of CoTracker being given a small number of frames. This should be resolved with this commit. Cheers!