search

z-x-yang / Segment-and-Track-Anything

An open-source project dedicated to tracking and segmenting any objects in videos, either automatically or interactively. The primary algorithms utilized include the Segment Anything Model (SAM) for key-frame segmentation and Associating Objects with Transformers (AOT) for efficient tracking and propagation purposes.
GNU Affero General Public License v3.0
2.83k stars 340 forks source link

unable to track small object #89

Open liruiluo opened 1 year ago

liruiluo commented 1 year ago

When I start tracking balls in an atari pong game, it often happens that the ball disappears, or the ball is grouped with other things. Is there any good solution?

yamy-cheng commented 12 months ago

The ability of segmentation and tracking of SAM-Track is limited by tracking model. Maybe you can use roll-back feature to get the better results.