search

z-x-yang / Segment-and-Track-Anything

An open-source project dedicated to tracking and segmenting any objects in videos, either automatically or interactively. The primary algorithms utilized include the Segment Anything Model (SAM) for key-frame segmentation and Associating Objects with Transformers (AOT) for efficient tracking and propagation purposes.
GNU Affero General Public License v3.0
2.77k stars 334 forks source link

FPS of SAM-Track #101

Open genitrix opened 11 months ago

genitrix commented 11 months ago

Hi, it seems that FPS is only 4 when I run the demo on a decent GPU. However, DeAOT can achieve 30 or 50 FPS, where does this gap come from? Could you share the FPS of SAM-Track when you test it? Thanks a lot!

yamy-cheng commented 10 months ago

SAM-Track uses SAM to segment objects in key frames, which causes a decrease in FPS.