An open-source project dedicated to tracking and segmenting any objects in videos, either automatically or interactively. The primary algorithms utilized include the Segment Anything Model (SAM) for key-frame segmentation and Associating Objects with Transformers (AOT) for efficient tracking and propagation purposes.
my python=3.10 and cuda=11.8
installation: download both zip.exe and unzip.exe from the url, put them into a folder & add the folder path to environment variables.
model: create a new folder named "ckpt" at ./ download these .pth files below and drop them into sam_vit_b_01ec64.pth R50_DeAOTL_PRE_YTB_DAV.pth groundingdino_swint_ogc.pth
running: