search

biigle / core

:large_blue_circle: Application core of BIIGLE
https://biigle.de
GNU General Public License v3.0
12 stars 15 forks source link

Video Tracking SAM2 #908

Open dlangenk opened 3 weeks ago

dlangenk commented 3 weeks ago

Explore if SAM2 does a better job in video tracking than the current opencv based implementation. Furthermore check if it is feasible to use SAM2 on larger videos or if they need to be chunked.

Using SAM2 would also mean that an automatic segmentation would come with it with all benefits and downsides.

dlangenk commented 3 weeks ago

A small test with the SAM2 online demo and the demo video. The tracking successfully stops when the object leaves the frame, but can be reinitiated.