biigle / core

:large_blue_circle: Application core of BIIGLE
https://biigle.de
GNU General Public License v3.0
13 stars 15 forks source link

Consider improved video object tracking #646

Open mzur opened 1 year ago

mzur commented 1 year ago

Today I saw FAIR's co-tracker which looks like an impressive video object tracking method. While it has a complicated license, there is also OmniMotion with an Apache license, looking similarly good. We should explore these (GPU-backed) tracking methods to improve the tracking performance of the video annotation tool.

dlangenk commented 1 year ago

Both look very good. Also there is MMtracking. However it only implements few algorithms.

mzur commented 1 year ago

Right, MMTracking would work well with the existing dependencies of MAIA.

dlangenk commented 1 year ago

I had a very small test with co-tracker tracking a fish in a video with good visibility. It worked well until the fish went into the corals and emerged again at a slightly different location. The tracker got stuck like most other trackers also did in previous tests.

mzur commented 3 months ago

Maybe #908 may solve this.