biigle / core

:large_blue_circle: Application core of BIIGLE
https://biigle.de
GNU General Public License v3.0
12 stars 16 forks source link

Consider improved video object tracking #646

Open mzur opened 10 months ago

mzur commented 10 months ago

Today I saw FAIR's co-tracker which looks like an impressive video object tracking method. While it has a complicated license, there is also OmniMotion with an Apache license, looking similarly good. We should explore these (GPU-backed) tracking methods to improve the tracking performance of the video annotation tool.

dlangenk commented 10 months ago

Both look very good. Also there is MMtracking. However it only implements few algorithms.

mzur commented 10 months ago

Right, MMTracking would work well with the existing dependencies of MAIA.

dlangenk commented 10 months ago

I had a very small test with co-tracker tracking a fish in a video with good visibility. It worked well until the fish went into the corals and emerged again at a slightly different location. The tracker got stuck like most other trackers also did in previous tests.