search

facebookresearch / co-tracker

CoTracker is a model for tracking any point (pixel) on a video.
https://co-tracker.github.io/
Other
2.52k stars 177 forks source link

Inaccurate tracking of animal's legs #24

Open WinKawaks opened 10 months ago

WinKawaks commented 10 months ago

Hi, I tried this work for some videos of moving animals (https://www.youtube.com/watch?v=DaYXX-68jSM). I found the model's prediction fits the body well but works poorly for legs. The tracking points of two legs often changes to those of one leg. Is there a good solution here? Thanks you!

nikitakaraevv commented 10 months ago

Hi @WinKawaks, could you please send a video with visualized tracks?

WinKawaks commented 10 months ago

Hi @nikitakaraevv, I upload two videos cat and dance. I set some tracking points manually. Could you please help me check the error? Thank you.

nikitakaraevv commented 10 months ago

Hi @WinKawaks, thank you for sending these videos! I currently don't have a solution, but we're working on it. I'll let you know when we have an update.

mrinuccini commented 8 months ago

Hi ! Any news on this ? I'm currently trying to track a horse movements and its doing great with the body but not at all with the legs. Hope you guys find a fix to that soon 😊!

nikitakaraevv commented 8 months ago

Hi @mrinuccini, we plan to release a new model in late November. Hopefully, it'll be better at tracking legs :)

mrinuccini commented 8 months ago

Oh that's great ! Will be looking forward to that then !

Immocat commented 7 months ago

Hi, any update on a better model trained with more datasets? Thanks.

nikitakaraevv commented 6 months ago

Hi @Immocat, @mrinuccini, @WinKawaks, we just released a new model that can track 10X more points and is more memory efficient, but it is still trained on the same dataset. We tried to train CoTracker on PointOdyssey as well, but it did not seem to solve the problem. We are going to work on that next.