facebookresearch / co-tracker

CoTracker is a model for tracking any point (pixel) on a video.
https://co-tracker.github.io/
Other
3.42k stars 230 forks source link

📢 Call for Use Cases: We Want to Hear from You! 🛠 #113

Open nikitakaraevv opened 6 days ago

nikitakaraevv commented 6 days ago

Hey everyone! 👋

First off, a big shoutout to all of you for being part of the CoTracker community. Thanks for the support and for using the project in all the awesome ways you do! 🙌

We’d love to get a better idea of how you’re using CoTracker in your work. Whether it's powering your AI research, building applications, or something else entirely — we’re super curious to know! 🚀 And if there’s anything you think could be improved or added, we’re all ears.

You can drop a comment right here or feel free to reach out to us directly via email at nikita@robots.ox.ac.uk if that’s easier. We’d love to hear from you either way!

Hearing about your experiences helps us figure out what’s working well and what might need some tweaking. So if you’ve got a minute, it’d be awesome to hear your thoughts!

Thanks again for being a part of this journey! We’re excited to see what you’re all up to. 🌟

Khoa-NT commented 5 days ago

Thank you for starting this discussion! I tried out the HF demo with the bear example and noticed that it didn’t track the feet as expected. I’m curious if this is a particularly challenging case for point tracking? I’m not trying to compare models, just trying to understand what might be happening.

image

dinrao commented 12 hours ago

Hi, I am keenly following the development of these point trackers. My use case is tracking the flight/movment of insects in natural enviroments, usually in cluttered background with lots of occlusion. generally I need atleast 2 points on the insect but the ability to track many points opens up a wealth of information about animal movements. I have tried the demo verison, but since I'm lacking in technical skills (took me a while to figure out how to change the path to the file!), I still havent been able to run it on my own videos. Your documentation is good, but it's still very complicated to follow for someone like me coming from a biology background.

nikitakaraevv commented 2 hours ago

Hi @dinrao, thank you for sharing your use case! Did you try the huggingface demo as well? it should be relatively straightforward to upload your own video there: https://huggingface.co/spaces/facebook/cotracker What do you want to achieve by tracking insects?