16lemoing / dot

Dense Optical Tracking: Connecting the Dots
https://16lemoing.github.io/dot
MIT License
217 stars 11 forks source link

Training code for optical flow and point tracking #14

Closed danqu130 closed 3 months ago

danqu130 commented 3 months ago

Thank you for open-sourcing this impressive work.

The publicly available pre-trained weights contain retrained optical flow and point tracking models, are there any plans to open source the corresponding training code? It would be great to have a good code framework compatible with training for these tasks!

16lemoing commented 3 months ago

Hi @danqu130, thank you for your interest in our work!

The point tracking models are off-the-shelf models (not retrained) so you may refer to the original works (e.g., CoTracker, TAPIR...) for training details.

The optical flow models are indeed retrained and we already include the training code https://github.com/16lemoing/dot#training

Hope that helps!

danqu130 commented 3 months ago

Thanks for your reply!