search

facebookresearch / co-tracker

CoTracker is a model for tracking any point (pixel) on a video.
https://co-tracker.github.io/
Other
3.93k stars 253 forks source link

RuntimeError: Invalid buffer size #38

Closed horsto closed 1 year ago

horsto commented 1 year ago

For relatively simple and short videos (in my case, for example w: 1944, h: 1944, frame number: 1680) I am getting errors like RuntimeError: Invalid buffer size: 70.96 GB. I presume this is because the whole video is loaded at once. Is there an obvious solution to loading and processing larger video files?

I did stumble over @whymatter https://github.com/facebookresearch/co-tracker/compare/main...whymatter:co-tracker:streaming - this might be a solution? However, without diving into that code: When loading chunks, how are the transitions handled in between frame buffers?

nikitakaraevv commented 1 year ago

Hi @horsto, we're currently working on a new, improved version of CoTracker that will also support loading chunks of videos. We are planning to release it in late November. Predictions on live videos are also discussed in issue https://github.com/facebookresearch/co-tracker/issues/37.

horsto commented 1 year ago

That sounds great, I can't wait!