willprice / flowty

The swiss army knife for extracting optical flow
https://flowty.rtfd.org
16 stars 1 forks source link

Support video resizing before computing flow #39

Open willprice opened 5 years ago

willprice commented 5 years ago

When computing flow it is useful to be able to resize the video frame before input into the algorithm

ir0nt0ad commented 4 years ago

This would be super helpful to have, thanks in advance

willprice commented 4 years ago

Hi @sh0gg0th , Just a heads up I probably won't work on this for quite a while. Also, it's worth noting that if you want to use flowty for TVL1 it's very slow. OpenCV has a serious performance regression in v4 (bug logged here). I have an alternate optical flow tool (with a not so nice UX) here that uses OpenCV 2 which is substantially faster for TVL1.

ir0nt0ad commented 4 years ago

Hi @willprice - thanks a lot! Yeah I noticed the same problem with speed and was wondering if it had something to do with my CUDA/Docker/drivers setup. Does your furnari-flow build support the latest architectures such as Turing (7.5)?

willprice commented 4 years ago

I don't believe it's an issue with yours (or my) setup, but a performance regression with OpenCV itself sadly :( My CUDA chops aren't good enough to debug it sadly. The docker images for furnari-flow have binaries up to compute 6.1 or so, so not the newest, however there are PTXs inside too so it'll JIT compile for your architecture on the first run (which will take an age) but then these are cached in further invocations (I've got the nvidia PTX cache set up as a docker volume for this purpose--check the dockerfile for details).

ir0nt0ad commented 4 years ago

Understood, thank you. Could you please point me to your dockerfile for willprice/opencv2-cuda8 ?

willprice commented 4 years ago

Sure, here it is: https://github.com/dl-container-registry/opencv2

ir0nt0ad commented 4 years ago

Excellent, and thanks for all your work!

willprice commented 4 years ago

No problem :) let me know if you have any problems