autonomousvision / unimatch

[TPAMI'23] Unifying Flow, Stereo and Depth Estimation
https://haofeixu.github.io/unimatch/
MIT License
1.05k stars 106 forks source link

Decoding RGB Optical Flow for Motion Information Extraction in Video Action Recognition #41

Closed seekerhuang closed 7 months ago

seekerhuang commented 12 months ago

Hi.

After performing inference, the obtained optical flow is an RGB image with three channels. If my objective is to utilize this RGB optical flow image for video action recognition and I need to decode it back to its original form (rescaled back to its original range) to extract motion information, could you kindly guide me on how to accomplish this?

Thank you very much!

haofeixu commented 12 months ago

Hi, you can use --save_flo_flow to save raw flow prediction as .flo file.

jokingww commented 11 months ago

Hi, you can use --save_flo_flow to save raw flow prediction as .flo file.

Hello, could you please tell how to resize .flo file in correct way. I just try np.size but the result is confused.

haofeixu commented 7 months ago

Hi you should resize the numpy or torch flow arrays instead of the .flo flow file.