NVlabs / PWC-Net

PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume, CVPR 2018 (Oral)
Other
1.63k stars 357 forks source link

About KITTI2015 #97

Closed MuZiGuYue closed 4 years ago

MuZiGuYue commented 4 years ago

Hello, As far as I know, the KITTI2015 dataset is a data pair composed of two video frames. How do you apply it in a multi-frame converged network? Thank you!

jrenzhile commented 4 years ago

@MuZiGuYue you can download all frames in the KITTI website

MuZiGuYue commented 4 years ago

@luvegood Thank you for your reply: For some reason, I can't enter the official website of the KITTI dataset right now. Does the KITTI dataset contain the corresponding optical flow? Is the KITTI dataset the same as the virtual KITTI mentioned in the paper "A Fusion Approach for Multi-Frame Optical Flow Estimation"? Thank you!

jrenzhile commented 4 years ago

@MuZiGuYue you'll need to contact authors of KITTI dataset for help. I downloaded those images from the official KITTI website

MuZiGuYue commented 4 years ago

@luvegood Thank you very much!

MuZiGuYue commented 4 years ago

@luvegood Sorry to bother you again, For the KITTI dataset, not all video frames have corresponding optical flow. Even if I downloaded all the frames, there is no way to train the multi-frame fusion model with them. Thanks again!

jrenzhile commented 4 years ago

@MuZiGuYue In KITTI we only use the preceding frame for training the multi-frame optical flow, and the only supervision signal in KITTI is the optical flow from the reference frame to the future frame. For other datasets, we use the full dataset for training MFF

MuZiGuYue commented 4 years ago

@luvegood Thank you very much for your help, I finally understood.