search

lxx1991 / pytorch-voxel-flow

Video Frame Synthesis using Deep Voxel Flow
137 stars 36 forks source link

Multi Frame interpolation #9

Open tarun005 opened 4 years ago

tarun005 commented 4 years ago

How to train models for predicting more than one intermediate frame?

zzwei1 commented 3 years ago

How to train models for predicting more than one intermediate frame?

Have you figured it out? I have a similar question. What confused me is that, how should I make multi-frame prediction using Voxel-Flow? When I have the first 5 frames as input, I concat them along time dimension, and then followed the precedure in Voxel-Flow to generate the fiest predicted frame. I understand so far. But what should I do next to generate the second, third frames? Should I concat the first predicted frame with the 5 ground truth frames to generate a new input? I don't think it's correct because the input channels will be changed if I do so.