search

MCG-NJU / EMA-VFI

[CVPR 2023] Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolatio
Apache License 2.0
399 stars 42 forks source link

Time error in arbitrary timestep interpolation. #29

Closed Mrzzz-ft closed 1 month ago

Mrzzz-ft commented 1 month ago

When I use the official provided weights, everything worked fine. But when I use it to retrain a model on my own dataset which is built on the Vimeo90k_septuplet, things get bad. For example, if two frames are inserted between two frames, the time of the two frames appears to be distorted, and the third frame regressed from the second frame, especially in the foot of the right people.

001 002 003 004

I train it with lr=1e-4~2e-5,batch_size=16, epoch=150. Is this caused by the parameters?

Mrzzz-ft commented 1 month ago

The problem is due to the reversal of I0 and I1, without reversal of timestep.