MCG-NJU / EMA-VFI

[CVPR 2023] Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolatio
Apache License 2.0
399 stars 42 forks source link

Can you provide arbitrary frame interpolation training code #11

Open JRStudio-107 opened 1 year ago

JRStudio-107 commented 1 year ago

The existing version only includes the fixed step fill frame training process, I want to learn the process of arbitrary frame interpolation, thx

GuozhenZhang1999 commented 1 year ago

Thanks for your concern! We won't provide the training code that supports arbitrary temporal interpolation in order to reduce the complexity of the code base. But it should be noticed that the configuration of the training dataset is the only thing that needs to be changed (we follow the setting of RIFE); the rest of the training process is essentially the same for both fixed- and arbitrary-training.

JRStudio-107 commented 1 year ago

Thank you for your reply. In fact, while waiting for your reply, I have built arbitrary temporal interpolation training methods, also referring to RIFE's Settings. However, during the training process, my training loss is almost unchanged, and the performance of PSNR test after each epoch becomes worse and worse with the training, the interpolation frame calculated by the trained model is all black, have you ever encountered similar cases?

GuozhenZhang1999 commented 1 year ago

No, the training process was very stable. You can see if the time step is computed correctly and passed into the model.

fuqianya commented 1 year ago

Hello, @JRStudio-107 and @GuozhenZhang1999 I am also interested in exploring the training of arbitrary temporal interpolation. Could you plz release the relevant code in another branch or repo?

nighting0le01 commented 12 months ago

Hi I wanted to ask if the arbitrary timestep training code can be shared? How can I reproduce the results??