hzwer / ECCV2022-RIFE

ECCV2022 - Real-Time Intermediate Flow Estimation for Video Frame Interpolation
MIT License
4.35k stars 432 forks source link

Is RefineNet necessary? #246

Closed kyz20 closed 2 years ago

kyz20 commented 2 years ago

In the Appendix of your paper, I do not see much difference between the results with or without RefineNet, but RefineNet increase much computational cost. So the only reason to use RefineNet is to get higher score (like PSNR, SSIM)?

hzwer commented 2 years ago

Probably. We found that using only optical flow to warp the image to produce results produced a sharper effect. If we carefully design and optimize the lpips metric, we can get a more practical model.