search

alex-moon / vc

MIT License
22 stars 6 forks source link

Video Frame Interpolation #30

Closed alex-moon closed 2 years ago

alex-moon commented 2 years ago

At high speeds in particular the ffmpeg interpolation creates blurring. Do interpolation with an AI instead, specifically one of these (in order of preference):

https://github.com/junheum/abme https://github.com/hperrot/splatting

alex-moon commented 2 years ago

Having implemented ABME, I'm unhappy with the results. The intermediate frames lose a lot of detail. Worth sanity-checking this - does FFMPEG do better? If so, something is clearly wrong here. If not, however, then ABME might still be better.

Might also be worth trying BMBC by the same author: https://github.com/JunHeum/BMBC

Also worth taking a look at RIFE: https://github.com/hzwer/arXiv2020-RIFE