search

feinanshan / M2M_VFI

Many-to-many Splatting for Efficient Video Frame Interpolation
Other
79 stars 5 forks source link

Artifacts with highspeed objects #15

Open manojs8473 opened 12 months ago

manojs8473 commented 12 months ago

Hi! The algorithm generates artifacts like flickering/disappearing of fast objects like when doing interpolation on soccer footages? Is there any way to solve this? Will training on slowmo soccer dataset help solve this issue ?

sniklaus commented 12 months ago

Thank you for bringing this up! Video frame interpolation remains an unsolved problem. The larger the motion the more difficult the problem becomes, and eventually any video frame interpolation fails to account for the motion ones it becomes too large/difficult. As such, what you are experiencing sounds within expectations. And while you could try to fine-tune on soccer data, there is no guarantee the it will lead to meaningful improvements. :upside_down_face: