search

hzwer / Practical-RIFE

We are developing more practical frame interpolation approach.
MIT License
542 stars 60 forks source link

Motion blur mode #61

Closed Mengnumbal3375 closed 5 months ago

Mengnumbal3375 commented 5 months ago

I was expecting a motion blur option (like RSMB). So it would track the object in the frame and add motion blur based on 1 frame in front and behind the current frame, all the way to the last frame.

For more details, see this video https://youtu.be/9eqyoH7Sxjc?si=-zbvo9kVinPbyYCu

Even if we use motion blur after interpolation. It will be able to cover the warp frame.

banjaminicc commented 5 months ago

Motion blur can always be added back in editing software, there's already a specific AI motion blur programme from the DAIN.app team.

There's probably a better allocation to time for hzwer to improve the models than adding motion blur lol

Mengnumbal3375 commented 5 months ago

Sorry in advance. I may not know anything yet. From my point of view, I was surprised that there is a tool like this that can be used in google colab. So I wanted to ask if motion blur can also be applied here (no coercion).

And your statement about editing software I admit is true. But you need to know that I am here only using a phone (no pc). Although there is motion blur software, its features are limited (warp, bad result, etc) because the phone system is still weak (unlike pc). So I just rely on google colab to do it. So maybe if you have a better solution seen from my condition.

Again, please forgive me for not knowing anything. Thanks

NevermindNilas commented 5 months ago

There are plenty of tools that already do motion blur using Rife and Frame averaging with ( I assume ) kernels. Smoothie-rs

There's also other alternatives that utilize " SVPFlow " blur

There's no real reason to tackle this subject.