search

hzwer / Practical-RIFE

We are developing more practical frame interpolation approach.
MIT License
547 stars 60 forks source link

Add anime models #12

Closed bropines closed 2 years ago

bropines commented 2 years ago

Is there any way to add interpolation for animation? The current version of course knows how to make animation smoother, but with a bunch of artifacts. Yes, version 4 has become better compared to the past, but it's still better to make a separate model for animation, as they did for example in real-esrgan

hzwer commented 2 years ago

Your suggestion is sound, I can give it a try.

bropines commented 2 years ago

Maybe this will help in some way https://github.com/lisiyao21/AnimeInterp

mikebilly commented 2 years ago

yes we want a model that is specially trained for anime to create the best output for anime

hzwer commented 2 years ago

In fact, the v4.0 version already contains the data of anime10K. I recently tried developing the "anime" and "real world" versions separately, but found no improvement.

bropines commented 2 years ago

Let's just say that even the 4th version with 2d animation is extremely tight. 2.3 is a little better, but still the algorithm stupidly lubricates the animation.

hzwer commented 2 years ago

v4.4 model is tuned for anime. We will further optimize it.

mikebilly commented 2 years ago

v4.4 model is tuned for anime. We will further optimize it.

@hzwer Thanks for your devotion to animation, I'd love to see more development regarding animation content!