CyFeng16 / MVIMP

Mixed Video and Image Manipulation Program
GNU General Public License v3.0
71 stars 20 forks source link

Interpolated Frames turn out Pixelated #29

Open Zotikus1001 opened 3 years ago

Zotikus1001 commented 3 years ago

Hello again. I finally had some time, and managed to get the anime dupe only interpolation working. The thing I spoke on #4 (You can see on my fork) It can use some improvements, but it's working :)

So now I'm left with solving the Pixelation that happens on 90% of interpolated frames. Very noticeable on fast moving scenes.

I did some testing with DAIN original repo today, and the pixelation doesn't happen (DainApp also doesnt happen). There are artifacts, ofc, but no pixelation. So I'm inclined to believe something is wrong with your DAIN interpolation code. I took a look, but I'm afraid it's too much for my noob self. :)

I used the original DAIN with the latest colab file they provided.

Here are some examples of what I'm talking about:

Original DAIN: (Notice the artifacts) image

And this is using MVIMP: (Notice how pixelated everything looks. Also the weapon fire effect is a green blue color for some strange reason) image

Here's another example from another video: image

Here's a video where you can actually tell without going frame by frame: https://www.youtube.com/watch?v=Qa54A1-FOWY *You can use , and . on youtube to go frame by frame.

And heres a video using the original DAIN: https://www.youtube.com/watch?v=sN1VA-gg7yM (No pixelation)

I understand artifacts will always happen. But Artifacts + Pixelation makes it much worse. I'd love to solve this problem so I can start interpolating some anime. The pixelation is even worse on anime.

*The pixelation is happening whether I use High Resolution splitting or not. So that's not it.

Any help would be greatly appreciated. Thank you.

CyFeng16 commented 3 years ago

Glad to meet you again! :) I will try to recheck the difference between the current code and the source code, once my assignment is temporarily over.