search

AaronFeng753 / Waifu2x-Extension-GUI

Video, Image and GIF upscale/enlarge(Super-Resolution) and Video frame interpolation. Achieved with Waifu2x, Real-ESRGAN, Real-CUGAN, RTX Video Super Resolution VSR, SRMD, RealSR, Anime4K, RIFE, IFRNet, CAIN, DAIN, and ACNet.
https://patreon.com/aaronfeng
Other
13.1k stars 878 forks source link

[Feature request] Add Real-ESRGAN to the list of upscaler #279

Closed Tsubajashi closed 3 years ago

Tsubajashi commented 3 years ago

Is your feature request related to a problem? Please describe. No, this is merely a request to add an upscaler.

Describe the solution you'd like https://github.com/xinntao/Real-ESRGAN In there, is a ncnn version of Real-ESRGAN, which in structure is very similar to RealSR, but has superior video quality. it would be really cool to have it in your software!

Describe alternatives you've considered Theres no alternative, just a request.

Additional context I have no further context.

AaronFeng753 commented 3 years ago

Thank you!

AaronFeng753 commented 3 years ago

I was wanna follow the the development of this project but kinda forgot about it, thank you for report this new development, definitely gonna look into this

Tsubajashi commented 3 years ago

wonderful! glad i could help.

AaronFeng753 commented 3 years ago

Okay, I just checked that repo, I don't think I should support it right away since it apparently still at early development stage, but I am definitely gonna keep an eye on it

Tsubajashi commented 3 years ago

alright! later in time, I will write to you again, since im working on an interpolation AI myself. I will remind you when it seems to be in a more stable stage.

AaronFeng753 commented 3 years ago

alright! later in time, I will write to you again, since im working on an interpolation AI myself. I will remind you when it seems to be in a more stable stage.

That's awesome! Thanks!

AaronFeng753 commented 3 years ago

Okay, I managed to implemented the Real-ESRGAN (I just re-use codes for realsr) But the result is kinda disappointing There are nearly no performance difference or image quality difference between them, they are pretty much the same thing

RTX 3060 (耗时 = time cost) Real-ESRGAN: gan

Realsr: realsr

@Tsubajashi

AaronFeng753 commented 3 years ago

Well, I tried some other pics, and the image quality is better in some cases

Tsubajashi commented 3 years ago

in my honest opinion, most pics i tested worked so much better on Real ESRGAN that i found it to be a really nice idea to already implement :D

AaronFeng753 commented 3 years ago

Snipaste_2021-08-09_11-47-44

AaronFeng753 commented 3 years ago

in my honest opinion, most pics i tested worked so much better on Real ESRGAN that i found it to be a really nice idea to already implement :D

Which kind of images?

Tsubajashi commented 3 years ago

basically everything i found. from IRL images (and frame sequences from movies) to Anime Openings in frame form, literally 95% of all my tests

AaronFeng753 commented 3 years ago

basically everything i found. from IRL images (and frame sequences from movies) to Anime Openings in frame form, literally 95% of all my tests

Okay, I can see some difference when processing IRL pics, but can not see any difference when processing Anime.

Tsubajashi commented 3 years ago

most of my anime have jpeg artifacting and compression in them. it can then really create good frames to be honest

AaronFeng753 commented 3 years ago

Anyway, since I already implemented ALL the codes, I am definitely not gonna remove it, this engine sure is gonna be supported in the future(after I do more tests

Tsubajashi commented 3 years ago

wonderful! glad to hear that

AaronFeng753 commented 3 years ago

And thank you for suggest this, currently I am looking for a faster version of RealSR (kinda like the "Anime4K" version of RealSR)

Please let me know if you found any project like that, thanks!

Tsubajashi commented 3 years ago

ill look for such projects for sure!

AaronFeng753 commented 3 years ago

Just tried it on an old LTT video, now I can really see the difference (RealSR | Real-ESRGAN) Snipaste_2021-08-09_13-16-44

Tsubajashi commented 3 years ago

great example!

AaronFeng753 commented 3 years ago

https://github.com/AaronFeng753/Waifu2x-Extension-GUI/releases/tag/v3.80.01-beta