Waifu2x in real time

[Mickevincent]

Hello!

(I sent a message thru Dolphin forums but for certainty I post here as well)

I was for some reason told to get in contact with "Ishiiruka" by a user at http://ngemu.com/. I don't know if you are the right person I should have contacted but I'll try it anyway. Now I know that you do work with Dolphin only so I don't know exactly why he told me to contact you for that reason either, but maybe you do work with other emulators and are extremely good at it? I don't know Smile

Anyway, here is what I want. It is about PS1 emulation. I don't know if you have heard about Waifu2x filtering? Here is a google translated URL to where you can download it as a program

https://translate.googleusercontent.com/translate_c?depth=1&hl=en&prev=search&rurl=translate.google.se&sl=ja&u=https://github.com/lltcggie/waifu2x-caffe/releases&usg=ALkJrhivu32FwUwuPxodRAFRTS4bRFPimA

and here is a URL to a GLSL implementation

https://github.com/ueshita/waifu2x-converter-glsl[url=https://github.com/ueshita/waifu2x-converter-glsl][/url]

It is kinda resource heavy, when I do it in gpu mode it takes about 0.2 - 0.5 seconds to render one picture, and I have a 980ti. But I don't know tech stuff so much and have no idea how well optimized it is.

I have asked around at many forums now about this and heard everything from "it's impossible" to "it's too much work". So why do I want it so badly? Well, here are some Waifu2x with highest noise reduction filtered pictures from Final Fantasy VII and IX. These were originaly as you know in very low resolutions. Zoom in to see how well the Waifu restores small details.

http://i.imgur.com/X27lVJ5.jpg

http://i.imgur.com/CzRczDb.jpg

http://i.imgur.com/fYwxIBY.png

http://i.imgur.com/iIN3GXk.jpg

http://i.imgur.com/D7dBMdH.jpg

If you ask me it could give the game the "hd-look" it deserves. This filter needs to be ported for gaming.

Maybe if you yourself don't want to or know how to do this maybe you know someone who does? I certainly hope for some positive feedback for once in this mission I have Wink Hehe

/Mike

[Tinob]

looked at the code and is a prity big neural network that is used, at this stage is would really hard to get full speed in current hardware, is a really big algorithm and it will kill any modern gpus. maybe if the network can be simplified it would be doable but it will requiere a lot of work to be done and i dont even know how much performance can be achieved.

2016-05-29 15:29 GMT-03:00 Mickevincent notifications@github.com:

Hello!

(I sent a message thru Dolphin forums but for certainty I post here as well)

I was for some reason told to get in contact with "Ishiiruka" by a user at http://ngemu.com/. I don't know if you are the right person I should have contacted but I'll try it anyway. Now I know that you do work with Dolphin only so I don't know exactly why he told me to contact you for that reason either, but maybe you do work with other emulators and are extremely good at it? I don't know Smile

Anyway, here is what I want. It is about PS1 emulation. I don't know if you have heard about Waifu2x filtering? Here is a google translated URL to where you can download it as a program

https://translate.googleusercontent.com/translate_c?depth=1&hl=en&prev=search&rurl=translate.google.se&sl=ja&u=https://github.com/lltcggie/waifu2x-caffe/releases&usg=ALkJrhivu32FwUwuPxodRAFRTS4bRFPimA

and here is a URL to a GLSL implementation

https://github.com/ueshita/waifu2x-converter-glsl[url=https://github.com/ueshita/waifu2x-converter-glsl][/url]

It is kinda resource heavy, when I do it in gpu mode it takes about 0.2 - 0.5 seconds to render one picture, and I have a 980ti. But I don't know tech stuff so much and have no idea how well optimized it is.

I have asked around at many forums now about this and heard everything from "it's impossible" to "it's too much work". So why do I want it so badly? Well, here are some Waifu2x with highest noise reduction filtered pictures from Final Fantasy VII and IX. These were originaly as you know in very low resolutions. Zoom in to see how well the Waifu restores small details.

[Image: X27lVJ5.jpg]

[Image: CzRczDb.jpg]

[Image: fYwxIBY.png]

[Image: iIN3GXk.jpg]

[Image: D7dBMdH.jpg] If you ask me it could give the game the "hd-look" it deserves. This filter needs to be ported for gaming.

Maybe if you yourself don't want to or know how to do this maybe you know someone who does? I certainly hope for some positive feedback for once in this mission I have Wink Hehe

/Mike

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/Tinob/Ishiiruka/issues/46, or mute the thread https://github.com/notifications/unsubscribe/AF0HimSGw8pbF2VaOdy3Xt3x22XKRznmks5qGdr6gaJpZM4IpWPb .

[Mickevincent]

With current hardware you mean not even a 980ti or titan x can do it? How about maybe 1080ti. Of course we still don't know the performance of that. But.. even if it would be a bit too demanding, why not make it for future use? I'am.. willing to pay, of course not much, but some for it to be done. Of course in usable state.

Yes, I'am desperately wanting this filter for my gaming. I need it :) Thanx! /Mike

[Mickevincent]

I have talked a little with the developer of Waifu2x. He is currently developing a version that is at least 2x faster. He also said this, wich I don't quite understand what it means

"If you train a small(shallow) CNN model, It will be faster(quality down a little) but it cannot reach reailtime, I think."

And he said this about the new model

"(on GTX760 and 320x240 image, current model 0.77 sec, new model 0.41 sec)"

At least some good news :)

[Mickevincent]

I have sent you another private message on Dolphin forums. It's quite important, when you got time :)