search

nagadomi / waifu2x

Image Super-Resolution for Anime-Style Art
http://waifu2x.udp.jp/
MIT License
27.6k stars 2.71k forks source link

Suggestion - GUI #148

Closed RinMaru closed 8 years ago

RinMaru commented 8 years ago

I just love this i was able to beautifully upscale a small image with great results. would a UI be possible? command line is a bit of a hassle

nagadomi commented 8 years ago

Use web.lua for web interface(it's same as http://waifu2x.udp.jp) or waifu2x-caffe(for windows).

Droyk commented 8 years ago

Will you able to tell me which is more updated I think it's the website because whenever I upscale my images with the website the quality seems good & the size seems good too but whenever I try caffe it seems more sharp to eye and become much larger than the website.

RinMaru commented 8 years ago

thanks hope it works as good as the page 😊

nagadomi commented 8 years ago

@Droyk Do you use the latest version of waifu2x-caffe? I think that waifu2x-caffe's 2-D illust (UpRGB Model) is completely the same as the our model that is used in the our website. But, in Denoise mode on UpRGB, it seems that waifu2x-caffe has a different method than our method. Probably it causes the different results. Please use 2-D illust (RGB Model) for Denoise mode.

Droyk commented 8 years ago

Yup I have the latest version it's really sharp and after upscaling size becomes too big even if i compare it to the website one & by the way why don't you make your own application? & why on the website you didn't add more upscaling options?

nagadomi commented 8 years ago

118 is related.

why don't you make your own application?

My focus is on web application. and I am contributing to waifu2x-caffe project within open source development. and I don't have windows environment.

Droyk commented 8 years ago

if you contributed to the waifu2x-caffe do you know what all the settings means exactly because I use my guess to use the settings will you be able to tell me what those settings means exactly?

and is there is any program that is as good as waifu2x-caffe and is in active development like your waifu2x project?

nagadomi commented 8 years ago

As far as I know, waifu2x-caffe is the only software option that is full compatible with waifu2x(this repo).

Droyk commented 8 years ago

if you contributed to the waifu2x-caffe do you know what all the settings means exactly because I use my guess to use the settings will you be able to tell me what those settings means exactly?

nagadomi commented 8 years ago

I've read almost of waifu2x-caffe code and I used it for some closed products. What is your question? I don't know what you're saying.

nagadomi commented 8 years ago

Sorry, I forgot that waifu2x-caffe does not have english documents. I don't have time and english skill for translating the waifu2x-caffe's document.

Droyk commented 8 years ago

okay will you able to tell me what (Uses of TTA mode) actually means & what split size means?

and I have been seeing on the internet that some people even upscaled videos using waifu2x is that possible if so then how should I do it!

nagadomi commented 8 years ago

TTA

TTA(test-time augmentation) mode averages the upscaling results of the following 8 augmented inputs. tta TTA mode able to reduce several type of artifacts but it's 8x slower than non TTA mode.

split size

block size(px) for block processing. larger size might be faster but it increases memory usage. When split size is too large for your GPU memory, runtime error(out of memory) might occur.

video

  1. convert video(all frames) to PNG images (with ffmepg)
  2. waifu2x
  3. convert waifu2xed images to video (with ffmpeg)

See https://github.com/nagadomi/waifu2x#video-encoding

Droyk commented 8 years ago

convert video(all frames) to PNG images (with ffmepg) waifu2x convert waifu2xed images to video (with ffmpeg)

Well that's totally looks a little time consuming work will you able to tell me how much time it will take on a 24 minute episode on i5 gtx970

nagadomi commented 8 years ago

You can guess the processing time with waifu2x-caffe. (It will display the processing time) When, video time=24min, video fps=24, waifu2x processing time per frame = 1sec, 

number of images = 1440sec(24min) * 24FPS = 34560 frames
processing time = 34560 * 1(waifu2x sec) = 9.6 hours

When the waifu2x processing time per frame = 2sec, it takes around 20 hours.

P.S. In fact, waifu2x does not expect the video frame input(it is not similar with fanart-like image). You should check the upscaling results first. For anime videos, maybe Photo (UpPhoto Model) model is better than 2-D illust (UpRGB Model) model.

nagadomi commented 8 years ago

another option, VapourSynth supports waifu2x-caffe. https://github.com/HomeOfVapourSynthEvolution/VapourSynth-Waifu2x-caffe I am not familiar with this software.

Droyk commented 8 years ago

Thankyou nagadomi for the help the last question is how do I use VapourSynth I downloaded the files but there is no exe do I have to merge it with caffe then it will work.

nagadomi commented 8 years ago

installation: http://www.animemusicvideos.org/forum/viewtopic.php?t=125039#p1546405 waifu2x-caffe plugin binary: https://github.com/HomeOfVapourSynthEvolution/VapourSynth-Waifu2x-caffe/releases

I haven't used this software. It looks a script based tool. Maybe it's hard to use as non programmer users.