search

nagadomi / waifu2x

Image Super-Resolution for Anime-Style Art
http://waifu2x.udp.jp/
MIT License
27.45k stars 2.71k forks source link

How to upscale videos via Waifu2X #269

Open PegionFish opened 5 years ago

PegionFish commented 5 years ago

So here's what happened. I want to upscale a low-res Vocaloid song video to 1080p because the source is modified which makes it impossible for me to just use video from Blu-Ray version. I have the latest Windows 10 and NVIDIA GeForce GTX 1060 6G installed on my PC What should I do next? Due to my machine has certain bugs I can't use Linux distributions so it would be nice if I can just run this on my Windows PC. CUDA and cuDNN are all set.

magiruuvelvet commented 5 years ago

waifu2x isn't really made to upscale videos. While it's not impossible, it takes a lot of time and effort. I once upscaled a bunch of videos using waifu2x; for that I used the following software:

The process took several weeks on my laptop with constant 100% GPU usage; I can't recommend it.

The results of the upscale really depend on the visual quality (compression artifacts) of the input source, you first should try 3~5 seconds of a video before wasting your time.

EDIT: If you need a reference; those are the videos I upscaled within 2 month https://mega.nz/#F!Sxo2kQIB!eyD2hfdv9Y3C-tiFrkLXjQ

PegionFish commented 5 years ago

waifu2x isn't really made to upscale videos. While it's not impossible, it takes a lot of time and effort. I once upscaled a bunch of videos using waifu2x; for that I used the following software:

  • ffmpeg, to convert a video into pictures frame-by-frame; and to put all frames together into a video file again
  • ImageMagick, for eventual resolution fixes which may come up by using waifu2x
  • bash shell for batch processing with ImageMagick
  • x264 and x265 to encode the lossless video which has several GB into a small video file

The process took several weeks on my laptop with constant 100% GPU usage; I can't recommend it.

The results of the upscale really depend on the visual quality (compression artifacts) of the input source, you first should try 3~5 seconds of a video before wasting your time.

EDIT: If you need a reference; those are the videos I upscaled within 2 month https://mega.nz/#F!Sxo2kQIB!eyD2hfdv9Y3C-tiFrkLXjQ

Thank you helped a lot

nagadomi commented 5 years ago

https://github.com/K4YT3X/video2x https://github.com/HomeOfVapourSynthEvolution/VapourSynth-Waifu2x-caffe

I have never used these.

akai-katto commented 5 years ago

I'm working on a software to optimize waifu2x for videos, it's still in development but I hope to release it soon.

https://github.com/CardinalPanda/dandere2x

PegionFish commented 5 years ago

I'm working on a software to optimize waifu2x for videos, it's still in development but I hope to release it soon.

Wow， thank you for your creation. Hope to use it soon

unit2x commented 5 years ago

I saw them using Blender and Waifu2x Cafe. In general, the time to make a video is quite time consuming and difficult for newbie. https://mega.nz/#!yhhGGIAY!jLXLukN2yHD6-qVe0bzH0ciGfSBuQ6AH91lXR4t8rxM I think it must be at least a GTX 1070 if you want to do this, otherwise you'll lose a lot of time. (Made by Jetrix from Hongfire)

unit2x commented 5 years ago

I'm working on a software to optimize waifu2x for videos, it's still in development but I hope to release it soon.

Hope it is fast and easy to use :))

EsteveJohnson commented 4 years ago

Script for scale videos using Waifu2X in avisynth,

Here link: https://www.youtube.com/watch?v=kdbhFVZ4vIM In the description of the video, comes a compressed file with all the necessary files and examples for its use.

Avisynth + any program windows Waifu2x (waifu2x-conver-cpp, waifu2x-caffe, waifu2x-ncnn-vulkan)

It has automatic detection of duplicate frames, thereby saving processing time in static scenes Only use a single temporary image file.

OnlyScriptAvsWaifu.zip