bloc97 / Anime4K

A High-Quality Real Time Upscaler for Anime Video
https://bloc97.github.io/Anime4K/
MIT License
18.51k stars 1.35k forks source link

usage with games #74

Open blockspacer opened 4 years ago

blockspacer commented 4 years ago

Hi, recently Nvidia released DLSS 2.0 and it is based on image up-scaling for improving game framerate (render at low resolution, than upscale), see https://engnews24h.com/nvidia-dlss-2-0-all-the-news-of-deep-learning-super-sampling/

Is Anime4K suitable for realtime games (maybe with some modifications to improve performance)?

bloc97 commented 4 years ago

Even if I think that ML super-resolution algorithms for 3D rendered games is a solution looking for a problem, (since increasing the resolution does not cost much more than applying a complex SR algorithm such as DLSS), Anime4K is tailored to anime, but should also work with games.

Instances where I think Anime4K would be useful is for non-pixel art/cartoon-ish 2D games such as Visual Novels or games with a lot of hand-drawn art. These art assets have a fixed size and will be pixelated/blurry when upscaled to a higher resolution.

It shouldn't be complex to port Anime4K to their engine or to something like ReShade, since it is already written in GLSL.

Calinou commented 4 years ago

What about a command-line or web-based tool that can be used to resize images using the highest quality variant of Anime4K? This could be useful for game modding.