bloc97 / Anime4K

A High-Quality Real Time Upscaler for Anime Video
https://bloc97.github.io/Anime4K/
MIT License
17.98k stars 1.34k forks source link

Anime4k CNN input type #226

Closed kristoftunner closed 5 months ago

kristoftunner commented 6 months ago

I'm curious about why the custom anime4k CNN is not using YUV input images, specifically focusing on the Y component. This approach is quite common in super resolution models due to the reduced sensitivity of our eyes towards chroma components.

The upscaling could be done only on the Y component and for the U/V components a simple bicubic upscale could be used, thus decreasing the computation complexity of the problem.

hooke007 commented 5 months ago

I'm curious about why the custom anime4k CNN is not using YUV input images

Anime4k v3.0

ref : https://github.com/bloc97/Anime4K/releases/tag/v3.2

All shaders now work on RGB space instead of Luma.