search

hollowaykeanho / Upscaler

A consolidation of various compiled open-source AI image/video upscaling product for a working CLI friendly image and video upscaling program.
BSD 3-Clause "New" or "Revised" License
291 stars 25 forks source link

Don't upscale still frames in the video #98

Open Sveagruva opened 2 months ago

Sveagruva commented 2 months ago

Description

Don't upscale frames that don't change from a previous frame. It's useful for upscaling anime where video has a lot of repeating frames

Expected Behavior

Doesn't reupscale repeating frames

Current Behavior

upscales all frames

Associated Data Files

No response

hollowaykeanho commented 2 months ago

Mark this as help wanted because this requires some kind of on-going visual analytic algorithm.

What's the problem aside from taking a long time?

Sveagruva commented 2 months ago

No problems aside from redundant work being done. I don't think it requires complicated algorithm. When upscaling a frame check if it matches previous one (pixel by pixel) and if it does just copy previously upscaled frame instead of upscaling it.

hollowaykeanho commented 2 months ago

Yeah.. that needs the image recognition algorithm to analyze pixel differences. I'll see what I can do. Mark this as optimization feature.