fishslot / video_loopback_for_webui

GNU General Public License v3.0
323 stars 17 forks source link

Compression Artifacts with temporal superimpose #12

Open xanderjm opened 1 year ago

xanderjm commented 1 year ago

Im getting some issues with what looks like compression artifacts - and it only seems to effect some frames...

some frames render clear like so image

Others have these artifacts like they are low res scaled up image

The seed, subseed & prompt are all fixed. and both these images are from the same loop... i can only assume its something to do with the process of blending the images together & compression in saving the resulting image, i notice it most when using temporal superimpose schedule.

Im using quite a hefty combine which i imagine makes the problem worse

[0.5,0.5,0.5,0.5,0.5,0.5,0.5,0.5,0.5,0.5,0.5,0.5,0.5] if loop_i<=4 else [0.0,0.0,0.0,0.0,0.0,0.0,0.1,0.0,0.0,0.0,0.0,0.0,0.0]

Strange that it only happens on some frames?

fishslot commented 1 year ago

Can you upload the generated video, the json file generated by this script, and the input video, so that I can reproduce this issue?

xanderjm commented 1 year ago

@fishslot sure thing

here is a zip that contains it, i just included loop_1 but you can already see it appearing - some frames perfect, others compressed

230302_200312.zip

fishslot commented 1 year ago

It seems that this problem doesn't appear in my test. I'm not sure about the reason at present. Maybe more tests are needed. Maybe you can try to add -- no-half-vae in the startup option of the WebUI? Or try the 768-v-ema model?