[Test] Upscale test!

[toyxyz]

I tried a few ways to upscale the video generated by AnimateDiff.

Webui ControlNet(tile+lineart+TemproalNet) batch img2img

Flickering is visible throughout the video, just like a normal batch img2img.

https://github.com/s9roll7/animatediff-cli-prompt-travel/assets/8006000/8c49544c-5219-4754-a918-090a01dd8cec

AnimateDiff ControlNet tile

Much cleaner than TemporalNet! However, due to high VRAM consumption, upscaling beyond 1024x1536 is not possible.

https://github.com/s9roll7/animatediff-cli-prompt-travel/assets/8006000/e333a239-b1c2-45d1-8366-b9aa7ece685b

AnimateDiff ControlNet tile - > Webui Adetailer + NMKD YandereNeo (4x)

I upscaled the video to 1024x1536 with AnimateDiff, then used Adetailer to enhance the detail on the character's face, then upscaled it to 4K resolution with NMKD YandereNeo (4x). It became very sharp!

https://github.com/s9roll7/animatediff-cli-prompt-travel/assets/8006000/ba7b2da0-505a-413f-b558-df62a4c7ec10

https://github.com/Bing-su/adetailer

https://openmodeldb.info/models/4x-NMKD-YandereNeo

https://huggingface.co/CiaraRowles/TemporalNet/tree/main

[xnmt9]

nice results! what did you feed in as tile input, all of the frames from the smaller video?

[toyxyz]

nice results! what did you feed in as tile input, all of the frames from the smaller video?

Yes. I placed all the 512x768 images back into the ControlNet tile folder.

[xnmt9]

cool 👍🏽 I got it to work but had to set upscale strength pretty low, otherwise a lot of jitteriness