Open toyxyz opened 1 year ago
nice results! what did you feed in as tile input, all of the frames from the smaller video?
nice results! what did you feed in as tile input, all of the frames from the smaller video?
Yes. I placed all the 512x768 images back into the ControlNet tile folder.
cool 👍🏽 I got it to work but had to set upscale strength pretty low, otherwise a lot of jitteriness
I tried a few ways to upscale the video generated by AnimateDiff.
Webui ControlNet(tile+lineart+TemproalNet) batch img2img
Flickering is visible throughout the video, just like a normal batch img2img.
https://github.com/s9roll7/animatediff-cli-prompt-travel/assets/8006000/8c49544c-5219-4754-a918-090a01dd8cec
AnimateDiff ControlNet tile
Much cleaner than TemporalNet! However, due to high VRAM consumption, upscaling beyond 1024x1536 is not possible.
https://github.com/s9roll7/animatediff-cli-prompt-travel/assets/8006000/e333a239-b1c2-45d1-8366-b9aa7ece685b
AnimateDiff ControlNet tile - > Webui Adetailer + NMKD YandereNeo (4x)
I upscaled the video to 1024x1536 with AnimateDiff, then used Adetailer to enhance the detail on the character's face, then upscaled it to 4K resolution with NMKD YandereNeo (4x). It became very sharp!
https://github.com/s9roll7/animatediff-cli-prompt-travel/assets/8006000/ba7b2da0-505a-413f-b558-df62a4c7ec10
https://github.com/Bing-su/adetailer
https://openmodeldb.info/models/4x-NMKD-YandereNeo
https://huggingface.co/CiaraRowles/TemporalNet/tree/main