Open ShmuelRonen opened 1 year ago
Try using ControlNet tile directly with source video frame path as control images (put the path to frames into AnimateDiff video path or ControlNet batch tab), if that’s gonna work then that is tile-upscale. If that’s not gonna work, we will have to read the source code.
I will check it. Is it possible to put the PNG files of each video in a separate folder and not have them all together, for example, in the outputs\txt2img-images\2023-10-19 folder?
Go to Settings/AnimateDiff and you will know which setting you should check
Thanks! now the PNG files is in a separete folders. When I do an upscale in animatediff-cli-prompt-travel, Besides the PNG files, it uses the creation script (json) to create the upscale with tile-upscale. How can I solve it in sd-webui-animatediff?
Example: prompt.json
I don't think this config has anything else you need to config in webui. Just use ControlNet tile directly and see what's going on.
I will try and update you.
OK. As you wrote, I try using ControlNet tile directly with source video frame path as control images (put the path to frames into AnimateDiff video path or ControlNet batch tab), if that’s gonna work then that is tile-upscale. The original video was 512x512 and I changed to 1024x1024. it's works for me but take a very long time (25 min for 16 frames) on my RTX 3090. Original: Tiled:
Now I try to do tiled-upscale on animatediff-cli-prompt-travel with the same PNG files. now it's take 2 min only for the same resoults.!!! Tiled:
Can I make it better?
Thanks for your report. I will investigate.
You should use control_v11f1e_sd15_tile and not control_v11u_sd15_tile !!!
What's the difference between the first tiled and second tiled upscale video? how were able to make it render in less time??
control_v11u_sd15_tile is an older version and control_v11f1e_sd15_tile is the new one.
Example control_v11f1e_sd15_tile:
Example control_v11u_sd15_tile:
The processing time taken by both is pretty much the same.
I noticed that if the tiled-upscaling process does not use the original prompt, the proposal comes out distorted. Also in the mode of prompt-travel.
I don send you an example because is NSFW...
OK here it with cover... compatibility of taild-upscale to the prompt.
Test No 1, upscale with automatic 1111 controlnet tile-upscale. it's take 17 min and the prompt commands are not kept.
Test No 2, upscale with animatediff-cli-pt tile-upscale. it's take 3 min and the prompt commands are kept.
Is it possible to add tiled-upscale as part of the GUI?
V2V VRAM problem should have been resolved. Let me know if problem still exists.
Hey...
I did a comprehensive experiment regarding Tile upscale in the updated version. prompt: kid need seed to grow.
In text2image mode without Animatediff, the Tile upscale from 512X512 to 1024X1024 went quickly and successfully. See an example.
512x512 :
1024x1024:
Now I made a short gif (16 frames) in 512x512 with animatediff web-ui
When I try to resample it to 1024x1024 with tile-resample it's said the time it would take was around an hour.
Here I gave up and did not continue.
Am I doing something wrong?
My computer have 64 GB memory and RTX3090.
Expected behavior
Hello, and thank you for you work!!
I work with animatediff-cli-prompt-travel and there is the animatediff tile-upscale option. How do I implement it here?
Example: animatediff tile-upscale "W:\animatediff-cli-prompt-travel\output\2023-10-19T19-20-05-anime-incredibleworld_v20\00-2529226679637802235" -c config/prompts/anime.json -W768 -H1152