Feature/ssim interpolation - Githubissues

Kahsolt / stable-diffusion-webui-prompt-travel

Travel between prompts in the latent space to make pseudo-animation, extension script for AUTOMATIC1111/stable-diffusion-webui.

The Unlicense

248 stars 22 forks source link

Feature/ssim interpolation #42

Closed Madrawn closed 7 months ago

Madrawn commented 7 months ago

Copies the ssim algorithm from the "shift-attention" plugin for the linear fixed process. If enabled it tries to keep the difference between successive frames below a certain difference threshold. This is different from just raising the number of frames per stage, as it adds more frames when the image changes faster from step to step and less when it changes slow. Without ssim:

https://github.com/Kahsolt/stable-diffusion-webui-prompt-travel/assets/1095756/1d4a92cc-a1fe-425e-b036-7ce5657d2f67

With ssim (threshold 0.5) enabled:

https://github.com/Kahsolt/stable-diffusion-webui-prompt-travel/assets/1095756/03d2c99e-dd8b-472c-93be-97a0f74986a3

Also fixes deprecated "script_args" parameter by just getting the possible parameters by looking with "inspect"

Kahsolt commented 7 months ago

Nice dude, I love this! Great thanks for your efforts!