search

continue-revolution / sd-webui-animatediff

AnimateDiff for AUTOMATIC1111 Stable Diffusion WebUI
Other
3.12k stars 259 forks source link

[Question] How does interpolation between two images work now? #326

Open VadimFedenko opened 1 year ago

VadimFedenko commented 1 year ago

In the first versions of this extension, it was enough to select 2 images as a Tile ControlNet , to generate a smooth transition between the images. the weight of each ControlNet controlled the "weight" of the frame in the animation. Now whatever I do, it doesn't work like that. I tried img2img with an additional image, but it only works with high denoise (like 0.75 and higher) where the initial images barely influence the result, if it all. how to trigger the interpolation behavior from earlier versions of the extension, besides rolling back to the old version?

continue-revolution commented 1 year ago

@zappityzap

zappityzap commented 1 year ago

I don't think this is about frame interpolation.

@VadimFedenko Could you share the settings and results you're seeing? Which version gave the expected result?

VadimFedenko commented 1 year ago

@zappityzap I made a small example of how interpolation worked in previous versions (like v1.3.0). at that time it was a popular use case for creating transitions between two images. https://youtu.be/h2Pk-H3Lh94 It worked simply by using 2 ControlNet images, and I just wanted to figure how to recreate this (or something simillar) in the newer versions. (notice how the denoise is very small in the transition, making it possible to recognize original images in the 1st and last frames? that's the main thing I'd like to achieve, but I don't know how with the latest updates) I'm sorry, I can't provide specific setting that don't work for me, because I tried tweaking all of the parameters, and they simply don't give the same result on the newer versions. Or am I missing something? I haven't followed the development for a few months. Sorry again, and thanks in advance