search

continue-revolution / sd-webui-animatediff

AnimateDiff for AUTOMATIC1111 Stable Diffusion WebUI
Other
3.07k stars 253 forks source link

[Question] How does interpolation between two images work now? #326

Open VadimFedenko opened 10 months ago

VadimFedenko commented 10 months ago

In the first versions of this extension, it was enough to select 2 images as a Tile ControlNet , to generate a smooth transition between the images. the weight of each ControlNet controlled the "weight" of the frame in the animation. Now whatever I do, it doesn't work like that. I tried img2img with an additional image, but it only works with high denoise (like 0.75 and higher) where the initial images barely influence the result, if it all. how to trigger the interpolation behavior from earlier versions of the extension, besides rolling back to the old version?

continue-revolution commented 10 months ago

@zappityzap

zappityzap commented 10 months ago

I don't think this is about frame interpolation.

@VadimFedenko Could you share the settings and results you're seeing? Which version gave the expected result?

VadimFedenko commented 10 months ago

@zappityzap I made a small example of how interpolation worked in previous versions (like v1.3.0). at that time it was a popular use case for creating transitions between two images. https://youtu.be/h2Pk-H3Lh94 It worked simply by using 2 ControlNet images, and I just wanted to figure how to recreate this (or something simillar) in the newer versions. (notice how the denoise is very small in the transition, making it possible to recognize original images in the 1st and last frames? that's the main thing I'd like to achieve, but I don't know how with the latest updates) I'm sorry, I can't provide specific setting that don't work for me, because I tried tweaking all of the parameters, and they simply don't give the same result on the newer versions. Or am I missing something? I haven't followed the development for a few months. Sorry again, and thanks in advance