search

guoyww / AnimateDiff

Official implementation of AnimateDiff.
https://animatediff.github.io
Apache License 2.0
10.28k stars 843 forks source link

Feature Request: T2I Adapter Support #279

Open JustCann opened 7 months ago

JustCann commented 7 months ago

Hello,

I may be doing this incorrectly, but when I attempt to use T2I Adapters in CN the extension creates an animated gif but keeps the model frozen in place as if I was doing img2img. Is using T2I Adapters supported or am I doing something incorrectly?

Thanks!!

vicitooo commented 7 months ago

Lower your strength and percents. It is almost like tile. It will fix it in place with minimal movement if your CN is too strong.

JustCann commented 7 months ago

Interesting... I had multiple going on, so the weight should be less than 1? I will try some more tests. Is running multiple CN a problem also?

vicitooo commented 7 months ago

No, you can run as many CN as you want. The more CN and the higher the weights, the more stable the image is. It is a fine balance between stability and motion.

JustCann commented 7 months ago

I did what you recommended, this time I only used t2IAdapter depth and the same issue still occurred, no movement as compared to other CN.

JustCann commented 3 months ago

I am just coming to the conclusion that T2I is just not possible with AnimateDiff. If I wanted a still image, I would make one, the caveat is the generation time. :(