continue-revolution / sd-webui-animatediff

AnimateDiff for AUTOMATIC1111 Stable Diffusion WebUI
Other
3.11k stars 258 forks source link

[Feature]: suggestion, multi controlnet source support #188

Closed YoungkyuAlexKim closed 1 year ago

YoungkyuAlexKim commented 1 year ago

Expected behavior

Is it possible to add a function to enter multiple control net sources in the current state?

Currently, it is possible to automatically extract controlnet sources from one video source to create animations, but some sources do not seem to be perfect to reflect the intention of the operator in the preprocessing phase. (Especially for open pose, some joints can't be created at all, so it's often hard to fully trust.)

If an artist can source a separate animation path that is self-produced and extracted by other external programs such as blender or Maya, I think we can create a much more consistent and reflective outcome of the worker's intentions.

For your information, I am attaching an example of the animation pass that I made myself as a GIF.

If it's already a feature implemented in the current version and I didn't know about it, please don't pay much attention.

depth depth seg seg walking openpose

all sources are created from other 3d program.

continue-revolution commented 1 year ago

It’s already supported in v1.7.0