Skquark
commented
1 year ago Ah, nice.. Keeps getting better. That opens up a whole lot of features, as well as some design complexities. Just started to tinker together some code for adding AnimateDiff ControlNet Layers to the UI, and trying to decipher the best way to make it easy.
They also added 'prompt_map' to travel the keyframes, which is what I wanted instead of the 'prompt' list that just made batches, however that makes my UI more complex there.. I'll figure something out to add the steps to the animated prompts list.
There's like 15 different ControlNet types that can be enabled, with a bunch of settings for each, so trying to decide the best way to handle that. Looks like the way it's setup, each layer needs an init_image that goes into the data/controlnet_image folder, and it's similar to how I have my other ControlNet Multi-Layer feature laid out with dropdown, image and Add Layer with list, so I can probably transplant that. Fun.
Then they have upscale modes to enable, along with extra upscale settings. Think I'll make those as checkboxes to enable the 5 upscale options. Getting a little tricky but doable.. not sure if I really need to expose all the settings or simplify a lot of it with set defaults.
On top of that, we can assign a reference image into it.. Should take a little time to implement all of it in the GUI, but feels like it's worth the extra effort as long as it works well. If you've got ideas, insights or suggestions, I'm open... Thanks.
Theres a new Fork to For animateDiff that uses the same animatediff you implement..but adds the ability to make things longer and use controlnet for better control, https://github.com/s9roll7/animatediff-cli-prompt-travel Plus there's a discord of some of the people trying to train the motion modules for animatediff if you like to implement some of the work they are doing here's the discord https://discord.gg/m9arRBBf