Below steps can solve your problems with Deforum:
(Note that these steps only apply to Deforum-related problems)
Make sure that you are using the latest version of official A1111 webui (non-official webui may also work but they are not tested).
Update Deforum to the latest version in A1111 Extensions Tab.
Update ControlNet to the latest version in A1111 Extensions Tab.
Disable all extensions other than Deforum and ControlNet.
Completely restart your terminal. (If you do not know what is a terminal, you may restart your computer.) Note that the “Apply and Restart UI” button cannot solve your problem, and you still need to restart your terminal.
Your problem should be solved now. Happy.
If you must use some other extensions, you can now carefully try other extensions one-by-one to see if they work with Deforum.
About the “Control Mode” in CN 1.1:
“Balanced” is same as previous ControlNet 1.0 without any special settings – this mode will perfectly preserve the shape of your ControlNet image(s) in a Deforum video. The “balanced” mode uses exactly same codes as CN 1.0 default setting with guess mode turned off.
“My prompt is more important/ControlNet is more important” will make lots of inconsistent detail variations to each frame of a Deforum video. You can ignore these two options if you just want to precisely control your shapes. These two options are not designed for video processing.
The above guidelines are tested on many devices by different developers from different projects. Those guidelines should be able to solve 99% problems.
If you still have problems, please try to use ControlNet in your txt2img Tab and see if ControlNet works without Deforum, then follow the below instructions:
Besides, in the future, ControlNet has plan to release official video processing extensions to provide technically correct codes for handling video frame consistency. Stay tuned!
Disabling other extensions did fix the error reported, so I can't use other extensions every time I use deforum? Is there another way to solve this problem?
Below steps can solve your problems with Deforum: (Note that these steps only apply to Deforum-related problems)
About the “Control Mode” in CN 1.1:
“Balanced” is same as previous ControlNet 1.0 without any special settings – this mode will perfectly preserve the shape of your ControlNet image(s) in a Deforum video. The “balanced” mode uses exactly same codes as CN 1.0 default setting with guess mode turned off.
“My prompt is more important/ControlNet is more important” will make lots of inconsistent detail variations to each frame of a Deforum video. You can ignore these two options if you just want to precisely control your shapes. These two options are not designed for video processing.
The above guidelines are tested on many devices by different developers from different projects. Those guidelines should be able to solve 99% problems.
If you still have problems, please try to use ControlNet in your txt2img Tab and see if ControlNet works without Deforum, then follow the below instructions:
In txt2img tab, if ControlNet does not work, then report issue at ControlNet https://github.com/Mikubill/sd-webui-controlnet/issues
In txt2img tab, if ControlNet works without any problem, then report issue at Deforum https://github.com/deforum-art/sd-webui-deforum/issues
Besides, in the future, ControlNet has plan to release official video processing extensions to provide technically correct codes for handling video frame consistency. Stay tuned!