search

lllyasviel / ControlNet-v1-1-nightly

Nightly release of ControlNet 1.1
4.47k stars 364 forks source link

Is there any plan to support ***comfyUI***? #106

Open icelandno1 opened 10 months ago

icelandno1 commented 10 months ago

Is there any plan to support comfyUI? Currently comfyUI has no way to access pre-processors although it supports the ControlNet-v1-1 model. Although there are projects on github such as comfy_controlnet_preprocessors that allow comfyUI to access the ControlNet preprocessors, but they are incomplete and don't have the control mode option, so they don't work very well. I believe there are very many people who have a need for this, so I hope there is good news.

lllyasviel commented 10 months ago

Hi @icelandno1 yes we considered that, as comfyui is becoming more popular. Our concern is that in our implementations, many preprocessors have non-commercial licenses, like CMU Openpose. We are not sure if this will cause problems if we officially implement it in comfyui, since comfyui seems a commercial project owned by commercial company. Nevertheless we can try to find alternative preprocessor models, like mmpose for replacing openpose (actually this is already on a todo list for main controlnet repo - you can find a bit more info here). And it is also worth taking a look at comfyui extensitons, as it seems to have some extensitons to achieve more advanced purposes.

icelandno1 commented 10 months ago

@lllyasviel Thank you for your reply, still would like to see full official ControlNet support for comfyUI. Good luck!

Andrew7127 commented 9 months ago

Is there any news on this issue?