xinsir6 / ControlNetPlus

ControlNet++: All-in-one ControlNet for image generations and editing!
Apache License 2.0
1.77k stars 43 forks source link

Openpose does not work (generates me a stick figure) #48

Open TiredBeeYYB opened 3 months ago

TiredBeeYYB commented 3 months ago

Browser - Firefox Developer Edition CLIP skip - 2 I also edited draw_bodypose function as suggested here https://github.com/xinsir6/ControlNetPlus/issues/35#issuecomment-2239090473 r1 r2

Crized-bit commented 3 months ago

I think the main reason for that behaviour is that @xinsir6 uses custom infrerence script, different from automatic1111 WebUi. Also had similar result with diffusers libriary at first image But if you use model and pipe provided by author, it works just fine!

TiredBeeYYB commented 3 months ago

I think the main reason for that behaviour is that @xinsir6 uses custom infrerence script, different from automatic1111 WebUi. Also had similar result with diffusers libriary at first image But if you use model and pipe provided by author, it works just fine!

Can you please explain what I need to do? How to use pipe? What I already did:

  1. I executed all the commands from here https://github.com/xinsir6/ControlNetPlus?tab=readme-ov-file#installation
  2. I downloaded diffusion_pytorch_model_promax.safetensors and put it in my "stable-diffusion-webui\extensions\sd-webui-controlnet\models" folder (and renamed it as "controlnet++_union_promax_sdxl")
  3. I replaced draw_bodypose function in stable-diffusion-webui\venv\Lib\site-packages\controlnet_aux\open_pose\util.py as suggested here: https://github.com/xinsir6/ControlNetPlus?tab=readme-ov-file#inference-scripts

still doesn't work T_T

Crized-bit commented 3 months ago

I think the main reason for that behaviour is that @xinsir6 uses custom infrerence script, different from automatic1111 WebUi. Also had similar result with diffusers libriary at first image But if you use model and pipe provided by author, it works just fine!

Can you please explain what I need to do? How to use pipe? What I already did:

  1. I executed all the commands from here https://github.com/xinsir6/ControlNetPlus?tab=readme-ov-file#installation
  2. I downloaded diffusion_pytorch_model_promax.safetensors and put it in my "stable-diffusion-webui\extensions\sd-webui-controlnet\models" folder (and renamed it as "controlnet++_union_promax_sdxl")
  3. I replaced draw_bodypose function in stable-diffusion-webui\venv\Lib\site-packages\controlnet_aux\open_pose\util.py as suggested here: https://github.com/xinsir6/ControlNetPlus?tab=readme-ov-file#inference-scripts

still doesn't work T_T

I think it's not supposed to work in auto1111 WebUi for now, also it's not in current TODO list: image

Maybe there's a custom node for ComfyUI, dunno :(

Fynjy888 commented 3 months ago

@Crized-bit yap, It's called SetUnionControlNetType - it's not custom, it's build in original comfyUI

So it allows you to choose which preprocessor type you are using