search

omniinfer / sd-webui-cloud-inference

Stable Diffusion（SDXL/Refiner）WebUI Cloud Inference Extension
200 stars 17 forks source link

Controlnet not working #47

Open ChrisFab16 opened 8 months ago

ChrisFab16 commented 8 months ago

Versions: ControlNet v1.1.422 Webui: version: v1.6.1  •  python: 3.10.11  •  torch: 2.0.1+cu117  •  xformers: 0.0.20  •  gradio: 3.41.2  •  checkpoint: 96e98913b1

Steps to reproduce: place openpose picture in controlnet image box. Select control_v11p_sd15_openpose from dropdown. Enter prompt "man standing" hit "generate"

Expected result: Pose from openpose template applied to picture

In stead, it provides a picture with a random pose

AnyISalIn commented 8 months ago

Have you enable controlnet ? could you provides controlnet extension version ?

ChrisFab16 commented 8 months ago

Yes it is enabled. ControlNet v1.1.422

If I render locally I get the result image and the pose image in the output.

When I try using the cloud generation it seems there is no controlnet info

ChrisFab16 commented 8 months ago

it looks like something may be going wrong with the loading of the Controlnet models. The controlnet model dropdown in my local interface does not match the example list in the screenshot from the README: image

ChrisFab16 commented 8 months ago

solved - removed controlnet models from models/ControlNet folder and it loaded the models from the api correctly. Keeping bug open as it's probably worth fixing.

Tyrnan commented 8 months ago

I am experiencing the same issue here. When I read the latest post of ChrisFab16 I removed all models from the models/ControlNet folder but still the web-ui refuses to show any models from the cloud it just shows "none". After removing I tried disabling and then then re-enabling the ControlNet extension as well as the cloud-inference extension but to no avail. I'm using ControlNet version 1.1.424 (this commit https://github.com/Mikubill/sd-webui-controlnet/commit/50ddf1da960ad4ca7800d65cdde4553e746bcbf7) and version 0.1.9 of cloud-inference. Any ideas?

KLA6 commented 7 months ago

I'm using ControlNet v1.1.427, and my situation is the same with Tyrnan.

AnyISalIn commented 7 months ago

Thanks for feedback, we will be fixed in next version. @KLA6 @Tyrnan @ChrisFab16

AnyISalIn commented 7 months ago

we cannot reproduce in our test environment, could you provides config.json and command line arguments help us to solve the problems. thanks. @KLA6

KLA6 commented 7 months ago

image This is a screen shot to show the problem. It's using Cloud Inference and ControlNet Canny, but the result doesn't include a Canny shot.

BTW, what do you mean config.json, where can I capture it?

AnyISalIn commented 7 months ago

image This is a screen shot to show the problem. It's using Cloud Inference and ControlNet Canny, but the result doesn't include a Canny shot.

BTW, what do you mean config.json, where can I capture it?

could you share screenshot of installed extensions ?

image
KLA6 commented 7 months ago

image Here, it is.

AnyISalIn commented 7 months ago

@KLA6 Hello, I have been updated in dev branch, could you upgrade to this version and try again ?

KLA6 commented 7 months ago

I've downloaded https://github.com/omniinfer/sd-webui-cloud-inference/tree/dev as a zip file to replace all files of Cloud Inference.

image

However, the result is still the same which is not showing any Canny related shot.

image