search

TheLastBen / fast-stable-diffusion

fast-stable-diffusion + DreamBooth
MIT License
7.52k stars 1.31k forks source link

ControlNet Not Working #1620

Open Josroyal opened 1 year ago

Josroyal commented 1 year ago

Discussed in https://github.com/TheLastBen/fast-stable-diffusion/discussions/1617

Originally posted by **Josroyal** February 21, 2023 I'd heard that there was this thing called "ControlNet", a tool to control into detail poses, depth, etc. I wanted to use it but it doesn't work on the colab. I've already tried everything known: Reinstalling the colab on my gdrive more than 6 times, installing controlnet manually, using the safetensors and ckpt models, played with all the possible parameters, followed multiple online tutorials step by step and nothing works. It seems like the model doesn't detec the image because when i use the brush it detects the outlines of the brush but not the image. (Sorry if my english is not quite good, I'm a spanish speaker). Here are some pictures: ![Screenshot 2023-02-21 144810](https://user-images.githubusercontent.com/64459744/220444846-aae9e5dc-7dd7-4829-aa66-a6991c9201a5.jpg) ![Screenshot 2023-02-21 144822](https://user-images.githubusercontent.com/64459744/220444848-d0141d25-8547-4015-b1f1-e0b413127e08.jpg) ![Screenshot 2023-02-21 144704](https://user-images.githubusercontent.com/64459744/220444850-6bf8c91d-72a9-454c-90cb-b4b0cddf30fa.jpg) ![Screenshot 2023-02-21 144729](https://user-images.githubusercontent.com/64459744/220444852-6b7a9a5b-7a01-4b7b-a09b-50789ecc95ff.jpg)
feesta commented 1 year ago

I had a similar issue. I found this bug for the ControlNet plugin: https://github.com/Mikubill/sd-webui-controlnet/issues/95

I'm using Brave Browser. Disabling fingerprinting for gradio and refreshing fixed it for me.

Taikakim commented 1 year ago

Did you do things as per here: https://www.reddit.com/r/StableDiffusion/comments/119o71b/a1111_controlnet_extension_explained_like_youre_5/

ssam2020 commented 1 year ago

any news on this?, my control net has no effect on the render

feesta commented 1 year ago

It's an issue with the Controlnet extension, not FastStableDiffusion. It's been a few months since I've had this issue but it seems to be that some browsers block canvas use as part of their privacy features because it can be used for fingerprinting. Automatic1111 may use the canvas feature of the browser for processing the controlnet UI. From my experience with Brave and later with Firefox, disabling the protection for the Gradio interface solved the problem.