search

lllyasviel / stable-diffusion-webui-forge

GNU Affero General Public License v3.0
6.57k stars 642 forks source link

[Bug]: Controlnet intergrated broken after update #467

Open wardensc2 opened 5 months ago

wardensc2 commented 5 months ago

Checklist

What happened?

All controlnet are not working after update. This is the image generate with controlnet depth:

image

Steps to reproduce the problem

  1. Fresh install Forge
  2. Begin a simple prompt
  3. Use Realistic Vision which Forge automatic download
  4. Using controlnet
  5. Get error log and image does not follow controlnet guidance

What should have happened?

After update some codes link to controlnet are broken or missing maybe

What browsers do you use to access the UI ?

Google Chrome

Sysinfo

sysinfo-2024-03-02-16-55.json

Console logs

Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug  1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: f0.0.9-latest-51-g5bea443d
Commit hash: 5bea443d94f3a85f819cb8541c1bba0aac208d83
Installing clip
Installing open_clip
Installing requirements
Installing forge_legacy_preprocessor requirement: fvcore
Installing forge_legacy_preprocessor requirement: mediapipe
Installing forge_legacy_preprocessor requirement: svglib
Launching Web UI with arguments:
Total VRAM 24575 MB, total RAM 32672 MB
Set vram state to: NORMAL_VRAM
Device: cuda:0 NVIDIA GeForce RTX 3090 : native
VAE dtype: torch.bfloat16
Using pytorch cross attention
Downloading: "https://huggingface.co/lllyasviel/fav_models/resolve/main/fav/realisticVisionV51_v51VAE.safetensors" to C:\AI\Forgetest\webui\models\Stable-diffusion\realisticVisionV51_v51VAE.safetensors

100%|█████████████████████████████████████████████████████████████████████████████| 1.99G/1.99G [01:50<00:00, 19.4MB/s]
ControlNet preprocessor location: C:\AI\Forgetest\webui\models\ControlNetPreprocessor
Calculating sha256 for C:\AI\Forgetest\webui\models\Stable-diffusion\realisticVisionV51_v51VAE.safetensors: 2024-03-02 23:48:09,824 - ControlNet - INFO - ControlNet UI callback registered.
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 157.8s (prepare environment: 38.6s, import torch: 3.4s, import gradio: 0.9s, setup paths: 0.7s, initialize shared: 0.2s, other imports: 0.7s, list SD models: 110.7s, load scripts: 1.8s, create ui: 0.4s, gradio launch: 0.4s).
15012c538f503ce2ebfc2c8547b268c75ccdaff7a281db55399940ff1d70e21d
Loading weights [15012c538f] from C:\AI\Forgetest\webui\models\Stable-diffusion\realisticVisionV51_v51VAE.safetensors
model_type EPS
UNet ADM Dimension 0
Using pytorch attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using pytorch attention in VAE
extra {'cond_stage_model.clip_l.text_projection', 'cond_stage_model.clip_l.logit_scale'}
loaded straight to GPU
To load target model BaseModel
Begin to load 1 model
To load target model SD1ClipModel
Begin to load 1 model
Model loaded in 4.5s (calculate hash: 2.5s, forge load real models: 1.8s, calculate empty prompt: 0.2s).
2024-03-02 23:48:45,581 - ControlNet - INFO - Preview Resolution = 512
Downloading: "https://huggingface.co/lllyasviel/ControlNet/resolve/main/annotator/ckpts/dpt_hybrid-midas-501f0c75.pt" to C:\AI\Forgetest\webui\models\ControlNetPreprocessor\midas\dpt_hybrid-midas-501f0c75.pt

100%|███████████████████████████████████████████████████████████████████████████████| 470M/470M [00:25<00:00, 19.6MB/s]
Automatic Memory Management: 659 Modules in 0.10 seconds.
2024-03-02 23:49:19,441 - ControlNet - INFO - ControlNet Input Mode: InputMode.SIMPLE
2024-03-02 23:49:19,443 - ControlNet - INFO - Using preprocessor: depth_midas
2024-03-02 23:49:19,444 - ControlNet - INFO - preprocessor resolution = 512
Automatic Memory Management: 11 Modules in 0.15 seconds.
*** Error running process: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 798, in process
        script.process(p, *script_args)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 450, in process
        self.process_unit_after_click_generate(p, unit, params, *args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 333, in process_unit_after_click_generate
        assert unit.model != 'None', 'You have not selected any control model!'
    AssertionError: You have not selected any control model!

---
                                  *** Error running process_before_every_sampling: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 830, in process_before_every_sampling
        script.process_before_every_sampling(p, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 457, in process_before_every_sampling
        self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)
    KeyError: 0

---
100%|██████████████████████████████████████████████████████████████████████████████████| 35/35 [00:02<00:00, 12.16it/s]
To load target model AutoencoderKL██▏                                                 | 35/150 [00:02<00:08, 13.21it/s]
Begin to load 1 model
Upscale script freed memory successfully.
Downloading: "https://github.com/cszn/KAIR/releases/download/v1.0/ESRGAN.pth" to C:\AI\Forgetest\webui\models\ESRGAN\ESRGAN_4x.pth

100%|█████████████████████████████████████████████████████████████████████████████| 63.8M/63.8M [00:10<00:00, 6.46MB/s]
tiled upscale: 100%|███████████████████████████████████████████████████████████████████| 15/15 [00:01<00:00,  8.23it/s]
*** Error running process_before_every_sampling: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 830, in process_before_every_sampling
        script.process_before_every_sampling(p, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 457, in process_before_every_sampling
        self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)
    KeyError: 0

---
100%|██████████████████████████████████████████████████████████████████████████████████| 15/15 [00:07<00:00,  1.91it/s]
*** Error running postprocess_batch_list: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 854, in postprocess_batch_list
        script.postprocess_batch_list(p, pp, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 463, in postprocess_batch_list
        self.process_unit_after_every_sampling(p, unit, self.current_params[i], pp, *args, **kwargs)
    KeyError: 0

---
*** Error running process_before_every_sampling: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 830, in process_before_every_sampling
        script.process_before_every_sampling(p, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 457, in process_before_every_sampling
        self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)
    KeyError: 0

---
100%|██████████████████████████████████████████████████████████████████████████████████| 35/35 [00:02<00:00, 13.17it/s]
Upscale script freed memory successfully.████████████████▊                            | 85/150 [00:29<00:05, 12.98it/s]
tiled upscale: 100%|███████████████████████████████████████████████████████████████████| 15/15 [00:01<00:00,  9.08it/s]
*** Error running process_before_every_sampling: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 830, in process_before_every_sampling
        script.process_before_every_sampling(p, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 457, in process_before_every_sampling
        self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)
    KeyError: 0

---
100%|██████████████████████████████████████████████████████████████████████████████████| 15/15 [00:07<00:00,  1.91it/s]
*** Error running postprocess_batch_list: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 854, in postprocess_batch_list
        script.postprocess_batch_list(p, pp, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 463, in postprocess_batch_list
        self.process_unit_after_every_sampling(p, unit, self.current_params[i], pp, *args, **kwargs)
    KeyError: 0

---
*** Error running process_before_every_sampling: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 830, in process_before_every_sampling
        script.process_before_every_sampling(p, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 457, in process_before_every_sampling
        self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)
    KeyError: 0

---
100%|██████████████████████████████████████████████████████████████████████████████████| 35/35 [00:02<00:00, 13.15it/s]
Upscale script freed memory successfully.█████████████████████████████████████▌      | 135/150 [00:42<00:01, 12.92it/s]
tiled upscale: 100%|███████████████████████████████████████████████████████████████████| 15/15 [00:01<00:00,  9.05it/s]
*** Error running process_before_every_sampling: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 830, in process_before_every_sampling
        script.process_before_every_sampling(p, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 457, in process_before_every_sampling
        self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)
    KeyError: 0

---
100%|██████████████████████████████████████████████████████████████████████████████████| 15/15 [00:07<00:00,  1.88it/s]
*** Error running postprocess_batch_list: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 854, in postprocess_batch_list
        script.postprocess_batch_list(p, pp, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 463, in postprocess_batch_list
        self.process_unit_after_every_sampling(p, unit, self.current_params[i], pp, *args, **kwargs)
    KeyError: 0

---
Total progress: 100%|████████████████████████████████████████████████████████████████| 150/150 [00:55<00:00,  2.69it/s]
2024-03-02 23:50:24,545 - ControlNet - INFO - ControlNet Input Mode: InputMode.SIMPLE| 150/150 [00:55<00:00,  1.86it/s]
2024-03-02 23:50:24,547 - ControlNet - INFO - Using preprocessor: depth_midas
2024-03-02 23:50:24,548 - ControlNet - INFO - preprocessor resolution = 512
Automatic Memory Management: 11 Modules in 0.13 seconds.
*** Error running process: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 798, in process
        script.process(p, *script_args)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 450, in process
        self.process_unit_after_click_generate(p, unit, params, *args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 333, in process_unit_after_click_generate
        assert unit.model != 'None', 'You have not selected any control model!'
    AssertionError: You have not selected any control model!

---
                                                                                                                       *** Error running process_before_every_sampling: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 830, in process_before_every_sampling
        script.process_before_every_sampling(p, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 457, in process_before_every_sampling
        self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)
    KeyError: 0

---
100%|██████████████████████████████████████████████████████████████████████████████████| 35/35 [00:02<00:00, 12.77it/s]
Upscale script freed memory successfully.                                             | 35/150 [00:02<00:08, 13.15it/s]
tiled upscale: 100%|███████████████████████████████████████████████████████████████████| 15/15 [00:01<00:00,  8.93it/s]
*** Error running process_before_every_sampling: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 830, in process_before_every_sampling
        script.process_before_every_sampling(p, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 457, in process_before_every_sampling
        self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)
    KeyError: 0

---
100%|██████████████████████████████████████████████████████████████████████████████████| 15/15 [00:07<00:00,  1.88it/s]
*** Error running postprocess_batch_list: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 854, in postprocess_batch_list
        script.postprocess_batch_list(p, pp, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 463, in postprocess_batch_list
        self.process_unit_after_every_sampling(p, unit, self.current_params[i], pp, *args, **kwargs)
    KeyError: 0

---
*** Error running process_before_every_sampling: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 830, in process_before_every_sampling
        script.process_before_every_sampling(p, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 457, in process_before_every_sampling
        self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)
    KeyError: 0

---
100%|██████████████████████████████████████████████████████████████████████████████████| 35/35 [00:02<00:00, 13.15it/s]
Upscale script freed memory successfully.████████████████▊                            | 85/150 [00:16<00:05, 12.95it/s]
tiled upscale: 100%|███████████████████████████████████████████████████████████████████| 15/15 [00:01<00:00,  9.03it/s]
*** Error running process_before_every_sampling: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 830, in process_before_every_sampling
        script.process_before_every_sampling(p, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 457, in process_before_every_sampling
        self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)
    KeyError: 0

---
100%|██████████████████████████████████████████████████████████████████████████████████| 15/15 [00:07<00:00,  1.88it/s]
*** Error running postprocess_batch_list: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 854, in postprocess_batch_list
        script.postprocess_batch_list(p, pp, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 463, in postprocess_batch_list
        self.process_unit_after_every_sampling(p, unit, self.current_params[i], pp, *args, **kwargs)
    KeyError: 0

---
*** Error running process_before_every_sampling: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 830, in process_before_every_sampling
        script.process_before_every_sampling(p, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 457, in process_before_every_sampling
        self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)
    KeyError: 0

---
100%|██████████████████████████████████████████████████████████████████████████████████| 35/35 [00:02<00:00, 13.10it/s]
Upscale script freed memory successfully.█████████████████████████████████████▌      | 135/150 [00:30<00:01, 12.94it/s]
tiled upscale: 100%|███████████████████████████████████████████████████████████████████| 15/15 [00:01<00:00,  9.09it/s]
*** Error running process_before_every_sampling: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 830, in process_before_every_sampling
        script.process_before_every_sampling(p, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 457, in process_before_every_sampling
        self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)
    KeyError: 0

---
100%|██████████████████████████████████████████████████████████████████████████████████| 15/15 [00:08<00:00,  1.86it/s]
*** Error running postprocess_batch_list: C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
    Traceback (most recent call last):
      File "C:\AI\Forgetest\webui\modules\scripts.py", line 854, in postprocess_batch_list
        script.postprocess_batch_list(p, pp, *script_args, **kwargs)
      File "C:\AI\Forgetest\system\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\AI\Forgetest\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 463, in postprocess_batch_list
        self.process_unit_after_every_sampling(p, unit, self.current_params[i], pp, *args, **kwargs)
    KeyError: 0

---
Total progress: 100%|████████████████████████████████████████████████████████████████| 150/150 [00:43<00:00,  3.43it/s]
Total progress: 100%|████████████████████████████████████████████████████████████████| 150/150 [00:43<00:00,  1.94it/s]

Additional information

No response

howtecher commented 5 months ago

same issue

StarComrade commented 5 months ago

Same but moreso for Instant ID, the face embedding does not load or show up in preprocessors.

EDIT: Can confirm ControlNet as a whole does not work for me currently, even using Depth masks yields an error.

aarony1993 commented 5 months ago

Just installed forge for the first time and can confirm controlnet is not working at all

lllyasviel commented 5 months ago

image

wardensc2 commented 5 months ago

image

Here is another examples which controlnet does not work:

image

Please check whether controlnet missing some codes or not, thank you

wardensc2 commented 5 months ago

Hi lllyasviel

I have fixed my problem, it's seem that BMAB extension can't work with Stable Diffusion Forge yet.

(https://github.com/lllyasviel/stable-diffusion-webui-forge)

Install BMAB will disable Controlnet Intergrate from Forge, uninstall BMAB problem solve

Sorry to bother you

StarComrade commented 5 months ago

ControlNet seems to be down in the new 1.8 webui as well right now - disabling and re-enabling the ControlNet integration from Forge did not fix the issue. It is currently not working in both Forge and 1.8 for me on fresh installs.

StarComrade commented 5 months ago

UPDATE: It works in 1.5 models but not XL, on trying to use Depth mask in XL models I get TypeError: 'NoneType' object is not iterable

However Instant-ID does not work at all.

StarComrade commented 5 months ago

It appears as though I jumped the gun a bit - I only just realized after the post that there are separate XL models you need to download, I had not seen the thread for them prior. ControlNet works as intended now.

emotionaldreams commented 5 months ago

same issue. no matter what model i use or setting

sumit91in commented 4 months ago

Hi lllyasviel

I have fixed my problem, it's seem that BMAB extension can't work with Stable Diffusion Forge yet.

(https://github.com/lllyasviel/stable-diffusion-webui-forge)

Install BMAB will disable Controlnet Intergrate from Forge, uninstall BMAB problem solve

Sorry to bother you

@wardensc2

BMAB

@StarComrade Is instant ID working for you? Which models and preprocessor are you selecting?