lllyasviel / stable-diffusion-webui-forge

GNU Affero General Public License v3.0
5.31k stars 521 forks source link

[Bug]: Unable to use extension for enabling using lama cleaner as input mask next to fill,original,latent... #339

Open silveroxides opened 4 months ago

silveroxides commented 4 months ago

Checklist

What happened?

I use the following extension normally both in regular inpainting tab as well as part of the Segment Anything based replacer extension both linked here: sd-webui-replacer and sd-webui-lama-cleaner-masked-content

I use this both because of how effective it is compared to inferior methods such as adetailer and because the cleaner approach works much better. One typical use scenario is to remove something in a generated image using sam_hq_vit_h+GroundingDINO_SwinB to detect and create segment mask, cleaner removes it, model inpaints a high quality interpretation of what would have been behind the object. It can also be used at low denois and no blur as well as with both SDXL models and non-inpaint models.

Here is the console output I got. My install is fresh from less than 24 hours ago.

2024-02-20 14:54:25 INFO [modules.shared_state] Starting job task(y2ujjpvz2m4qvyh)
2024-02-20 14:54:25 INFO [modules.shared_state] Starting job replacer
Start SAM Processing
Using local groundingdino.
Running GroundingDINO Inference
Initializing GroundingDINO GroundingDINO_SwinB (938MB)
final text_encoder_type: bert-base-uncased
Initializing SAM to cuda:0
Running SAM Inference (768, 1024, 3)
SAM inference with 1 box, 0 positive prompts, 0 negative prompts
Creating output image
SAM inference with 1 box, 0 positive prompts, 0 negative prompts done.
Dilation Amount:  35
Dilation Amount:  35
Dilation Amount:  35
MasksCreator cached
*** [Replacer]: Controlnet is not installed for 'Lama Cleaner'
    Traceback (most recent call last):
      File "D:\stable-diffusion-webui-forge\webui\extensions\sd-webui-lama-cleaner-masked-content\lama_cleaner_masked_content\inpaint.py", line 47, in lamaCNInpaint
        from scripts.processor import lama_inpaint
    ModuleNotFoundError: No module named 'scripts.processor'

    During handling of the above exception, another exception occurred:

    Traceback (most recent call last):
      File "D:\stable-diffusion-webui-forge\webui\extensions\sd-webui-replacer\replacer\generate.py", line 53, in inpaint
        image = lamaInpaint(image, mask, gArgs.inpainting_mask_invert, getUpscaler())
      File "D:\stable-diffusion-webui-forge\webui\extensions\sd-webui-lama-cleaner-masked-content\lama_cleaner_masked_content\inpaint.py", line 118, in lamaInpaint
        tmpImage = lamaCNInpaint(tmpImage)
      File "D:\stable-diffusion-webui-forge\webui\extensions\sd-webui-lama-cleaner-masked-content\lama_cleaner_masked_content\inpaint.py", line 51, in lamaCNInpaint
        raise Exception("Controlnet is not installed for 'Lama Cleaner'")
    Exception: Controlnet is not installed for 'Lama Cleaner'

---
To load target model AutoencoderKL
Begin to load 1 model
Moving model(s) has taken 0.13 seconds
To load target model BaseModel
Begin to load 1 model
Moving model(s) has taken 1.11 seconds
100%|████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:00<00:00,  5.29it/s]
2024-02-20 14:54:44 INFO [modules.shared_state] Ending job replacer (18.95 seconds)      | 3/4 [00:00<00:00, 16.87it/s]
2024-02-20 14:54:44 INFO [modules.shared_state] Ending job  (18.95 seconds)

Steps to reproduce the problem

Install above mentioned extensions and their prerequisites and attempt to use the lama cleaner as masked content.

What should have happened?

Used the lama model for the masked content

What browsers do you use to access the UI ?

No response

Sysinfo

sysinfo-2024-02-20-14-13.json

Console logs

Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug  1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: f0.0.14v1.8.0rc-latest-184-g43c9e3b5
Commit hash: 43c9e3b5ce1642073c7a9684e36b45489eeb4a49
Installing requirements
2024-02-20 13:54:02 DEBUG [root] Installing a1111-sd-webui-tagcomplete
2024-02-20 13:54:02 DEBUG [root] Installing adetailer
2024-02-20 13:54:03 DEBUG [root] Installing put extensions here.txt
2024-02-20 13:54:03 DEBUG [root] Installing sd-webui-cads
2024-02-20 13:54:03 DEBUG [root] Installing sd-webui-infinite-image-browsing
2024-02-20 13:54:03 DEBUG [root] Installing sd-webui-inpaint-anything
2024-02-20 13:54:03 DEBUG [root] Installing sd-webui-kohya-hiresfix
2024-02-20 13:54:03 DEBUG [root] Installing sd-webui-lama-cleaner-masked-content
2024-02-20 13:54:03 DEBUG [root] Installing sd-webui-lora-block-weight
2024-02-20 13:54:03 DEBUG [root] Installing sd-webui-neutral-prompt
2024-02-20 13:54:03 DEBUG [root] Installing sd-webui-prevent-artifact
2024-02-20 13:54:03 DEBUG [root] Installing sd-webui-prompt-format
2024-02-20 13:54:03 DEBUG [root] Installing sd-webui-replacer
2024-02-20 13:54:03 DEBUG [root] Installing sd-webui-segment-anything
2024-02-20 13:54:04 DEBUG [root] Installing sd-webui-supermerger
2024-02-20 13:54:04 DEBUG [root] Installing sd-webui-untitledmerger
2024-02-20 13:54:04 DEBUG [root] Installing uddetailer
Check mmcv version...
Your mmcv version 2.1.0 may not work with mmyolo.
or you need to fix version restriction of __init__.py of mmyolo manually, to use mmcv 2.1.0 with mmyolo.
Check mmengine version...
your mmengine version is 0.8.5
2024-02-20 13:54:04 DEBUG [root] Installing canvas-zoom-and-pan
2024-02-20 13:54:04 DEBUG [root] Installing extra-options-section
2024-02-20 13:54:04 DEBUG [root] Installing forge_legacy_preprocessors
2024-02-20 13:54:04 DEBUG [root] Installing forge_preprocessor_inpaint
2024-02-20 13:54:04 DEBUG [root] Installing forge_preprocessor_marigold
2024-02-20 13:54:04 DEBUG [root] Installing forge_preprocessor_normalbae
2024-02-20 13:54:04 DEBUG [root] Installing forge_preprocessor_recolor
2024-02-20 13:54:04 DEBUG [root] Installing forge_preprocessor_reference
2024-02-20 13:54:04 DEBUG [root] Installing forge_preprocessor_revision
2024-02-20 13:54:04 DEBUG [root] Installing forge_preprocessor_tile
2024-02-20 13:54:04 DEBUG [root] Installing LDSR
2024-02-20 13:54:04 DEBUG [root] Installing Lora
2024-02-20 13:54:04 DEBUG [root] Installing mobile
2024-02-20 13:54:04 DEBUG [root] Installing prompt-bracket-checker
2024-02-20 13:54:04 DEBUG [root] Installing ScuNET
2024-02-20 13:54:04 DEBUG [root] Installing sd_forge_controlllite
2024-02-20 13:54:04 DEBUG [root] Installing sd_forge_controlnet
2024-02-20 13:54:05 DEBUG [root] Installing sd_forge_controlnet_example
2024-02-20 13:54:05 DEBUG [root] Installing sd_forge_dynamic_thresholding
2024-02-20 13:54:05 DEBUG [root] Installing sd_forge_fooocus_inpaint
2024-02-20 13:54:05 DEBUG [root] Installing sd_forge_freeu
2024-02-20 13:54:05 DEBUG [root] Installing sd_forge_hypertile
2024-02-20 13:54:05 DEBUG [root] Installing sd_forge_ipadapter
2024-02-20 13:54:05 DEBUG [root] Installing sd_forge_kohya_hrfix
2024-02-20 13:54:05 DEBUG [root] Installing sd_forge_latent_modifier
2024-02-20 13:54:05 DEBUG [root] Installing sd_forge_multidiffusion
2024-02-20 13:54:05 DEBUG [root] Installing sd_forge_photomaker
2024-02-20 13:54:05 DEBUG [root] Installing sd_forge_sag
2024-02-20 13:54:05 DEBUG [root] Installing sd_forge_stylealign
2024-02-20 13:54:05 DEBUG [root] Installing sd_forge_svd
2024-02-20 13:54:05 DEBUG [root] Installing sd_forge_z123
2024-02-20 13:54:05 DEBUG [root] Installing soft-inpainting
2024-02-20 13:54:05 DEBUG [root] Installing SwinIR
Launching Web UI with arguments: --forge-ref-a1111-home D:\stable-diffusion-webui\webui --loglevel DEBUG --ckpt-dir D:\stable-diffusion-webui\webui\models\Stable-diffusion --vae-dir D:\stable-diffusion-webui\webui\models\VAE --hypernetwork-dir D:\stable-diffusion-webui\webui\models\hypernetworks --embeddings-dir D:\stable-diffusion-webui\webui\embeddings --lora-dir D:\stable-diffusion-webui\webui\models\lora --controlnet-dir D:\stable-diffusion-webui\webui\models\ControlNet --controlnet-preprocessor-models-dir D:\stable-diffusion-webui\webui\extensions\sd-webui-controlnet\annotator\downloads
Total VRAM 16380 MB, total RAM 32716 MB
Set vram state to: NORMAL_VRAM
Device: cuda:0 NVIDIA GeForce RTX 4060 Ti : native
VAE dtype: torch.bfloat16
2024-02-20 13:54:09 DEBUG [matplotlib] matplotlib data path: C:\Users\ishim\AppData\Roaming\Python\Python310\site-packages\matplotlib\mpl-data
2024-02-20 13:54:09 DEBUG [matplotlib] CONFIGDIR=C:\Users\ishim\.matplotlib
2024-02-20 13:54:09 DEBUG [matplotlib] interactive is False
2024-02-20 13:54:09 DEBUG [matplotlib] platform is win32
2024-02-20 13:54:09 DEBUG [matplotlib] CACHEDIR=C:\Users\ishim\.matplotlib
2024-02-20 13:54:09 DEBUG [matplotlib.font_manager] Using fontManager instance from C:\Users\ishim\.matplotlib\fontlist-v330.json
2024-02-20 13:54:11 DEBUG [httpx] load_ssl_context verify=True cert=None trust_env=True http2=False
2024-02-20 13:54:11 DEBUG [httpx] load_verify_locations cafile='D:\\stable-diffusion-webui-forge\\system\\python\\lib\\site-packages\\certifi\\cacert.pem'
2024-02-20 13:54:11 DEBUG [httpx] load_ssl_context verify=True cert=None trust_env=True http2=False
2024-02-20 13:54:11 DEBUG [httpx] load_verify_locations cafile='D:\\stable-diffusion-webui-forge\\system\\python\\lib\\site-packages\\certifi\\cacert.pem'
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing BlpImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing BmpImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing BufrStubImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing CurImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing DcxImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing DdsImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing EpsImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing FitsImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing FitsStubImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing FliImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing FpxImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Image: failed to import FpxImagePlugin: No module named 'olefile'
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing FtexImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing GbrImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing GifImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing GribStubImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing Hdf5StubImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing IcnsImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing IcoImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing ImImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing ImtImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing IptcImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing JpegImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing Jpeg2KImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing McIdasImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing MicImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Image: failed to import MicImagePlugin: No module named 'olefile'
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing MpegImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing MpoImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing MspImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing PalmImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing PcdImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing PcxImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing PdfImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing PixarImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing PngImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing PpmImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing PsdImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing QoiImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing SgiImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing SpiderImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing SunImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing TgaImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing TiffImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing WebPImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing WmfImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing XbmImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing XpmImagePlugin
2024-02-20 13:54:11 DEBUG [PIL.Image] Importing XVThumbImagePlugin
2024-02-20 13:54:15 DEBUG [git.cmd] Popen(['git', 'version'], cwd=D:\stable-diffusion-webui-forge\webui, universal_newlines=False, shell=None, istream=None)
2024-02-20 13:54:15 DEBUG [git.cmd] Popen(['git', 'version'], cwd=D:\stable-diffusion-webui-forge\webui, universal_newlines=False, shell=None, istream=None)
Using pytorch cross attention
*** Extension "sd-webui-lama-cleaner-masked-content" requires "sd-webui-controlnet" which is not installed.
ControlNet preprocessor location: D:\stable-diffusion-webui\webui\extensions\sd-webui-controlnet\annotator\downloads
Tag Autocomplete: Could not locate model-keyword extension, Lora trigger word completion will be limited to those added through the extra networks menu.
2024-02-20 13:54:24 DEBUG [urllib3.connectionpool] Starting new HTTPS connection (1): huggingface.co:443
2024-02-20 13:54:24 DEBUG [urllib3.connectionpool] https://huggingface.co:443 "HEAD /Bingsu/adetailer/resolve/main/face_yolov8n.pt HTTP/1.1" 302 0
2024-02-20 13:54:25 DEBUG [urllib3.connectionpool] https://huggingface.co:443 "HEAD /Bingsu/adetailer/resolve/main/face_yolov8s.pt HTTP/1.1" 302 0
2024-02-20 13:54:25 DEBUG [urllib3.connectionpool] https://huggingface.co:443 "HEAD /Bingsu/adetailer/resolve/main/hand_yolov8n.pt HTTP/1.1" 302 0
2024-02-20 13:54:25 DEBUG [urllib3.connectionpool] https://huggingface.co:443 "HEAD /Bingsu/adetailer/resolve/main/person_yolov8n-seg.pt HTTP/1.1" 302 0
2024-02-20 13:54:25 DEBUG [urllib3.connectionpool] https://huggingface.co:443 "HEAD /Bingsu/adetailer/resolve/main/person_yolov8s-seg.pt HTTP/1.1" 302 0
[-] ADetailer initialized. version: 24.1.2, num models: 9
2024-02-20 13:54:28 DEBUG [git.cmd] Popen(['git', 'cat-file', '--batch-check'], cwd=D:\stable-diffusion-webui-forge\webui\extensions\sd-webui-replacer, universal_newlines=False, shell=None, istream=<valid stream>)
Loading weights [13bdadfaf6] from D:\stable-diffusion-webui\webui\models\Stable-diffusion\experience_realisticV3-lcm-fp16.inpainting.safetensors
model_type EPS
UNet ADM Dimension 0
ERROR - failed to import mmyolo - MMCV==2.1.0 is used but incompatible. Please install mmcv>=2.0.0rc4, <2.1.0.
Using pytorch attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using pytorch attention in VAE
 Total 4 mmdet, 0 yolo and 3 mediapipe models.
SUCCESS - success to load config for D:\stable-diffusion-webui-forge\webui\models\mmdet\segm\yolov5_ins_n.pth!
 You can enable model validity tester in the Settings-> μ DDetailer.
SUCCESS - success to load config for D:\stable-diffusion-webui-forge\webui\models\mmdet\segm\yolov5_ins_s.pth!
SUCCESS - success to load config for D:\stable-diffusion-webui-forge\webui\models\mmdet\segm\mmdet_dd-person_mask2former.pth!
SUCCESS - success to load config for D:\stable-diffusion-webui-forge\webui\models\mmdet\bbox\mmdet_anime-face_yolov3.pth!
 Total 4 valid mmdet configs are found.
 You can disable validity tester in the Settings-> μ DDetailer.
Check config files...
Done
loading.. cn_modole
 - default µ DDetailer model= bbox/mmdet_anime-face_yolov3.pth [38208bb6]
 - default µ DDetailer model= bbox/mmdet_anime-face_yolov3.pth [38208bb6]
2024-02-20 13:54:35,975 - ControlNet - INFO - ControlNet UI callback registered.
2024-02-20 13:54:36 DEBUG [asyncio] Using selector: SelectSelector
2024-02-20 13:54:37 DEBUG [asyncio] Using selector: SelectSelector
2024-02-20 13:54:37 DEBUG [httpx] load_ssl_context verify=None cert=None trust_env=True http2=False
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
extra {'cond_stage_model.clip_l.text_projection', 'cond_stage_model.clip_l.logit_scale'}
left over keys: dict_keys(['alphas_cumprod', 'alphas_cumprod_prev', 'betas', 'log_one_minus_alphas_cumprod', 'model_ema.decay', 'model_ema.num_updates', 'posterior_log_variance_clipped', 'posterior_mean_coef1', 'posterior_mean_coef2', 'posterior_variance', 'sqrt_alphas_cumprod', 'sqrt_one_minus_alphas_cumprod', 'sqrt_recip_alphas_cumprod', 'sqrt_recipm1_alphas_cumprod'])
Startup time: 66.2s (prepare environment: 33.6s, import torch: 5.9s, import gradio: 2.2s, setup paths: 2.3s, initialize shared: 0.2s, other imports: 1.7s, list SD models: 1.7s, load scripts: 12.3s, scripts before_ui_callback: 3.7s, create ui: 1.6s, gradio launch: 0.5s, app_started_callback: 0.5s).
Calculating sha256 for D:\stable-diffusion-webui\webui\embeddings\embedding_merge\e621_style-neg.safetensors: a0483ad97b516f2a631274675ac10ecee1e5ad12028da062d834b46b4f0cfda5
To load target model SD1ClipModel
Begin to load 1 model
Moving model(s) has taken 0.13 seconds
Model loaded in 14.3s (load weights from disk: 0.1s, forge load real models: 5.5s, load VAE: 0.3s, load textual inversion embeddings: 4.4s, calculate empty prompt: 3.9s).
2024-02-20 13:54:51 DEBUG [matplotlib.pyplot] Loaded backend agg version v2.2.
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\uvicorn\protocols\websockets\websockets_impl.py", line 255, in run_asgi
    result = await self.app(self.scope, self.asgi_receive, self.asgi_send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\uvicorn\middleware\proxy_headers.py", line 84, in __call__
    return await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\applications.py", line 273, in __call__
    await super().__call__(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\applications.py", line 122, in __call__
    await self.middleware_stack(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\errors.py", line 149, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\cors.py", line 76, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\gzip.py", line 26, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\exceptions.py", line 79, in __call__
    raise exc
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\exceptions.py", line 68, in __call__
    await self.app(scope, receive, sender)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\middleware\asyncexitstack.py", line 21, in __call__
    raise e
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\middleware\asyncexitstack.py", line 18, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\routing.py", line 718, in __call__
    await route.handle(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\routing.py", line 341, in handle
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\routing.py", line 82, in app
    await func(session)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\routing.py", line 289, in app
    await dependant.call(**values)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\gradio\routes.py", line 604, in join_queue
    session_info = await asyncio.wait_for(
  File "asyncio\tasks.py", line 445, in wait_for
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\websockets.py", line 133, in receive_json
    self._raise_on_disconnect(message)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\websockets.py", line 105, in _raise_on_disconnect
    raise WebSocketDisconnect(message["code"])
starlette.websockets.WebSocketDisconnect: 1001
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\uvicorn\protocols\websockets\websockets_impl.py", line 255, in run_asgi
    result = await self.app(self.scope, self.asgi_receive, self.asgi_send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\uvicorn\middleware\proxy_headers.py", line 84, in __call__
    return await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\applications.py", line 273, in __call__
    await super().__call__(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\applications.py", line 122, in __call__
    await self.middleware_stack(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\errors.py", line 149, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\cors.py", line 76, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\gzip.py", line 26, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\exceptions.py", line 79, in __call__
    raise exc
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\exceptions.py", line 68, in __call__
    await self.app(scope, receive, sender)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\middleware\asyncexitstack.py", line 21, in __call__
    raise e
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\middleware\asyncexitstack.py", line 18, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\routing.py", line 718, in __call__
    await route.handle(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\routing.py", line 341, in handle
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\routing.py", line 82, in app
    await func(session)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\routing.py", line 289, in app
    await dependant.call(**values)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\gradio\routes.py", line 604, in join_queue
    session_info = await asyncio.wait_for(
  File "asyncio\tasks.py", line 445, in wait_for
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\websockets.py", line 133, in receive_json
    self._raise_on_disconnect(message)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\websockets.py", line 105, in _raise_on_disconnect
    raise WebSocketDisconnect(message["code"])
starlette.websockets.WebSocketDisconnect: 1001
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\uvicorn\protocols\websockets\websockets_impl.py", line 255, in run_asgi
    result = await self.app(self.scope, self.asgi_receive, self.asgi_send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\uvicorn\middleware\proxy_headers.py", line 84, in __call__
    return await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\applications.py", line 273, in __call__
    await super().__call__(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\applications.py", line 122, in __call__
    await self.middleware_stack(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\errors.py", line 149, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\cors.py", line 76, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\gzip.py", line 26, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\exceptions.py", line 79, in __call__
    raise exc
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\exceptions.py", line 68, in __call__
    await self.app(scope, receive, sender)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\middleware\asyncexitstack.py", line 21, in __call__
    raise e
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\middleware\asyncexitstack.py", line 18, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\routing.py", line 718, in __call__
    await route.handle(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\routing.py", line 341, in handle
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\routing.py", line 82, in app
    await func(session)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\routing.py", line 289, in app
    await dependant.call(**values)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\gradio\routes.py", line 604, in join_queue
    session_info = await asyncio.wait_for(
  File "asyncio\tasks.py", line 445, in wait_for
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\websockets.py", line 133, in receive_json
    self._raise_on_disconnect(message)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\websockets.py", line 105, in _raise_on_disconnect
    raise WebSocketDisconnect(message["code"])
starlette.websockets.WebSocketDisconnect: 1001
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\uvicorn\protocols\websockets\websockets_impl.py", line 255, in run_asgi
    result = await self.app(self.scope, self.asgi_receive, self.asgi_send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\uvicorn\middleware\proxy_headers.py", line 84, in __call__
    return await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\applications.py", line 273, in __call__
    await super().__call__(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\applications.py", line 122, in __call__
    await self.middleware_stack(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\errors.py", line 149, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\cors.py", line 76, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\gzip.py", line 26, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\exceptions.py", line 79, in __call__
    raise exc
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\exceptions.py", line 68, in __call__
    await self.app(scope, receive, sender)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\middleware\asyncexitstack.py", line 21, in __call__
    raise e
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\middleware\asyncexitstack.py", line 18, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\routing.py", line 718, in __call__
    await route.handle(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\routing.py", line 341, in handle
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\routing.py", line 82, in app
    await func(session)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\routing.py", line 289, in app
    await dependant.call(**values)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\gradio\routes.py", line 604, in join_queue
    session_info = await asyncio.wait_for(
  File "asyncio\tasks.py", line 445, in wait_for
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\websockets.py", line 133, in receive_json
    self._raise_on_disconnect(message)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\websockets.py", line 105, in _raise_on_disconnect
    raise WebSocketDisconnect(message["code"])
starlette.websockets.WebSocketDisconnect: 1001
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\uvicorn\protocols\websockets\websockets_impl.py", line 255, in run_asgi
    result = await self.app(self.scope, self.asgi_receive, self.asgi_send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\uvicorn\middleware\proxy_headers.py", line 84, in __call__
    return await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\applications.py", line 273, in __call__
    await super().__call__(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\applications.py", line 122, in __call__
    await self.middleware_stack(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\errors.py", line 149, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\cors.py", line 76, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\gzip.py", line 26, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\exceptions.py", line 79, in __call__
    raise exc
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\middleware\exceptions.py", line 68, in __call__
    await self.app(scope, receive, sender)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\middleware\asyncexitstack.py", line 21, in __call__
    raise e
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\middleware\asyncexitstack.py", line 18, in __call__
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\routing.py", line 718, in __call__
    await route.handle(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\routing.py", line 341, in handle
    await self.app(scope, receive, send)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\routing.py", line 82, in app
    await func(session)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\fastapi\routing.py", line 289, in app
    await dependant.call(**values)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\gradio\routes.py", line 604, in join_queue
    session_info = await asyncio.wait_for(
  File "asyncio\tasks.py", line 445, in wait_for
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\websockets.py", line 133, in receive_json
    self._raise_on_disconnect(message)
  File "D:\stable-diffusion-webui-forge\system\python\lib\site-packages\starlette\websockets.py", line 105, in _raise_on_disconnect
    raise WebSocketDisconnect(message["code"])
starlette.websockets.WebSocketDisconnect: 1001
2024-02-20 14:51:27 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
2024-02-20 14:51:27 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
2024-02-20 14:51:27 DEBUG [git.cmd] Popen(['git', 'remote', 'get-url', '--all', 'origin'], cwd=D:\stable-diffusion-webui-forge\webui, universal_newlines=False, shell=None, istream=None)
2024-02-20 14:51:27 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
2024-02-20 14:51:27 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
2024-02-20 14:51:27 DEBUG [git.cmd] Popen(['git', 'cat-file', '--batch-check'], cwd=D:\stable-diffusion-webui-forge\webui, universal_newlines=False, shell=None, istream=<valid stream>)
2024-02-20 14:51:27 DEBUG [git.cmd] Popen(['git', 'cat-file', '--batch'], cwd=D:\stable-diffusion-webui-forge\webui, universal_newlines=False, shell=None, istream=<valid stream>)
2024-02-20 14:51:27 DEBUG [git.cmd] Popen(['git', 'remote', 'get-url', '--all', 'origin'], cwd=D:\stable-diffusion-webui-forge\webui, universal_newlines=False, shell=None, istream=None)
2024-02-20 14:51:27 DEBUG [git.cmd] Popen(['git', 'cat-file', '--batch-check'], cwd=D:\stable-diffusion-webui-forge\webui, universal_newlines=False, shell=None, istream=<valid stream>)
2024-02-20 14:51:27 DEBUG [git.cmd] Popen(['git', 'cat-file', '--batch'], cwd=D:\stable-diffusion-webui-forge\webui, universal_newlines=False, shell=None, istream=<valid stream>)
2024-02-20 14:51:27 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
2024-02-20 14:51:27 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
2024-02-20 14:51:56 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
2024-02-20 14:51:56 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
2024-02-20 14:52:10 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
2024-02-20 14:52:10 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
2024-02-20 14:52:11 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
2024-02-20 14:52:12 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
2024-02-20 14:54:25 INFO [modules.shared_state] Starting job task(y2ujjpvz2m4qvyh)
2024-02-20 14:54:25 INFO [modules.shared_state] Starting job replacer
Start SAM Processing
Using local groundingdino.
Running GroundingDINO Inference
Initializing GroundingDINO GroundingDINO_SwinB (938MB)
final text_encoder_type: bert-base-uncased
Initializing SAM to cuda:0
Running SAM Inference (768, 1024, 3)
SAM inference with 1 box, 0 positive prompts, 0 negative prompts
Creating output image
SAM inference with 1 box, 0 positive prompts, 0 negative prompts done.
Dilation Amount:  35
Dilation Amount:  35
Dilation Amount:  35
MasksCreator cached
*** [Replacer]: Controlnet is not installed for 'Lama Cleaner'
    Traceback (most recent call last):
      File "D:\stable-diffusion-webui-forge\webui\extensions\sd-webui-lama-cleaner-masked-content\lama_cleaner_masked_content\inpaint.py", line 47, in lamaCNInpaint
        from scripts.processor import lama_inpaint
    ModuleNotFoundError: No module named 'scripts.processor'

    During handling of the above exception, another exception occurred:

    Traceback (most recent call last):
      File "D:\stable-diffusion-webui-forge\webui\extensions\sd-webui-replacer\replacer\generate.py", line 53, in inpaint
        image = lamaInpaint(image, mask, gArgs.inpainting_mask_invert, getUpscaler())
      File "D:\stable-diffusion-webui-forge\webui\extensions\sd-webui-lama-cleaner-masked-content\lama_cleaner_masked_content\inpaint.py", line 118, in lamaInpaint
        tmpImage = lamaCNInpaint(tmpImage)
      File "D:\stable-diffusion-webui-forge\webui\extensions\sd-webui-lama-cleaner-masked-content\lama_cleaner_masked_content\inpaint.py", line 51, in lamaCNInpaint
        raise Exception("Controlnet is not installed for 'Lama Cleaner'")
    Exception: Controlnet is not installed for 'Lama Cleaner'

---
To load target model AutoencoderKL
Begin to load 1 model
Moving model(s) has taken 0.13 seconds
To load target model BaseModel
Begin to load 1 model
Moving model(s) has taken 1.11 seconds
100%|████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:00<00:00,  5.29it/s]
2024-02-20 14:54:44 INFO [modules.shared_state] Ending job replacer (18.95 seconds)      | 3/4 [00:00<00:00, 16.87it/s]
2024-02-20 14:54:44 INFO [modules.shared_state] Ending job  (18.95 seconds)
2024-02-20 14:54:44 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
2024-02-20 14:54:44 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
2024-02-20 14:55:18 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
2024-02-20 14:55:19 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"
2024-02-20 14:55:19 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/api/predict "HTTP/1.1 200 OK"
2024-02-20 14:55:19 INFO [httpx] HTTP Request: POST http://127.0.0.1:7860/reset "HTTP/1.1 200 OK"

Total progress: 100%|████████████████████████████████████████████████████████████████████| 4/4 [00:36<00:00, 16.87it/s]

Additional information

No response

ExissNA commented 1 month ago

A little late to the party, but mine functioned flawlessly until something updated. Now, controlnet disables itself at start and turning it on via the extensions tab will turn itself back off after. Seems to be a common issue. I'm searching for workarounds for now, lama cleaner is a massive tool I use and A1111 is out of the question unless I feel like sticking to SD1.5 only. (99% of all my stuff is XL).