AUTOMATIC1111 / stable-diffusion-webui

Stable Diffusion web UI
GNU Affero General Public License v3.0
143.9k stars 27.06k forks source link

RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument weight in method wrapper_CUDA___slow_conv2d_forward)[Bug]: #15613

Open corvo4791 opened 7 months ago

corvo4791 commented 7 months ago

Checklist

What happened?

In txt2img with Refiner, AnimateDiff and ControlNet it gives this error:

RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument weight in method wrapper_CUDA___slow_conv2d_forward)

In other discussions somebody suggested to disable "Refiner" and if I do it the error disappears but I need the "Refiner" tool to be active.

I tried to add "--opt-sdp-attention" to set "COMMANDLINE_ARGS=" in "webui-user.bat" but nothing changed

I also added "set CUDA_VISIBLE_DEVICES=0" in "webui-user.bat" but still nothing changed

I've 12GB VRAM and when I get this error just 10GB of VRAM is used. So, because A1111 always uses VRAM by default, the GPU manages all the models and the CPU manages nothing. I really can't understand why I get this error if everything is in the VRAM?

Steps to reproduce the problem

  1. Launch A1111
  2. Go in txt2img
  3. Try to make a video2video using AnimateDiff, ControlNet and Refiner active

What should have happened?

It should give me an animation without any errors

What browsers do you use to access the UI ?

Google Chrome

Sysinfo

sysinfo-2024-04-23-21-07.json

Console logs

venv "C:\code\SD\venv\Scripts\Python.exe"
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug  1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: v1.9.3
Commit hash: 1c0a0c4c26f78c32095ebc7f8af82f5c04fca8c0
Installing requirements
CUDA 12.1
Requirement already satisfied: insightface==0.7.3 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from -r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (0.7.3)
Requirement already satisfied: onnx==1.14.0 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from -r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 2)) (1.14.0)
Requirement already satisfied: onnxruntime==1.15.0 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from -r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 3)) (1.15.0)
Requirement already satisfied: opencv-python==4.7.0.72 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from -r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 4)) (4.7.0.72)
Requirement already satisfied: ifnude in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from -r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 5)) (0.0.3)
Requirement already satisfied: cython in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from -r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 6)) (3.0.2)
Requirement already satisfied: numpy in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (1.24.3)
Requirement already satisfied: tqdm in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (4.65.0)
Requirement already satisfied: requests in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (2.31.0)
Requirement already satisfied: matplotlib in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (3.7.2)
Requirement already satisfied: Pillow in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (10.2.0)
Requirement already satisfied: scipy in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (1.11.1)
Requirement already satisfied: scikit-learn in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (1.3.0)
Requirement already satisfied: scikit-image in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (0.20.0)
Requirement already satisfied: easydict in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (1.10)
Requirement already satisfied: albumentations in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (1.3.1)
Requirement already satisfied: prettytable in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (3.9.0)
Requirement already satisfied: protobuf>=3.20.2 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from onnx==1.14.0->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 2)) (3.20.3)
Requirement already satisfied: typing-extensions>=3.6.2.1 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from onnx==1.14.0->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 2)) (4.8.0)
Requirement already satisfied: coloredlogs in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from onnxruntime==1.15.0->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 3)) (15.0.1)
Requirement already satisfied: flatbuffers in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from onnxruntime==1.15.0->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 3)) (23.5.26)
Requirement already satisfied: packaging in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from onnxruntime==1.15.0->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 3)) (23.1)
Requirement already satisfied: sympy in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from onnxruntime==1.15.0->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 3)) (1.12)
Requirement already satisfied: opencv-python-headless>=4.5.1.48 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from ifnude->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 5)) (4.8.0.76)
Requirement already satisfied: PyYAML in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from albumentations->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (6.0.1)
Requirement already satisfied: qudida>=0.0.4 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from albumentations->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (0.0.4)
Requirement already satisfied: networkx>=2.8 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from scikit-image->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (3.2.1)
Requirement already satisfied: imageio>=2.4.1 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from scikit-image->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (2.9.0)
Requirement already satisfied: tifffile>=2019.7.26 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from scikit-image->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (2023.8.12)
Requirement already satisfied: PyWavelets>=1.1.1 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from scikit-image->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (1.4.1)
Requirement already satisfied: lazy_loader>=0.1 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from scikit-image->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (0.3)
Requirement already satisfied: humanfriendly>=9.1 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from coloredlogs->onnxruntime==1.15.0->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 3)) (10.0)
Requirement already satisfied: contourpy>=1.0.1 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from matplotlib->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (1.1.0)
Requirement already satisfied: cycler>=0.10 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from matplotlib->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (0.11.0)
Requirement already satisfied: fonttools>=4.22.0 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from matplotlib->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (4.42.1)
Requirement already satisfied: kiwisolver>=1.0.1 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from matplotlib->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (1.4.5)
Requirement already satisfied: pyparsing<3.1,>=2.3.1 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from matplotlib->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (3.0.9)
Requirement already satisfied: python-dateutil>=2.7 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from matplotlib->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (2.8.2)
Requirement already satisfied: wcwidth in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from prettytable->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (0.2.6)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from requests->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (3.2.0)
Requirement already satisfied: idna<4,>=2.5 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from requests->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from requests->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (1.26.16)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from requests->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (2023.7.22)
Requirement already satisfied: joblib>=1.1.1 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from scikit-learn->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (1.3.2)
Requirement already satisfied: threadpoolctl>=2.0.0 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from scikit-learn->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (3.2.0)
Requirement already satisfied: mpmath>=0.19 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from sympy->onnxruntime==1.15.0->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 3)) (1.3.0)
Requirement already satisfied: colorama in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from tqdm->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (0.4.6)
Requirement already satisfied: pyreadline3 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from humanfriendly>=9.1->coloredlogs->onnxruntime==1.15.0->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 3)) (3.4.1)
Requirement already satisfied: six>=1.5 in c:\users\aldo\appdata\local\programs\python\python310\lib\site-packages (from python-dateutil>=2.7->matplotlib->insightface==0.7.3->-r C:\code\SD\extensions\sd-webui-roop\requirements.txt (line 1)) (1.16.0)
If submitting an issue on github, please provide the full startup log for debugging purposes.

Initializing Dreambooth
Dreambooth revision: 45a12fe5950bf93205b6ef2b7511eb94052a241f
Checking xformers...
Xformers is outdated, and automatic installation has been removed. Please install manually if desired.
Checking bitsandbytes...
Checking bitsandbytes (ALL!)
Checking Dreambooth requirements...
Installed version of bitsandbytes: 0.43.0
[Dreambooth] bitsandbytes v0.43.0 is already installed.
Installed version of accelerate: 0.21.0
[Dreambooth] accelerate v0.21.0 is already installed.
Installed version of dadaptation: 3.2
[Dreambooth] dadaptation v3.2 is already installed.
Installed version of diffusers: 0.26.3
[Dreambooth] diffusers v0.25.0 is already installed.
Installed version of discord-webhook: 1.3.0
[Dreambooth] discord-webhook v1.3.0 is already installed.
Installed version of fastapi: 0.94.0
[Dreambooth] fastapi is already installed.
Installed version of gitpython: 3.1.32
[Dreambooth] gitpython v3.1.40 is not installed.
Successfully installed gitpython-3.1.43

Installed version of pytorch_optimizer: 2.12.0
[Dreambooth] pytorch_optimizer v2.12.0 is already installed.
Installed version of Pillow: 9.5.0
[Dreambooth] Pillow is already installed.
Installed version of tqdm: 4.66.2
[Dreambooth] tqdm is already installed.
Installed version of tomesd: 0.1.3
[Dreambooth] tomesd v0.1.2 is already installed.
Installed version of tensorboard: 2.13.0
[Dreambooth] tensorboard v2.13.0 is already installed.
[+] torch version 2.1.2+cu121 installed.
[+] torchvision version 0.16.2+cu121 installed.
[+] accelerate version 0.21.0 installed.
[+] diffusers version 0.26.3 installed.
[+] bitsandbytes version 0.43.0 installed.
[!] xformers version 0.0.20 installed.
Launching Web UI with arguments: --xformers --autolaunch --opt-sdp-attention
2024-04-23 22:56:02.040568: I tensorflow/core/util/port.cc:113] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`.
2024-04-23 22:56:02.483801: I tensorflow/core/util/port.cc:113] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`.
ControlNet preprocessor location: C:\code\SD\extensions\sd-webui-controlnet\annotator\downloads
2024-04-23 22:56:05,467 - ControlNet - INFO - ControlNet v1.1.445
2024-04-23 22:56:05,555 - ControlNet - INFO - ControlNet v1.1.445
22:56:05 - ReActor - STATUS - Running v0.7.0-b7 on Device: CUDA
2024-04-23 22:56:05,911 - roop - INFO - roop v0.0.2
2024-04-23 22:56:05,930 - roop - INFO - roop v0.0.2
Loading weights [ef76aa2332] from C:\code\SD\models\Stable-diffusion\realisticVisionV51_v51VAE.safetensors
Creating model from config: C:\code\SD\configs\v1-inference.yaml
Loading VAE weights specified in settings: C:\code\SD\models\VAE\vae-ft-mse-840000-ema-pruned.safetensors
Applying attention optimization: xformers... done.
Model loaded in 1.6s (create model: 0.2s, apply weights to model: 1.1s).
2024-04-23 22:56:08,605 - ControlNet - INFO - ControlNet UI callback registered.
Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}
find model: C:\Users\Aldo/.insightface\models\buffalo_l\1k3d68.onnx landmark_3d_68 ['None', 3, 192, 192] 0.0 1.0
Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}
find model: C:\Users\Aldo/.insightface\models\buffalo_l\2d106det.onnx landmark_2d_106 ['None', 3, 192, 192] 0.0 1.0
Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}
find model: C:\Users\Aldo/.insightface\models\buffalo_l\det_10g.onnx detection [1, 3, '?', '?'] 127.5 128.0
Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}
find model: C:\Users\Aldo/.insightface\models\buffalo_l\genderage.onnx genderage ['None', 3, 96, 96] 0.0 1.0
Applied providers: ['CPUExecutionProvider'], with options: {'CPUExecutionProvider': {}}
find model: C:\Users\Aldo/.insightface\models\buffalo_l\w600k_r50.onnx recognition ['None', 3, 112, 112] 127.5 127.5
set det-size: (640, 640)
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 32.1s (prepare environment: 18.2s, import torch: 2.9s, import gradio: 0.7s, setup paths: 2.0s, initialize shared: 0.2s, other imports: 0.4s, load scripts: 2.5s, create ui: 4.9s, gradio launch: 0.2s).
Advanced elements visible: False
2024-04-23 22:56:30,038 - AnimateDiff - INFO - AnimateDiff process start.
2024-04-23 22:56:30,038 - AnimateDiff - INFO - Loading motion module mm_sd_v15_v2.ckpt from C:\code\SD\extensions\sd-webui-animatediff-for-ControlNet\model\mm_sd_v15_v2.ckpt
2024-04-23 22:56:30,505 - AnimateDiff - INFO - Guessed mm_sd_v15_v2.ckpt architecture: MotionModuleType.AnimateDiffV2
2024-04-23 22:56:32,261 - AnimateDiff - INFO - Injecting motion module mm_sd_v15_v2.ckpt into SD1.5 UNet middle block.
2024-04-23 22:56:32,261 - AnimateDiff - INFO - Injecting motion module mm_sd_v15_v2.ckpt into SD1.5 UNet input blocks.
2024-04-23 22:56:32,261 - AnimateDiff - INFO - Injecting motion module mm_sd_v15_v2.ckpt into SD1.5 UNet output blocks.
2024-04-23 22:56:32,262 - AnimateDiff - INFO - Setting DDIM alpha.
2024-04-23 22:56:32,270 - AnimateDiff - INFO - Injection finished.
2024-04-23 22:56:32,271 - AnimateDiff - INFO - AnimateDiff + ControlNet will generate 10 frames.
fatal: No names found, cannot describe anything.
2024-04-23 22:56:32,289 - AnimateDiff - WARNING - Failed to get git tag for AnimateDiff: Command '['git', '-C', 'C:\\code\\SD\\extensions\\sd-webui-animatediff-for-ControlNet\\model', 'describe', '--tags']' returned non-zero exit status 128.
INFO:sd_dynamic_prompts.dynamic_prompting:Prompt matrix will create 10 images in a total of 1 batches.
2024-04-23 22:56:32,310 - ControlNet - INFO - unit_separate = False, style_align = False
2024-04-23 22:56:32,476 - ControlNet - INFO - Loading model: control_v11p_sd15_lineart [43d4be0d]
2024-04-23 22:56:32,686 - ControlNet - INFO - Loaded state_dict from [C:\code\SD\models\ControlNet\control_v11p_sd15_lineart.pth]
2024-04-23 22:56:32,686 - ControlNet - INFO - controlnet_default_config
2024-04-23 22:56:33,657 - ControlNet - INFO - ControlNet model control_v11p_sd15_lineart [43d4be0d](ControlModelType.ControlNet) loaded.
2024-04-23 22:56:33,657 - ControlNet - INFO - AnimateDiff + ControlNet lineart_realistic receive the following parameters:
2024-04-23 22:56:33,658 - ControlNet - INFO -   batch control images: I:\NUOVO ALDO JONES\FOOTBOLE\2023 - Agosto\AI\PROMOTIONAL IMAGE 1\IMM\FACE+POSE\07 - FAT MAN\07 - FAT MAN 3D SPIN
2024-04-23 22:56:33,882 - ControlNet - INFO - Using preprocessor: lineart_realistic
2024-04-23 22:56:33,882 - ControlNet - INFO - preprocessor resolution = 576
100%|██████████████████████████████████████████████████████████████████████████████████| 10/10 [00:00<00:00, 22.96it/s]
2024-04-23 22:56:34,328 - ControlNet - INFO - Using preprocessor: reference_only
2024-04-23 22:56:34,328 - ControlNet - INFO - preprocessor resolution = 576
2024-04-23 22:56:34,409 - ControlNet - INFO - ControlNet Hooked - Time = 2.1015188694000244
  0%|                                                                                           | 0/20 [00:00<?, ?it/s]2024-04-23 22:56:34,449 - AnimateDiff - INFO - inner model forward hooked
2024-04-23 22:56:34,607 - ControlNet - INFO - ControlNet used torch.float16 VAE to encode torch.Size([1, 4, 96, 72]).
 30%|████████████████████████▉                                                          | 6/20 [00:28<01:06,  4.75s/it]Reusing loaded model realisticVisionV51_v51VAE.safetensors [ef76aa2332] to load 3dAnimationDiffusion_v10.safetensors [31829c378d]
Loading weights [31829c378d] from C:\code\SD\models\Stable-diffusion\3dAnimationDiffusion_v10.safetensors
Loading VAE weights specified in settings: C:\code\SD\models\VAE\vae-ft-mse-840000-ema-pruned.safetensors
Applying attention optimization: xformers... done.
Weights loaded in 1.5s (send model to cpu: 0.8s, apply weights to model: 0.2s, move model to device: 0.4s).
 30%|████████████████████████▉                                                          | 6/20 [00:30<01:11,  5.12s/it]
*** Error completing request
*** Arguments: ('task(icb66igga0814dn)', <gradio.routes.Request object at 0x0000012927DEB490>, 'fat black man aged 24 in a soccer uniform with a short beard, short hair, very wide face, white background, yellow soccer shirt, black soccer shorts, black soccer socks, yellow soccer shoes', 'logos on the shirt, writings on the shirt, smile, EasyNegative, low-res, missing arms, watermark', [], 1, 1, 7, 768, 576, False, 0.7, 2, 'Latent', 0, 0, 0, 'Use same checkpoint', 'Use same sampler', 'Use same scheduler', '', '', [], 0, 20, 'Euler a', 'Automatic', True, '3dAnimationDiffusion_v10.safetensors [31829c378d]', 0.3, 2119900801, False, -1, 0, 0, 0, False, 'MultiDiffusion', False, True, 1024, 1024, 96, 96, 48, 4, 'None', 2, False, 10, 1, 1, 64, False, False, False, False, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 'DemoFusion', False, 128, 64, 4, 2, False, 10, 1, 1, 64, False, True, 3, 1, 1, True, 0.85, 0.6, 4, False, False, 2048, 128, True, True, True, False, False, '', 0, True, False, 1, False, False, False, 1.1, 1.5, 100, 0.7, False, False, True, False, False, 0, 'Gustavosta/MagicPrompt-Stable-Diffusion', '', <scripts.animatediff_ui.AnimateDiffProcess object at 0x0000012928599CC0>, UiControlNetUnit(enabled=True, module='lineart_realistic', model='control_v11p_sd15_lineart [43d4be0d]', weight=1, image=None, resize_mode='Crop and Resize', low_vram=False, processor_res=512, threshold_a=0.5, threshold_b=0.5, guidance_start=0, guidance_end=1, pixel_perfect=True, control_mode='ControlNet is more important', inpaint_crop_input_image=True, hr_option='HiResFixOption.BOTH', save_detected_map=True, advanced_weighting=None, ipadapter_input=None), UiControlNetUnit(enabled=True, module='reference_only', model='None', weight=0.95, image={'image': array([[[252, 253, 249],
***         [253, 252, 251],
***         [253, 254, 254],
***         ...,
***         [253, 255, 254],
***         [252, 254, 253],
***         [253, 254, 254]],
***
***        [[253, 253, 253],
***         [255, 255, 254],
***         [255, 254, 255],
***         ...,
***         [253, 254, 253],
***         [253, 254, 255],
***         [252, 252, 253]],
***
***        [[253, 253, 253],
***         [254, 254, 253],
***         [254, 254, 255],
***         ...,
***         [254, 254, 254],
***         [253, 254, 253],
***         [255, 255, 255]],
***
***        ...,
***
***        [[254, 254, 253],
***         [254, 255, 254],
***         [254, 255, 254],
***         ...,
***         [254, 255, 255],
***         [254, 255, 254],
***         [255, 255, 255]],
***
***        [[254, 255, 253],
***         [254, 254, 253],
***         [254, 254, 254],
***         ...,
***         [254, 254, 255],
***         [255, 255, 255],
***         [251, 252, 252]],
***
***        [[251, 254, 251],
***         [253, 255, 254],
***         [254, 254, 254],
***         ...,
***         [255, 255, 255],
***         [254, 255, 253],
***         [254, 255, 253]]], dtype=uint8), 'mask': array([[[0, 0, 0],
***         [0, 0, 0],
***         [0, 0, 0],
***         ...,
***         [0, 0, 0],
***         [0, 0, 0],
***         [0, 0, 0]],
***
***        [[0, 0, 0],
***         [0, 0, 0],
***         [0, 0, 0],
***         ...,
***         [0, 0, 0],
***         [0, 0, 0],
***         [0, 0, 0]],
***
***        [[0, 0, 0],
***         [0, 0, 0],
***         [0, 0, 0],
***         ...,
***         [0, 0, 0],
***         [0, 0, 0],
***         [0, 0, 0]],
***
***        ...,
***
***        [[0, 0, 0],
***         [0, 0, 0],
***         [0, 0, 0],
***         ...,
***         [0, 0, 0],
***         [0, 0, 0],
***         [0, 0, 0]],
***
***        [[0, 0, 0],
***         [0, 0, 0],
***         [0, 0, 0],
***         ...,
***         [0, 0, 0],
***         [0, 0, 0],
***         [0, 0, 0]],
***
***        [[0, 0, 0],
***         [0, 0, 0],
***         [0, 0, 0],
***         ...,
***         [0, 0, 0],
***         [0, 0, 0],
***         [0, 0, 0]]], dtype=uint8)}, resize_mode='Crop and Resize', low_vram=False, processor_res=512, threshold_a=0.5, threshold_b=0.5, guidance_start=0, guidance_end=1, pixel_perfect=True, control_mode='My prompt is more important', inpaint_crop_input_image=True, hr_option='HiResFixOption.BOTH', save_detected_map=True, advanced_weighting=None, ipadapter_input=None), UiControlNetUnit(enabled=False, module='none', model='None', weight=1, image=None, resize_mode='Crop and Resize', low_vram=False, processor_res=-1, threshold_a=-1, threshold_b=-1, guidance_start=0, guidance_end=1, pixel_perfect=False, control_mode='Balanced', inpaint_crop_input_image=False, hr_option='Both', save_detected_map=True, advanced_weighting=None, ipadapter_input=None), None, False, '0', '0', 'inswapper_128.onnx', 'CodeFormer', 1, True, 'None', 1, 1, False, True, 1, 0, 0, False, 0.5, True, False, 'CUDA', False, 0, 'None', '', None, False, False, 0.5, 0, <PIL.Image.Image image mode=RGB size=250x330 at 0x12928DEA1A0>, True, '0', 'C:\\code\\SD\\models\\roop\\inswapper_128.onnx', 'CodeFormer', 1, '', 1, 1, False, True, False, False, False, False, False, 'positive', 'comma', 0, False, False, 'start', '', 1, '', [], 0, '', [], 0, '', [], True, False, False, False, False, False, False, 0, False, None, None, False, None, None, False, None, None, False, 50, True, False, 0, 'Range', 1, 'GPU', True, False, False, False, False, 0, 448, False, 448, False, False, 3, False, 3, True, 3, False, 'Horizontal', False, False, 'u2net', False, True, True, False, 0, 2.5, 'polylines_sharp', ['left-right', 'red-cyan-anaglyph'], 2, 0, '∯boost∯clipdepth∯clipdepth_far∯clipdepth_mode∯clipdepth_near∯compute_device∯do_output_depth∯gen_normalmap∯gen_rembg∯gen_simple_mesh∯gen_stereo∯model_type∯net_height∯net_size_match∯net_width∯normalmap_invert∯normalmap_post_blur∯normalmap_post_blur_kernel∯normalmap_pre_blur∯normalmap_pre_blur_kernel∯normalmap_sobel∯normalmap_sobel_kernel∯output_depth_combine∯output_depth_combine_axis∯output_depth_invert∯pre_depth_background_removal∯rembg_model∯save_background_removal_masks∯save_outputs∯simple_mesh_occlude∯simple_mesh_spherical∯stereo_balance∯stereo_divergence∯stereo_fill_algo∯stereo_modes∯stereo_offset_exponent∯stereo_separation') {}
    Traceback (most recent call last):
      File "C:\code\SD\modules\call_queue.py", line 57, in f
        res = list(func(*args, **kwargs))
      File "C:\code\SD\modules\call_queue.py", line 36, in f
        res = func(*args, **kwargs)
      File "C:\code\SD\modules\txt2img.py", line 109, in txt2img
        processed = processing.process_images(p)
      File "C:\code\SD\modules\processing.py", line 845, in process_images
        res = process_images_inner(p)
      File "C:\code\SD\extensions\sd-webui-controlnet\scripts\batch_hijack.py", line 48, in processing_process_images_hijack
        return getattr(processing, '__controlnet_original_process_images_inner')(p, *args, **kwargs)
      File "C:\code\SD\modules\processing.py", line 981, in process_images_inner
        samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts)
      File "C:\code\SD\extensions\sd-webui-controlnet\scripts\hook.py", line 449, in process_sample
        return process.sample_before_CN_hack(*args, **kwargs)
      File "C:\code\SD\modules\processing.py", line 1328, in sample
        samples = self.sampler.sample(self, x, conditioning, unconditional_conditioning, image_conditioning=self.txt2img_image_conditioning(x))
      File "C:\code\SD\modules\sd_samplers_kdiffusion.py", line 218, in sample
        samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))
      File "C:\code\SD\modules\sd_samplers_common.py", line 272, in launch_sampling
        return func()
      File "C:\code\SD\modules\sd_samplers_kdiffusion.py", line 218, in <lambda>
        samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))
      File "C:\code\SD\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "C:\code\SD\repositories\k-diffusion\k_diffusion\sampling.py", line 145, in sample_euler_ancestral
        denoised = model(x, sigmas[i] * s_in, **extra_args)
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
        return self._call_impl(*args, **kwargs)
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\code\SD\modules\sd_samplers_cfg_denoiser.py", line 256, in forward
        x_out[a:b] = self.inner_model(x_in[a:b], sigma_in[a:b], cond=make_condition_dict(c_crossattn, image_cond_in[a:b]))
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
        return self._call_impl(*args, **kwargs)
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\code\SD\repositories\k-diffusion\k_diffusion\external.py", line 112, in forward
        eps = self.get_eps(input * c_in, self.sigma_to_t(sigma), **kwargs)
      File "C:\code\SD\repositories\k-diffusion\k_diffusion\external.py", line 138, in get_eps
        return self.inner_model.apply_model(*args, **kwargs)
      File "C:\code\SD\modules\sd_hijack_utils.py", line 18, in <lambda>
        setattr(resolved_obj, func_path[-1], lambda *args, **kwargs: self(*args, **kwargs))
      File "C:\code\SD\modules\sd_hijack_utils.py", line 32, in __call__
        return self.__orig_func(*args, **kwargs)
      File "C:\code\SD\repositories\stable-diffusion-stability-ai\ldm\models\diffusion\ddpm.py", line 858, in apply_model
        x_recon = self.model(x_noisy, t, **cond)
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
        return self._call_impl(*args, **kwargs)
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\code\SD\repositories\stable-diffusion-stability-ai\ldm\models\diffusion\ddpm.py", line 1335, in forward
        out = self.diffusion_model(x, t, context=cc)
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
        return self._call_impl(*args, **kwargs)
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\code\SD\extensions\sd-webui-controlnet\scripts\hook.py", line 874, in forward_webui
        raise e
      File "C:\code\SD\extensions\sd-webui-controlnet\scripts\hook.py", line 871, in forward_webui
        return forward(*args, **kwargs)
      File "C:\code\SD\extensions\sd-webui-controlnet\scripts\hook.py", line 592, in forward
        control = param.control_model(
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
        return self._call_impl(*args, **kwargs)
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\code\SD\extensions\sd-webui-controlnet\scripts\cldm.py", line 31, in forward
        return self.control_model(*args, **kwargs)
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
        return self._call_impl(*args, **kwargs)
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\code\SD\extensions\sd-webui-controlnet\scripts\cldm.py", line 300, in forward
        guided_hint = self.input_hint_block(hint, emb, context)
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
        return self._call_impl(*args, **kwargs)
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\code\SD\repositories\generative-models\sgm\modules\diffusionmodules\openaimodel.py", line 102, in forward
        x = layer(x)
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
        return self._call_impl(*args, **kwargs)
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
        return forward_call(*args, **kwargs)
      File "C:\code\SD\extensions\stable-diffusion-webui-composable-lora\composable_lora.py", line 154, in lora_Conv2d_forward
        return lora_forward(self, input, torch.nn.Conv2d_forward_before_lora(self, input))
      File "C:\code\SD\extensions-builtin\Lora\networks.py", line 518, in network_Conv2d_forward
        return originals.Conv2d_forward(self, input)
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\conv.py", line 460, in forward
        return self._conv_forward(input, self.weight, self.bias)
      File "C:\code\SD\venv\lib\site-packages\torch\nn\modules\conv.py", line 456, in _conv_forward
        return F.conv2d(input, weight, bias, self.stride,
    RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument weight in method wrapper_CUDA___slow_conv2d_forward)

---

Additional information

No response

corvo4791 commented 7 months ago

Nobody?

corvo4791 commented 7 months ago

I've 12GB VRAM and when I get this error just 10GB of VRAM is used. So, because A1111 always uses VRAM by default, the GPU manages all the models and the CPU manages nothing. I really can't understand why I get this error if everything is in the VRAM?