Closed zhangukai closed 6 months ago
zhangukai
commented
6 months ago Thank you very much for your help in your busy schedule. I have downloaded the ip-adapter-plus_sd15.safetensors, but another mistake has occurred. Are some steps I have done wrong?
zhangukai
commented
6 months ago You are running torch 1.12.1+cu113. The program is tested to work with torch 2.1.2. To reinstall the desired version, run with commandline flag --reinstall-torch. Beware that this will cause a lot of large files to be downloaded, as well as there are reports of issues with training tab on the latest version.
================================================================================= You are running xformers 0.0.14.dev. The program is tested to work with xformers 0.0.23.post1. To reinstall the desired version, run with commandline flag --reinstall-xformers.
Civitai Helper: Root Path is: D:\SD\sd-webui-aki\sd-webui-aki-v4.1 Civitai Helper: Get Custom Model Folder Tag Autocomplete: Could not locate model-keyword extension, Lora trigger word completion will be limited to those added through the extra networks menu. [AddNet] Updating model hashes... [AddNet] Updating model hashes... ControlNet preprocessor location: D:\SD\sd-webui-aki\sd-webui-aki-v4.1\extensions\sd-webui-controlnet\annotator\downloads 2024-04-23 09:48:50,214 - ControlNet - INFO - ControlNet v1.1.445 2024-04-23 09:48:50,334 - ControlNet - INFO - ControlNet v1.1.445 sd-webui-prompt-all-in-one background API service started successfully. Loading weights [ec41bd2a82] from D:\SD\sd-webui-aki\sd-webui-aki-v4.1\models\Stable-diffusion\Photon_v1.safetensors Creating model from config: D:\SD\sd-webui-aki\sd-webui-aki-v4.1\configs\v1-inference.yaml 2024-04-23 09:48:51,226 - ControlNet - INFO - ControlNet UI callback registered. Civitai Helper: Settings: Civitai Helper: max_size_preview: True Civitai Helper: skip_nsfw_preview: False Civitai Helper: open_url_with_js: True Civitai Helper: proxy: Civitai Helper: use civitai api key: False Running on local URL: http://127.0.0.1:7860
To create a public link, set share=True in launch().
IIB Database file has been successfully backed up to the backup folder.
🤯 LobeTheme: Initializing...
Startup time: 18.0s (prepare environment: 5.9s, import torch: 3.1s, import gradio: 1.3s, setup paths: 1.3s, initialize shared: 0.3s, other imports: 0.8s, load scripts: 2.8s, create ui: 1.1s, gradio launch: 0.4s, add APIs: 0.8s, app_started_callback: 0.3s).
Loading VAE weights specified in settings: D:\SD\sd-webui-aki\sd-webui-aki-v4.1\models\VAE\vae-ft-mse-840000-ema-pruned.safetensors
Applying attention optimization: xformers... done.
Model loaded in 5.6s (create model: 0.8s, apply weights to model: 4.1s, load VAE: 0.1s, calculate empty prompt: 0.4s).
2024-04-23 09:50:00,997 - ControlNet - INFO - Preview Resolution = 512
2024-04-23 09:50:13,149 - ControlNet - INFO - unit_separate = False, style_align = False
2024-04-23 09:50:13,336 - ControlNet - INFO - Loading model: ip-adapter-plus_sd15 [836b5c2e]
2024-04-23 09:50:13,339 - ControlNet - INFO - Loaded state_dict from [D:\SD\sd-webui-aki\sd-webui-aki-v4.1\extensions\sd-webui-controlnet\models\ip-adapter-plus_sd15.safetensors]
2024-04-23 09:50:13,542 - ControlNet - INFO - ControlNet model ip-adapter-plus_sd15 836b5c2e loaded.
2024-04-23 09:50:13,543 - ControlNet - INFO - using mask
2024-04-23 09:50:13,550 - ControlNet - INFO - Using preprocessor: ip-adapter-auto
2024-04-23 09:50:13,551 - ControlNet - INFO - preprocessor resolution = 853
2024-04-23 09:50:13,553 - ControlNet - INFO - ip-adapter-auto => ip-adapter_clip_h
2024-04-23 09:50:19,942 - ControlNet - INFO - Loading model: control_v11p_sd15_lineart [43d4be0d]
2024-04-23 09:50:20,219 - ControlNet - INFO - Loaded state_dict from [D:\SD\sd-webui-aki\sd-webui-aki-v4.1\models\ControlNet\control_v11p_sd15_lineart.pth]
2024-04-23 09:50:20,219 - ControlNet - INFO - controlnet_default_config
2024-04-23 09:50:22,063 - ControlNet - INFO - ControlNet model control_v11p_sd15_lineart 43d4be0d loaded.
2024-04-23 09:50:22,110 - ControlNet - INFO - Using preprocessor: lineart_standard (from white bg & black line)
2024-04-23 09:50:22,111 - ControlNet - INFO - preprocessor resolution = 744
2024-04-23 09:50:22,191 - ControlNet - INFO - IP-Adapter using advanced weighting [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
2024-04-23 09:50:22,330 - ControlNet - INFO - ControlNet Hooked - Time = 9.184790134429932
Error completing request
Arguments: ('task(i5dzhgpldtw65tj)', <gradio.routes.Request object at 0x000001AB549B8130>, '', '', ['基础起手式'], 1, 1, 7, 744, 1280, False, 0.7, 2, 'Latent', 0, 0, 0, 'Use same checkpoint', 'Use same sampler', 'Use same scheduler', '', '', [], 0, 40, 'DPM++ 3M SDE', 'Karras', False, '', 0.8, -1, False, -1, 0, 0, 0, False, 'MultiDiffusion', False, True, 1024, 1024, 96, 96, 48, 1, 'None', 2, False, 10, 1, 1, 64, False, False, False, False, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 'DemoFusion', False, 128, 64, 4, 2, False, 10, 1, 1, 64, False, True, 3, 1, 1, True, 0.85, 0.6, 4, False, False, 3072, 192, True, True, True, False, False, False, 'LoRA', 'None', 1, 1, 'LoRA', 'None', 1, 1, 'LoRA', 'None', 1, 1, 'LoRA', 'None', 1, 1, 'LoRA', 'None', 1, 1, None, 'Refresh models', UiControlNetUnit(enabled=True, module='ip-adapter-auto', model='ip-adapter-plus_sd15 [836b5c2e]', weight=0.8, image={'image': array([[[ 17, 16, 14],
[ 17, 16, 14],
[ 17, 16, 14],
...,
[103, 103, 105],
[103, 103, 105],
[103, 103, 105]],
[[ 17, 16, 14], [ 17, 16, 14], [ 17, 16, 14], ..., [103, 103, 105], [103, 103, 105], *** [103, 103, 105]],
[[ 16, 15, 13], [ 16, 15, 13], [ 16, 15, 13], ..., [103, 103, 105], [103, 103, 105], *** [103, 103, 105]],
*** ...,
[[ 22, 20, 21], [ 22, 20, 21], [ 22, 20, 21], ..., [122, 126, 129], [122, 126, 129], *** [122, 126, 129]],
[[ 20, 18, 19], [ 19, 17, 18], [ 19, 17, 18], ..., [120, 124, 127], [120, 124, 127], *** [121, 125, 128]],
[[ 16, 14, 15], [ 16, 14, 15], [ 17, 15, 16], ..., [119, 123, 126], [119, 123, 126], [119, 123, 126]]], dtype=uint8), 'mask': array([[[0, 0, 0], [0, 0, 0], [0, 0, 0], ..., [0, 0, 0], [0, 0, 0], *** [0, 0, 0]],
[[0, 0, 0], [0, 0, 0], [0, 0, 0], ..., [0, 0, 0], [0, 0, 0], *** [0, 0, 0]],
[[0, 0, 0], [0, 0, 0], [0, 0, 0], ..., [0, 0, 0], [0, 0, 0], *** [0, 0, 0]],
*** ...,
[[0, 0, 0], [0, 0, 0], [0, 0, 0], ..., [0, 0, 0], [0, 0, 0], *** [0, 0, 0]],
[[0, 0, 0], [0, 0, 0], [0, 0, 0], ..., [0, 0, 0], [0, 0, 0], *** [0, 0, 0]],
[[0, 0, 0], [0, 0, 0], [0, 0, 0], ..., [0, 0, 0], [0, 0, 0], [0, 0, 0]]], dtype=uint8)}, resize_mode='Crop and Resize', low_vram=False, processor_res=512, threshold_a=0.5, threshold_b=0.5, guidance_start=0, guidance_end=0.8, pixel_perfect=True, control_mode='Balanced', inpaint_crop_input_image=False, hr_option='Both', save_detected_map=True, advanced_weighting=[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], ipadapter_input=None), UiControlNetUnit(enabled=True, module='lineart_standard (from white bg & black line)', model='control_v11p_sd15_lineart [43d4be0d]', weight=0.9, image={'image': array([[[255, 255, 255], [255, 255, 255], [255, 255, 255], ..., [255, 255, 255], [255, 255, 255], *** [255, 255, 255]],
[[255, 255, 255], [255, 255, 255], [255, 255, 255], ..., [255, 255, 255], [255, 255, 255], *** [255, 255, 255]],
[[255, 255, 255], [255, 255, 255], [255, 255, 255], ..., [255, 255, 255], [255, 255, 255], *** [255, 255, 255]],
*** ...,
[[255, 255, 255], [255, 255, 255], [255, 255, 255], ..., [255, 255, 255], [255, 255, 255], *** [255, 255, 255]],
[[255, 255, 255], [255, 255, 255], [255, 255, 255], ..., [255, 255, 255], [255, 255, 255], *** [255, 255, 255]],
[[255, 255, 255], [255, 255, 255], [255, 255, 255], ..., [255, 255, 255], [255, 255, 255], [255, 255, 255]]], dtype=uint8), 'mask': array([[[0, 0, 0], [0, 0, 0], [0, 0, 0], ..., [0, 0, 0], [0, 0, 0], *** [0, 0, 0]],
[[0, 0, 0], [0, 0, 0], [0, 0, 0], ..., [0, 0, 0], [0, 0, 0], *** [0, 0, 0]],
[[0, 0, 0], [0, 0, 0], [0, 0, 0], ..., [0, 0, 0], [0, 0, 0], *** [0, 0, 0]],
*** ...,
[[0, 0, 0], [0, 0, 0], [0, 0, 0], ..., [0, 0, 0], [0, 0, 0], *** [0, 0, 0]],
[[0, 0, 0], [0, 0, 0], [0, 0, 0], ..., [0, 0, 0], [0, 0, 0], *** [0, 0, 0]],
[[0, 0, 0],
[0, 0, 0],
[0, 0, 0],
...,
[0, 0, 0],
[0, 0, 0],
[0, 0, 0]]], dtype=uint8)}, resize_mode='Crop and Resize', low_vram=False, processor_res=512, threshold_a=0.5, threshold_b=0.5, guidance_start=0, guidance_end=0.9, pixel_perfect=True, control_mode='ControlNet is more important', inpaint_crop_input_image=False, hr_option='Both', save_detected_map=True, advanced_weighting=None, ipadapter_input=None), UiControlNetUnit(enabled=False, module='none', model='None', weight=1, image=None, resize_mode='Crop and Resize', low_vram=False, processor_res=512, threshold_a=64, threshold_b=64, guidance_start=0, guidance_end=1, pixel_perfect=False, control_mode='Balanced', inpaint_crop_input_image=False, hr_option='Both', save_detected_map=True, advanced_weighting=None, ipadapter_input=None), False, False, 0, None, [], 0, False, [], [], False, 0, 1, False, False, 0, None, [], -2, False, [], False, 0, None, None, False, False, 'positive', 'comma', 0, False, False, 'start', '', 1, '', [], 0, '', [], 0, '', [], True, False, False, False, False, False, False, 0, False, None, None, False, None, None, False, None, None, False, 50) {}
Traceback (most recent call last):
File "D:\SD\sd-webui-aki\sd-webui-aki-v4.1\modules\call_queue.py", line 57, in f
res = list(func(args, kwargs))
File "D:\SD\sd-webui-aki\sd-webui-aki-v4.1\modules\call_queue.py", line 36, in f
res = func(*args, kwargs)
File "D:\SD\sd-webui-aki\sd-webui-aki-v4.1\modules\txt2img.py", line 109, in txt2img
processed = processing.process_images(p)
File "D:\SD\sd-webui-aki\sd-webui-aki-v4.1\modules\processing.py", line 845, in process_images
res = process_images_inner(p)
File "D:\SD\sd-webui-aki\sd-webui-aki-v4.1\extensions\sd-webui-controlnet\scripts\batch_hijack.py", line 59, in processing_process_images_hijack
return getattr(processing, '__controlnet_original_process_images_inner')(p, *args, *kwargs)
File "D:\SD\sd-webui-aki\sd-webui-aki-v4.1\modules\processing.py", line 981, in process_images_inner
samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts)
File "D:\SD\sd-webui-aki\sd-webui-aki-v4.1\extensions\sd-webui-controlnet\scripts\hook.py", line 449, in process_sample
return process.sample_before_CN_hack(args, kwargs)
File "D:\SD\sd-webui-aki\sd-webui-aki-v4.1\modules\processing.py", line 1328, in sample
samples = self.sampler.sample(self, x, conditioning, unconditional_conditioning, image_conditioning=self.txt2img_image_conditioning(x))
File "D:\SD\sd-webui-aki\sd-webui-aki-v4.1\modules\sd_samplers_kdiffusion.py", line 218, in sample
samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, extra_params_kwargs))
File "D:\SD\sd-webui-aki\sd-webui-aki-v4.1\modules\sd_samplers_common.py", line 272, in launch_sampling
return func()
File "D:\SD\sd-webui-aki\sd-webui-aki-v4.1\modules\sd_samplers_kdiffusion.py", line 218, in
zhangukai
commented
6 months ago I upgraded my Torch and xFormers and they work properly. Thank you very much
Is there an existing issue for this?
What happened?
The IP-adapter cannot be used for interior rendering
Steps to reproduce the problem
Controlnet Unit 1, add 1 indoor image to multiple inputs. Controlnet Unit 2, add an interior wire sketch
What should have happened?
it should transfer the style from Figure 1 to Figure 2
Commit where the problem happens
webui:b9ab9dc controlnet: b4b5bfe
What browsers do you use to access the UI ?
Microsoft Edge
Command Line Arguments
List of enabled extensions
Console logs
Additional information
No response