search

lllyasviel / stable-diffusion-webui-forge

GNU Affero General Public License v3.0
5.27k stars 518 forks source link

[Bug]: controlnet -photomaker didn't work （attached screenshot） #65

Open samliu315 opened 4 months ago

samliu315 commented 4 months ago

Checklist

What happened?

controlnet -photomaker didn't work 1 2

Steps to reproduce the problem

  1. Put the photomaker model into the model file of controlnet
  2. Upload multiple pictures to photomaker
  3. Check the keywords required for photomaker to start

What should have happened?

Generate a graphic with the faces of the people I uploaded

What browsers do you use to access the UI ?

Google Chrome

Sysinfo

sysinfo-2024-02-06-16-36.json

Console logs

2024-02-07 00:30:30,068 - ControlNet - INFO - ControlNet Method ClipVision (Photomaker) patched.
To load target model BaseModel
Begin to load 1 model
unload clone 2
Moving model(s) has taken 1.02 seconds
100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:01<00:00, 13.78it/s]
Token merging is under construction now and the setting will not take effect.██████████| 20/20 [00:01<00:00, 15.72it/s]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 20/20 [00:01<00:00, 12.34it/s]
Token merging is under construction now and the setting will not take effect.██████████| 20/20 [00:01<00:00, 15.72it/s]
2024-02-07 00:32:28,303 - ControlNet - INFO - ControlNet Input Mode: InputMode.MERGE
2024-02-07 00:32:28,304 - ControlNet - INFO - Try to read image: C:\Users\FUNGAM~1\AppData\Local\Temp\gradio\bf84b36caa276a7e5b5926d32843b95aca4d5469\1570732594_instagram-jelodi-jung-68.jpg
2024-02-07 00:32:28,348 - ControlNet - INFO - Try to read image: C:\Users\FUNGAM~1\AppData\Local\Temp\gradio\a0f23073960158943590e0b4d1071243311af046\9b69603b5c64b45c9d16d7fc0ff6e75e--elodie-yung-human-body.jpg_http___avatars.mds.yandex.jpg
2024-02-07 00:32:28,360 - ControlNet - INFO - Try to read image: C:\Users\FUNGAM~1\AppData\Local\Temp\gradio\f8aa0e1153a28013262618a7163ec5566778559c\1_16a083549e9.1547137_3644485459_16a083549e9_large.jpg
2024-02-07 00:32:28,374 - ControlNet - INFO - Try to read image: C:\Users\FUNGAM~1\AppData\Local\Temp\gradio\9a53097bb068ae6aefb15890488f1e02aa2cedeb\1570732590_instagram-jelodi-jung-19.jpg
2024-02-07 00:32:28,484 - ControlNet - INFO - Using preprocessor: ClipVision (Photomaker)
2024-02-07 00:32:28,484 - ControlNet - INFO - preprocessor resolution = 0.5
2024-02-07 00:32:28,484 - ControlNet - INFO - Using preprocessor: ClipVision (Photomaker)
2024-02-07 00:32:28,484 - ControlNet - INFO - preprocessor resolution = 0.5
2024-02-07 00:32:28,484 - ControlNet - INFO - Using preprocessor: ClipVision (Photomaker)
2024-02-07 00:32:28,484 - ControlNet - INFO - preprocessor resolution = 0.5
2024-02-07 00:32:28,484 - ControlNet - INFO - Using preprocessor: ClipVision (Photomaker)
2024-02-07 00:32:28,484 - ControlNet - INFO - preprocessor resolution = 0.5
2024-02-07 00:32:29,241 - ControlNet - INFO - Current ControlNet PhotomakerPatcher: H:\webui_forge_cu121_torch21\webui\models\ControlNet\photomaker-v1.bin
To load target model SD1ClipModel
Begin to load 1 model
unload clone 2
Moving model(s) has taken 0.39 seconds
2024-02-07 00:32:29,685 - ControlNet - INFO - ControlNet Method ClipVision (Photomaker) patched.
To load target model BaseModel
Begin to load 1 model
unload clone 2
Moving model(s) has taken 1.09 seconds
100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:01<00:00, 12.91it/s]
Token merging is under construction now and the setting will not take effect.██████████| 20/20 [00:01<00:00, 14.34it/s]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 20/20 [00:01<00:00, 12.01it/s]
Total progress: 100%|██████████████████████████████████████████████████████████████████| 20/20

Additional information

No response

huchenlei commented 4 months ago

The batch upload is for batch processing. It is not equivalent to previous Multi-Inputs. Multi-Inputs feature is removed. See https://github.com/lllyasviel/stable-diffusion-webui-forge/discussions/40 .

You need to turn on multiple units each with an input to achieve the same result as previous Multi-Inputs. Please file an feature request and we will see if it is necessary to add that feature back.

samliu315 commented 4 months ago

photomaker has never worked, I've tried it, either with a single image or multiple controlnets.

And the vertical alignment of controlnet is also rather inconvenient, is it because my UI preset is not selected correctly?

CCpt5 commented 4 months ago

FWIW I am unable to get PhotoMaker to generate an image using the image provided in the CN Single Image console either.

Could be user error? But I'm pretty sure I have the proper model and there are no errors in the console. The generated image just isn't altered by the model.

65456151

Console clip shows no errors

100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:05<00:00, 5.26it/s] Total progress: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:05<00:00, 4.92it/s] 2024-02-06 21:15:29,613 - ControlNet - INFO - ControlNet Input Mode: InputMode.SIMPLE████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:05<00:00, 5.29it/s] 2024-02-06 21:15:29,617 - ControlNet - INFO - Using preprocessor: ClipVision (Photomaker) 2024-02-06 21:15:29,618 - ControlNet - INFO - preprocessor resolution = 0.5 Warning torch.load doesn't support weights_only on this pytorch version, loading unsafely. 2024-02-06 21:15:32,094 - ControlNet - INFO - Current ControlNet PhotomakerPatcher: D:\stable-diffusion-webui-forge\models\ControlNet\photomaker-v1.bin 2024-02-06 21:15:32,148 - ControlNet - INFO - ControlNet Method ClipVision (Photomaker) patched. To load target model SDXL Begin to load 1 model unload clone 3 Moving model(s) has taken 1.64 seconds 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:03<00:00, 7.48it/s] Total progress: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:04<00:00, 6.46it/s] 2024-02-06 21:17:31,613 - ControlNet - INFO - ControlNet Input Mode: InputMode.SIMPLE████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:04<00:00, 7.62it/s] 2024-02-06 21:17:31,617 - ControlNet - INFO - Using preprocessor: ClipVision (Photomaker) 2024-02-06 21:17:31,617 - ControlNet - INFO - preprocessor resolution = 0.5 2024-02-06 21:17:31,738 - ControlNet - INFO - Current ControlNet PhotomakerPatcher: D:\stable-diffusion-webui-forge\models\ControlNet\photomaker-v1.bin 2024-02-06 21:17:31,791 - ControlNet - INFO - ControlNet Method ClipVision (Photomaker) patched. To load target model SDXL Begin to load 1 model unload clone 2 Moving model(s) has taken 2.53 seconds 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:03<00:00, 7.42it/s] Total progress: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:04<00:00, 6.05it/s] 2024-02-06 21:23:23,992 - ControlNet - INFO - ControlNet Input Mode: InputMode.SIMPLE████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:04<00:00, 7.63it/s] 2024-02-06 21:23:23,996 - ControlNet - INFO - Using preprocessor: ClipVision (Photomaker) 2024-02-06 21:23:23,996 - ControlNet - INFO - preprocessor resolution = 0.5 2024-02-06 21:23:24,118 - ControlNet - INFO - Current ControlNet PhotomakerPatcher: D:\stable-diffusion-webui-forge\models\ControlNet\photomaker-v1.bin 2024-02-06 21:23:24,174 - ControlNet - INFO - ControlNet Method ClipVision (Photomaker) patched. To load target model SDXL Begin to load 1 model unload clone 2 Moving model(s) has taken 2.55 seconds 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:04<00:00, 7.23it/s] Total progress: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:04<00:00, 6.00it/s] Total progress: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 29/29 [00:04<00:00, 7.49it/s]

System Info:

Details

```python { "Platform": "Windows-10-10.0.19045-SP0", "Python": "3.10.6", "Version": "f0.0.10-latest-58-ge6263135", "Commit": "e62631350a408edf3b1f0a9dd45a43f9f0e95ead", "Script path": "D:\\stable-diffusion-webui-forge", "Data path": "D:\\stable-diffusion-webui-forge", "Extensions dir": "D:\\stable-diffusion-webui-forge\\extensions", "Checksum": "f1b5e4261ccd6eed11591f91ee11455510852ccc6649d03c744d021fac250d93", "Commandline": [ "launch.py", "--ckpt-dir", "e:\\stable Diffusion Checkpoints" ], "Torch env info": { "torch_version": "2.1.2+cu121", "is_debug_build": "False", "cuda_compiled_version": "12.1", "gcc_version": null, "clang_version": null, "cmake_version": null, "os": "Microsoft Windows 10 Pro", "libc_version": "N/A", "python_version": "3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)] (64-bit runtime)", "python_platform": "Windows-10-10.0.19045-SP0", "is_cuda_available": "True", "cuda_runtime_version": "12.1.66\r", "cuda_module_loading": "LAZY", "nvidia_driver_version": "551.23", "nvidia_gpu_models": "GPU 0: NVIDIA GeForce RTX 4090", "cudnn_version": null, "pip_version": "pip3", "pip_packages": [ "numpy==1.26.2", "open-clip-torch==2.20.0", "pytorch-lightning==1.9.4", "torch==2.1.2+cu121", "torchdiffeq==0.2.3", "torchmetrics==1.3.0.post0", "torchsde==0.2.6", "torchvision==0.16.2+cu121" ], "conda_packages": null, "hip_compiled_version": "N/A", "hip_runtime_version": "N/A", "miopen_runtime_version": "N/A", "caching_allocator_config": "", "is_xnnpack_available": "True", "cpu_info": [ "Architecture=9", "CurrentClockSpeed=3200", "DeviceID=CPU0", "Family=207", "L2CacheSize=16384", "L2CacheSpeed=", "Manufacturer=GenuineIntel", "MaxClockSpeed=3200", "Name=Intel(R) Core(TM) i9-14900K", "ProcessorType=3", "Revision=" ] }, "Exceptions": [ { "exception": "'dict' object has no attribute 'shape'", "traceback": [ [ "D:\\stable-diffusion-webui-forge\\modules\\call_queue.py, line 57, f", "res = list(func(*args, **kwargs))" ], [ "D:\\stable-diffusion-webui-forge\\modules\\call_queue.py, line 36, f", "res = func(*args, **kwargs)" ], [ "D:\\stable-diffusion-webui-forge\\modules\\txt2img.py, line 110, txt2img", "processed = processing.process_images(p)" ], [ "D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 749, process_images", "res = process_images_inner(p)" ], [ "D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 920, process_images_inner", "samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts)" ], [ "D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 1275, sample", "samples = self.sampler.sample(self, x, conditioning, unconditional_conditioning, image_conditioning=self.txt2img_image_conditioning(x))" ], [ "D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_kdiffusion.py, line 251, sample", "samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))" ], [ "D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_common.py, line 260, launch_sampling", "return func()" ], [ "D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_kdiffusion.py, line 251, ", "samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))" ], [ "D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\utils\\_contextlib.py, line 115, decorate_context", "return func(*args, **kwargs)" ], [ "D:\\stable-diffusion-webui-forge\\repositories\\k-diffusion\\k_diffusion\\sampling.py, line 594, sample_dpmpp_2m", "denoised = model(x, sigmas[i] * s_in, **extra_args)" ], [ "D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\nn\\modules\\module.py, line 1518, _wrapped_call_impl", "return self._call_impl(*args, **kwargs)" ], [ "D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\nn\\modules\\module.py, line 1527, _call_impl", "return forward_call(*args, **kwargs)" ], [ "D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_cfg_denoiser.py, line 182, forward", "denoised = forge_sampler.forge_sample(self, denoiser_params=denoiser_params," ], [ "D:\\stable-diffusion-webui-forge\\modules_forge\\forge_sampler.py, line 82, forge_sample", "denoised = sampling_function(model, x, timestep, uncond, cond, cond_scale, model_options, seed)" ], [ "D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\samplers.py, line 282, sampling_function", "cond_pred, uncond_pred = calc_cond_uncond_batch(model, cond, uncond_, x, timestep, model_options)" ], [ "D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\samplers.py, line 248, calc_cond_uncond_batch", "c['control'] = control.get_control(input_x, timestep_, control_cond, len(cond_or_uncond))" ], [ "D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\controlnet.py, line 241, get_control", "self.cond_hint = ldm_patched.modules.utils.common_upscale(self.cond_hint_original, x_noisy.shape[3] * 8, x_noisy.shape[2] * 8, 'nearest-exact', \"center\").to(dtype).to(self.device)" ], [ "D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\utils.py, line 383, common_upscale", "old_width = samples.shape[3]" ] ] }, { "exception": "'dict' object has no attribute 'shape'", "traceback": [ [ "D:\\stable-diffusion-webui-forge\\modules\\call_queue.py, line 57, f", "res = list(func(*args, **kwargs))" ], [ "D:\\stable-diffusion-webui-forge\\modules\\call_queue.py, line 36, f", "res = func(*args, **kwargs)" ], [ "D:\\stable-diffusion-webui-forge\\modules\\txt2img.py, line 110, txt2img", "processed = processing.process_images(p)" ], [ "D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 749, process_images", "res = process_images_inner(p)" ], [ "D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 920, process_images_inner", "samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts)" ], [ "D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 1275, sample", "samples = self.sampler.sample(self, x, conditioning, unconditional_conditioning, image_conditioning=self.txt2img_image_conditioning(x))" ], [ "D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_kdiffusion.py, line 251, sample", "samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))" ], [ "D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_common.py, line 260, launch_sampling", "return func()" ], [ "D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_kdiffusion.py, line 251, ", "samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))" ], [ "D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\utils\\_contextlib.py, line 115, decorate_context", "return func(*args, **kwargs)" ], [ "D:\\stable-diffusion-webui-forge\\repositories\\k-diffusion\\k_diffusion\\sampling.py, line 594, sample_dpmpp_2m", "denoised = model(x, sigmas[i] * s_in, **extra_args)" ], [ "D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\nn\\modules\\module.py, line 1518, _wrapped_call_impl", "return self._call_impl(*args, **kwargs)" ], [ "D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\nn\\modules\\module.py, line 1527, _call_impl", "return forward_call(*args, **kwargs)" ], [ "D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_cfg_denoiser.py, line 182, forward", "denoised = forge_sampler.forge_sample(self, denoiser_params=denoiser_params," ], [ "D:\\stable-diffusion-webui-forge\\modules_forge\\forge_sampler.py, line 82, forge_sample", "denoised = sampling_function(model, x, timestep, uncond, cond, cond_scale, model_options, seed)" ], [ "D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\samplers.py, line 282, sampling_function", "cond_pred, uncond_pred = calc_cond_uncond_batch(model, cond, uncond_, x, timestep, model_options)" ], [ "D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\samplers.py, line 248, calc_cond_uncond_batch", "c['control'] = control.get_control(input_x, timestep_, control_cond, len(cond_or_uncond))" ], [ "D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\controlnet.py, line 241, get_control", "self.cond_hint = ldm_patched.modules.utils.common_upscale(self.cond_hint_original, x_noisy.shape[3] * 8, x_noisy.shape[2] * 8, 'nearest-exact', \"center\").to(dtype).to(self.device)" ], [ "D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\utils.py, line 383, common_upscale", "old_width = samples.shape[3]" ] ] }, { "exception": "'dict' object has no attribute 'shape'", "traceback": [ [ "D:\\stable-diffusion-webui-forge\\modules\\call_queue.py, line 57, f", "res = list(func(*args, **kwargs))" ], [ "D:\\stable-diffusion-webui-forge\\modules\\call_queue.py, line 36, f", "res = func(*args, **kwargs)" ], [ "D:\\stable-diffusion-webui-forge\\modules\\txt2img.py, line 110, txt2img", "processed = processing.process_images(p)" ], [ "D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 749, process_images", "res = process_images_inner(p)" ], [ "D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 920, process_images_inner", "samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts)" ], [ "D:\\stable-diffusion-webui-forge\\modules\\processing.py, line 1275, sample", "samples = self.sampler.sample(self, x, conditioning, unconditional_conditioning, image_conditioning=self.txt2img_image_conditioning(x))" ], [ "D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_kdiffusion.py, line 251, sample", "samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))" ], [ "D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_common.py, line 260, launch_sampling", "return func()" ], [ "D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_kdiffusion.py, line 251, ", "samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))" ], [ "D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\utils\\_contextlib.py, line 115, decorate_context", "return func(*args, **kwargs)" ], [ "D:\\stable-diffusion-webui-forge\\repositories\\k-diffusion\\k_diffusion\\sampling.py, line 594, sample_dpmpp_2m", "denoised = model(x, sigmas[i] * s_in, **extra_args)" ], [ "D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\nn\\modules\\module.py, line 1518, _wrapped_call_impl", "return self._call_impl(*args, **kwargs)" ], [ "D:\\stable-diffusion-webui-forge\\venv\\lib\\site-packages\\torch\\nn\\modules\\module.py, line 1527, _call_impl", "return forward_call(*args, **kwargs)" ], [ "D:\\stable-diffusion-webui-forge\\modules\\sd_samplers_cfg_denoiser.py, line 182, forward", "denoised = forge_sampler.forge_sample(self, denoiser_params=denoiser_params," ], [ "D:\\stable-diffusion-webui-forge\\modules_forge\\forge_sampler.py, line 82, forge_sample", "denoised = sampling_function(model, x, timestep, uncond, cond, cond_scale, model_options, seed)" ], [ "D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\samplers.py, line 282, sampling_function", "cond_pred, uncond_pred = calc_cond_uncond_batch(model, cond, uncond_, x, timestep, model_options)" ], [ "D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\samplers.py, line 248, calc_cond_uncond_batch", "c['control'] = control.get_control(input_x, timestep_, control_cond, len(cond_or_uncond))" ], [ "D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\controlnet.py, line 241, get_control", "self.cond_hint = ldm_patched.modules.utils.common_upscale(self.cond_hint_original, x_noisy.shape[3] * 8, x_noisy.shape[2] * 8, 'nearest-exact', \"center\").to(dtype).to(self.device)" ], [ "D:\\stable-diffusion-webui-forge\\ldm_patched\\modules\\utils.py, line 383, common_upscale", "old_width = samples.shape[3]" ] ] } ], "CPU": { "model": "Intel64 Family 6 Model 183 Stepping 1, GenuineIntel", "count logical": 32, "count physical": 24 }, "RAM": { "total": "64GB", "used": "15GB", "free": "49GB" }, "Extensions": [ { "name": "a2-adetailer", "path": "D:\\stable-diffusion-webui-forge\\extensions\\a2-adetailer", "version": "8f01dfda", "branch": "main", "remote": "https://github.com/Bing-su/adetailer.git" }, { "name": "b1111-sd-webui-tagcomplete", "path": "D:\\stable-diffusion-webui-forge\\extensions\\b1111-sd-webui-tagcomplete", "version": "829a4a7b", "branch": "main", "remote": "https://github.com/DominikDoom/a1111-sd-webui-tagcomplete.git" }, { "name": "frame2frame", "path": "D:\\stable-diffusion-webui-forge\\extensions\\frame2frame", "version": "", "branch": null, "remote": null }, { "name": "sd-Img2img-batch-interrogator", "path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-Img2img-batch-interrogator", "version": "7f4e4eb0", "branch": "main", "remote": "https://github.com/Alvi-alvarez/sd-Img2img-batch-interrogator.git" }, { "name": "sd-canvas-editor", "path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-canvas-editor", "version": "e4c9e15f", "branch": "master", "remote": "https://github.com/jtydhr88/sd-canvas-editor.git" }, { "name": "sd-dynamic-prompts", "path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-dynamic-prompts", "version": "284d3ef3", "branch": "main", "remote": "https://github.com/adieyal/sd-dynamic-prompts.git" }, { "name": "sd-extension-system-info", "path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-extension-system-info", "version": "363d4417", "branch": "main", "remote": "https://github.com/vladmandic/sd-extension-system-info.git" }, { "name": "sd-webui-animatediff", "path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-animatediff", "version": "e9db9f28", "branch": "master", "remote": "https://github.com/continue-revolution/sd-webui-animatediff.git" }, { "name": "sd-webui-aspect-ratio-helper", "path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-aspect-ratio-helper", "version": "99fcf9b0", "branch": "main", "remote": "https://github.com/thomasasfk/sd-webui-aspect-ratio-helper.git" }, { "name": "sd-webui-cads", "path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-cads", "version": "a821b207", "branch": "main", "remote": "https://github.com/v0xie/sd-webui-cads.git" }, { "name": "sd-webui-inpaint-anything", "path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-inpaint-anything", "version": "a08995a7", "branch": "main", "remote": "https://github.com/Uminosachi/sd-webui-inpaint-anything.git" }, { "name": "sd-webui-model-mixer", "path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-model-mixer", "version": "519beda8", "branch": "master", "remote": "https://github.com/wkpark/sd-webui-model-mixer.git" }, { "name": "sd-webui-mosaic-outpaint", "path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-mosaic-outpaint", "version": "709c60ac", "branch": "main", "remote": "https://github.com/Haoming02/sd-webui-mosaic-outpaint.git" }, { "name": "sd-webui-stablesr", "path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-stablesr", "version": "4499d796", "branch": "master", "remote": "https://github.com/pkuliyi2015/sd-webui-stablesr.git" }, { "name": "sd-webui-zmultidiffusion-upscaler-for-automatic1111", "path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-zmultidiffusion-upscaler-for-automatic1111", "version": "fbb24736", "branch": "main", "remote": "https://github.com/pkuliyi2015/multidiffusion-upscaler-for-automatic1111.git" }, { "name": "stable-diffusion-webui-model-toolkit", "path": "D:\\stable-diffusion-webui-forge\\extensions\\stable-diffusion-webui-model-toolkit", "version": "cf824587", "branch": "master", "remote": "https://github.com/arenasys/stable-diffusion-webui-model-toolkit.git" }, { "name": "stable-diffusion-webui-rembg", "path": "D:\\stable-diffusion-webui-forge\\extensions\\stable-diffusion-webui-rembg", "version": "a4c07b85", "branch": "master", "remote": "https://github.com/AUTOMATIC1111/stable-diffusion-webui-rembg.git" } ], "Inactive extensions": [ { "name": "extension-style-vars", "path": "D:\\stable-diffusion-webui-forge\\extensions\\extension-style-vars", "version": "7e528995", "branch": "master", "remote": "https://github.com/SirVeggie/extension-style-vars" }, { "name": "sd-webui-replacer", "path": "D:\\stable-diffusion-webui-forge\\extensions\\sd-webui-replacer", "version": "6f8b5807", "branch": "master", "remote": "https://github.com/light-and-ray/sd-webui-replacer.git" }, { "name": "ultimate-upscale-for-automatic1111", "path": "D:\\stable-diffusion-webui-forge\\extensions\\ultimate-upscale-for-automatic1111", "version": "728ffcec", "branch": "master", "remote": "https://github.com/Coyote-A/ultimate-upscale-for-automatic1111.git" } ], "Environment": { "COMMANDLINE_ARGS": "--ckpt-dir \"e:\\stable Diffusion Checkpoints\"", "GRADIO_ANALYTICS_ENABLED": "False" }, "Config": { "ldsr_steps": 100, "ldsr_cached": false, "SCUNET_tile": 256, "SCUNET_tile_overlap": 8, "SWIN_tile": 192, "SWIN_tile_overlap": 8, "SWIN_torch_compile": false, "control_net_detectedmap_dir": "detected_maps", "control_net_models_path": "D:\\stable-diffusion-webui\\extensions\\3sd-webui-controlnet", "control_net_modules_path": "", "control_net_unit_count": 3, "control_net_model_cache_size": 3, "control_net_no_detectmap": false, "control_net_detectmap_autosaving": false, "control_net_allow_script_control": true, "control_net_sync_field_args": true, "controlnet_show_batch_images_in_ui": false, "controlnet_increment_seed_during_batch": false, "controlnet_disable_openpose_edit": false, "controlnet_disable_photopea_edit": false, "controlnet_photopea_warning": true, "controlnet_input_thumbnail": true, "sd_checkpoint_hash": "31e35c80fc4829d14f90153f4c74cd59c90b779f6afe05a74cd6120b893f7e5b", "sd_model_checkpoint": "SDXL\\sd_xl_base_1.0.safetensors [31e35c80fc]", "outdir_samples": "E:\\Stable Diffusion Images", "outdir_txt2img_samples": "E:\\Stable Diffusion Images", "outdir_img2img_samples": "E:\\Stable Diffusion Images", "outdir_extras_samples": "E:\\Stable Diffusion Images", "outdir_grids": "E:\\Stable Diffusion Images", "outdir_txt2img_grids": "E:\\Stable Diffusion Images", "outdir_img2img_grids": "E:\\Stable Diffusion Images", "outdir_save": "E:\\Stable Diffusion Images", "outdir_init_images": "E:\\Stable Diffusion Images", "samples_save": true, "samples_format": "png", "samples_filename_pattern": "", "save_images_add_number": true, "save_images_replace_action": "Replace", "grid_save": true, "grid_format": "png", "grid_extended_filename": false, "grid_only_if_multiple": true, "grid_prevent_empty_spots": false, "grid_zip_filename_pattern": "", "n_rows": -1, "font": "", "grid_text_active_color": "#000000", "grid_text_inactive_color": "#999999", "grid_background_color": "#ffffff", "save_images_before_face_restoration": false, "save_images_before_highres_fix": false, "save_images_before_color_correction": false, "save_mask": false, "save_mask_composite": false, "jpeg_quality": 80, "webp_lossless": false, "export_for_4chan": true, "img_downscale_threshold": 4.0, "target_side_length": 4000.0, "img_max_size_mp": 200.0, "use_original_name_batch": true, "use_upscaler_name_as_suffix": false, "save_selected_only": true, "save_init_img": false, "temp_dir": "", "clean_temp_dir_at_start": false, "save_incomplete_images": false, "notification_audio": true, "notification_volume": 100, "save_to_dirs": true, "grid_save_to_dirs": true, "use_save_to_dirs_for_ui": false, "directories_filename_pattern": "[date]", "directories_max_prompt_words": 8, "auto_backcompat": true, "use_old_emphasis_implementation": false, "use_old_karras_scheduler_sigmas": false, "no_dpmpp_sde_batch_determinism": false, "use_old_hires_fix_width_height": false, "dont_fix_second_order_samplers_schedule": false, "hires_fix_use_firstpass_conds": false, "use_old_scheduling": false, "use_downcasted_alpha_bar": false, "lora_functional": false, "extra_networks_show_hidden_directories": true, "extra_networks_dir_button_function": false, "extra_networks_hidden_models": "When searched", "extra_networks_default_multiplier": 1, "extra_networks_card_width": 0.0, "extra_networks_card_height": 0.0, "extra_networks_card_text_scale": 1, "extra_networks_card_show_desc": true, "extra_networks_card_order_field": "Path", "extra_networks_card_order": "Ascending", "extra_networks_tree_view_default_enabled": false, "extra_networks_add_text_separator": " ", "ui_extra_networks_tab_reorder": "", "textual_inversion_print_at_load": false, "textual_inversion_add_hashes_to_infotext": true, "sd_hypernetwork": "None", "sd_lora": "None", "lora_preferred_name": "Alias from file", "lora_add_hashes_to_infotext": true, "lora_show_all": false, "lora_hide_unknown_for_versions": [], "lora_in_memory_limit": 0, "lora_not_found_warning_console": false, "lora_not_found_gradio_warning": false, "cross_attention_optimization": "Automatic", "s_min_uncond": 0, "token_merging_ratio": 0, "token_merging_ratio_img2img": 0, "token_merging_ratio_hr": 0, "pad_cond_uncond": false, "pad_cond_uncond_v0": false, "persistent_cond_cache": true, "batch_cond_uncond": true, "fp8_storage": "Disable", "cache_fp16_weight": false, "hide_samplers": [], "eta_ddim": 0, "eta_ancestral": 1, "ddim_discretize": "uniform", "s_churn": 0, "s_tmin": 0, "s_tmax": 0, "s_noise": 1, "k_sched_type": "Automatic", "sigma_min": 0.0, "sigma_max": 0.0, "rho": 0.0, "eta_noise_seed_delta": 0, "always_discard_next_to_last_sigma": false, "sgm_noise_multiplier": false, "uni_pc_variant": "bh1", "uni_pc_skip_type": "time_uniform", "uni_pc_order": 3, "uni_pc_lower_order_final": true, "sd_noise_schedule": "Default", "sd_checkpoints_limit": 1, "sd_checkpoints_keep_in_cpu": true, "sd_checkpoint_cache": 0, "sd_unet": "Automatic", "enable_quantization": false, "enable_emphasis": true, "enable_batch_seeds": true, "comma_padding_backtrack": 20, "upcast_attn": false, "randn_source": "GPU", "tiling": false, "hires_fix_refiner_pass": "second pass", "sdxl_crop_top": 0.0, "sdxl_crop_left": 0.0, "sdxl_refiner_low_aesthetic_score": 2.5, "sdxl_refiner_high_aesthetic_score": 6.0, "sd_vae_checkpoint_cache": 0, "sd_vae_overrides_per_model_preferences": true, "auto_vae_precision_bfloat16": false, "auto_vae_precision": true, "sd_vae_encode_method": "Full", "sd_vae_decode_method": "Full", "inpainting_mask_weight": 1, "initial_noise_multiplier": 1, "img2img_extra_noise": 0, "img2img_color_correction": false, "img2img_fix_steps": false, "img2img_background_color": "#ffffff", "img2img_editor_height": 720, "img2img_sketch_default_brush_color": "#ffffff", "img2img_inpaint_mask_brush_color": "#ffffff", "img2img_inpaint_sketch_default_brush_color": "#ffffff", "return_mask": false, "return_mask_composite": false, "img2img_batch_show_results_limit": 32, "overlay_inpaint": true, "return_grid": true, "do_not_show_images": false, "js_modal_lightbox": true, "js_modal_lightbox_initially_zoomed": true, "js_modal_lightbox_gamepad": false, "js_modal_lightbox_gamepad_repeat": 250.0, "sd_webui_modal_lightbox_icon_opacity": 1, "sd_webui_modal_lightbox_toolbar_opacity": 0.9, "gallery_height": "", "enable_pnginfo": true, "save_txt": false, "add_model_name_to_info": true, "add_model_hash_to_info": true, "add_vae_name_to_info": true, "add_vae_hash_to_info": true, "add_user_name_to_info": false, "add_version_to_infotext": true, "disable_weights_auto_swap": true, "infotext_skip_pasting": [], "infotext_styles": "Apply if any", "show_progressbar": true, "live_previews_enable": true, "live_previews_image_format": "png", "show_progress_grid": false, "show_progress_every_n_steps": -1, "show_progress_type": "Full", "live_preview_allow_lowvram_full": false, "live_preview_content": "Combined", "live_preview_refresh_period": 1000.0, "live_preview_fast_interrupt": true, "js_live_preview_in_modal_lightbox": true, "keyedit_precision_attention": 0.1, "keyedit_precision_extra": 0.05, "keyedit_delimiters": ".,\\/!?%^*;:{}=`~() ", "keyedit_delimiters_whitespace": [ "Tab", "Carriage Return", "Line Feed" ], "keyedit_move": true, "disable_token_counters": false, "extra_options_txt2img": [], "extra_options_img2img": [], "extra_options_cols": 1, "extra_options_accordion": false, "compact_prompt_box": false, "samplers_in_dropdown": true, "dimensions_and_batch_together": true, "sd_checkpoint_dropdown_use_short": false, "hires_fix_show_sampler": false, "hires_fix_show_prompts": false, "txt2img_settings_accordion": false, "img2img_settings_accordion": false, "interrupt_after_current": true, "localization": "None", "quicksettings_list": [ "sd_model_checkpoint", "sd_vae", "CLIP_stop_at_last_layers" ], "ui_tab_order": [], "hidden_tabs": [], "ui_reorder_list": [], "gradio_theme": "Default", "gradio_themes_cache": true, "show_progress_in_title": true, "send_seed": true, "send_size": true, "api_enable_requests": true, "api_forbid_local_requests": true, "api_useragent": "", "auto_launch_browser": "Local", "enable_console_prompts": false, "show_warnings": false, "show_gradio_deprecation_warnings": true, "memmon_poll_rate": 8, "samples_log_stdout": false, "multiple_tqdm": true, "enable_upscale_progressbar": true, "print_hypernet_extra": false, "list_hidden_files": true, "disable_mmap_load_safetensors": false, "hide_ldm_prints": true, "dump_stacks_on_signal": false, "face_restoration": false, "face_restoration_model": "CodeFormer", "code_former_weight": 0.5, "face_restoration_unload": false, "postprocessing_enable_in_main_ui": [], "postprocessing_operation_order": [], "upscaling_max_images_in_cache": 5, "postprocessing_existing_caption_action": "Ignore", "ESRGAN_tile": 192, "ESRGAN_tile_overlap": 8, "realesrgan_enabled_models": [ "R-ESRGAN 4x+", "R-ESRGAN 4x+ Anime6B" ], "dat_enabled_models": [ "DAT x2", "DAT x3", "DAT x4" ], "DAT_tile": 192, "DAT_tile_overlap": 8, "unload_models_when_training": false, "pin_memory": false, "save_optimizer_state": false, "save_training_settings_to_txt": true, "dataset_filename_word_regex": "", "dataset_filename_join_string": " ", "training_image_repeats_per_epoch": 1, "training_write_csv_every": 500.0, "training_xattention_optimizations": false, "training_enable_tensorboard": false, "training_tensorboard_save_images": false, "training_tensorboard_flush_every": 120.0, "canvas_hotkey_zoom": "Alt", "canvas_hotkey_adjust": "Ctrl", "canvas_hotkey_shrink_brush": "Q", "canvas_hotkey_grow_brush": "W", "canvas_hotkey_move": "F", "canvas_hotkey_fullscreen": "S", "canvas_hotkey_reset": "R", "canvas_hotkey_overlap": "O", "canvas_show_tooltip": true, "canvas_auto_expand": true, "canvas_blur_prompt": false, "canvas_disabled_functions": [ "Overlap" ], "interrogate_keep_models_in_memory": false, "interrogate_return_ranks": false, "interrogate_clip_num_beams": 1, "interrogate_clip_min_length": 24, "interrogate_clip_max_length": 48, "interrogate_clip_dict_limit": 1500.0, "interrogate_clip_skip_categories": [], "interrogate_deepbooru_score_threshold": 0.5, "deepbooru_sort_alpha": true, "deepbooru_use_spaces": true, "deepbooru_escape": true, "deepbooru_filter_tags": "", "control_net_inpaint_blur_sigma": 7, "controlnet_ignore_noninpaint_mask": false, "controlnet_clip_detector_on_cpu": false, "ad_max_models": 2, "ad_extra_models_dir": "D:\\stable-diffusion-webui\\models", "ad_save_previews": false, "ad_save_images_before": false, "ad_only_seleted_scripts": true, "ad_script_names": "dynamic_prompting,dynamic_thresholding,wildcard_recursive,wildcards,lora_block_weight,negpip", "ad_bbox_sortby": "None", "ad_same_seed_for_each_tap": false, "tac_tagFile": "danbooru.csv", "tac_active": true, "tac_activeIn.txt2img": true, "tac_activeIn.img2img": true, "tac_activeIn.negativePrompts": true, "tac_activeIn.thirdParty": true, "tac_activeIn.modelList": "", "tac_activeIn.modelListMode": "Blacklist", "tac_slidingPopup": true, "tac_maxResults": 5, "tac_showAllResults": false, "tac_resultStepLength": 100, "tac_delayTime": 100, "tac_useWildcards": true, "tac_sortWildcardResults": true, "tac_wildcardExclusionList": "", "tac_skipWildcardRefresh": false, "tac_useEmbeddings": true, "tac_includeEmbeddingsInNormalResults": false, "tac_useHypernetworks": true, "tac_useLoras": true, "tac_useLycos": true, "tac_useLoraPrefixForLycos": true, "tac_showWikiLinks": false, "tac_showExtraNetworkPreviews": true, "tac_modelSortOrder": "Name", "tac_useStyleVars": false, "tac_replaceUnderscores": true, "tac_escapeParentheses": true, "tac_appendComma": true, "tac_appendSpace": true, "tac_alwaysSpaceAtEnd": true, "tac_modelKeywordCompletion": "Never", "tac_modelKeywordLocation": "Start of prompt", "tac_wildcardCompletionMode": "To next folder level", "tac_alias.searchByAlias": true, "tac_alias.onlyShowAlias": false, "tac_translation.translationFile": "None", "tac_translation.oldFormat": false, "tac_translation.searchByTranslation": true, "tac_translation.liveTranslation": false, "tac_extra.extraFile": "extra-quality-tags.csv", "tac_extra.addMode": "Insert before", "tac_chantFile": "demo-chants.json", "tac_keymap": "{\n \"MoveUp\": \"ArrowUp\",\n \"MoveDown\": \"ArrowDown\",\n \"JumpUp\": \"PageUp\",\n \"JumpDown\": \"PageDown\",\n \"JumpToStart\": \"Home\",\n \"JumpToEnd\": \"End\",\n \"ChooseSelected\": \"Enter\",\n \"ChooseFirstOrSelected\": \"Tab\",\n \"Close\": \"Escape\"\n}", "tac_colormap": "{\n \"danbooru\": {\n \"-1\": [\"red\", \"maroon\"],\n \"0\": [\"lightblue\", \"dodgerblue\"],\n \"1\": [\"indianred\", \"firebrick\"],\n \"3\": [\"violet\", \"darkorchid\"],\n \"4\": [\"lightgreen\", \"darkgreen\"],\n \"5\": [\"orange\", \"darkorange\"]\n },\n \"e621\": {\n \"-1\": [\"red\", \"maroon\"],\n \"0\": [\"lightblue\", \"dodgerblue\"],\n \"1\": [\"gold\", \"goldenrod\"],\n \"3\": [\"violet\", \"darkorchid\"],\n \"4\": [\"lightgreen\", \"darkgreen\"],\n \"5\": [\"tomato\", \"darksalmon\"],\n \"6\": [\"red\", \"maroon\"],\n \"7\": [\"whitesmoke\", \"black\"],\n \"8\": [\"seagreen\", \"darkseagreen\"]\n }\n}", "tac_refreshTempFiles": "Refresh TAC temp files", "style_vars_enabled": true, "style_vars_random": false, "style_vars_hires": false, "style_vars_linebreaks": true, "style_vars_info": true, "polotno_api_key": "bHEpG9Rp0Nq9XrLcwFNu", "canvas_editor_default_width": 1024, "canvas_editor_default_height": 1024, "animatediff_model_path": "", "animatediff_optimize_gif_palette": false, "animatediff_optimize_gif_gifsicle": false, "animatediff_mp4_crf": 23, "animatediff_mp4_preset": "", "animatediff_mp4_tune": "", "animatediff_webp_quality": 80, "animatediff_webp_lossless": false, "animatediff_save_to_custom": false, "animatediff_xformers": "Optimize attention layers with xformers", "animatediff_disable_lcm": false, "animatediff_s3_enable": false, "animatediff_s3_host": "", "animatediff_s3_port": "", "animatediff_s3_access_key": "", "animatediff_s3_secret_key": "", "animatediff_s3_storge_bucket": "", "arh_javascript_aspect_ratio_show": true, "arh_javascript_aspect_ratio": "1:1, 3:2, 4:3, 5:4, 16:9", "arh_ui_javascript_selection_method": "Aspect Ratios Dropdown", "arh_hide_accordion_by_default": true, "arh_expand_by_default": false, "arh_ui_component_order_key": "MaxDimensionScaler, MinDimensionScaler, PredefinedAspectRatioButtons, PredefinedPercentageButtons", "arh_show_max_width_or_height": false, "arh_max_width_or_height": 1024.0, "arh_show_min_width_or_height": false, "arh_min_width_or_height": 1024.0, "arh_show_predefined_aspect_ratios": false, "arh_predefined_aspect_ratio_use_max_dim": false, "arh_predefined_aspect_ratios": "1:1, 4:3, 16:9, 9:16, 21:9", "arh_show_predefined_percentages": false, "arh_predefined_percentages": "25, 50, 75, 125, 150, 175, 200", "arh_predefined_percentages_display_key": "Incremental/decremental percentage (-50%, +50%)", "freeu_png_info_auto_enable": true, "inpaint_anything_save_folder": "inpaint-anything", "inpaint_anything_sam_oncpu": false, "inpaint_anything_offline_inpainting": false, "inpaint_anything_padding_fill": 127, "inpain_anything_sam_models_dir": "", "mm_max_models": 3, "mm_debugs": [ "elemental merge" ], "mm_save_model": [ "safetensors", "fp16", "prune", "overwrite" ], "mm_save_model_filename": "modelmixer-[hash]", "mm_use_extra_elements": true, "mm_use_old_finetune": false, "mm_use_unet_partial_update": true, "mm_laplib": "lap", "mm_use_fast_weighted_sum": true, "mm_use_precalculate_hash": false, "mm_use_model_dl": false, "mm_default_config_lock": false, "mm_civitai_api_key": "", "replacer_use_first_positive_prompt_from_examples": true, "replacer_use_first_negative_prompt_from_examples": true, "replacer_hide_segment_anything_accordions": false, "replacer_always_unload_models": "Automatic", "replacer_detection_prompt_examples": "", "replacer_avoidance_prompt_examples": "", "replacer_positive_prompt_examples": "", "replacer_negative_prompt_examples": "", "replacer_hf_positive_prompt_suffix_examples": "", "replacer_examples_per_page_for_detection_prompt": 10, "replacer_examples_per_page_for_avoidance_prompt": 10, "replacer_examples_per_page_for_positive_prompt": 10, "replacer_examples_per_page_for_negative_prompt": 10, "replacer_save_dir": "outputs\\replacer", "model_toolkit_fix_clip": false, "model_toolkit_autoprune": false, "dp_ignore_whitespace": false, "dp_write_raw_template": false, "dp_write_prompts_to_file": false, "dp_parser_variant_start": "{", "dp_parser_variant_end": "}", "dp_parser_wildcard_wrap": "__", "dp_limit_jinja_prompts": false, "dp_auto_purge_cache": false, "dp_wildcard_manager_no_dedupe": false, "dp_wildcard_manager_no_sort": false, "dp_wildcard_manager_shuffle": false, "dp_magicprompt_default_model": "Gustavosta/MagicPrompt-Stable-Diffusion", "dp_magicprompt_batch_size": 1, "disabled_extensions": [ "extension-style-vars", "sd-webui-freeu", "sd-webui-replacer", "ultimate-upscale-for-automatic1111" ], "disable_all_extensions": "none", "sd_vae": "sdxl_vae.safetensors", "CLIP_stop_at_last_layers": 1 }, "Startup": { "total": 2.6610946655273438, "records": { "app reload callback": 0.0, "scripts unloaded callback": 0.0, "set samplers": 0.0, "list extensions": 0.011959075927734375, "restore config state file": 0.0, "list SD models": 0.21428275108337402, "list localizations": 0.0009968280792236328, "load scripts/custom_code.py": 0.0029897689819335938, "load scripts/img2imgalt.py": 0.0, "load scripts/loopback.py": 0.0, "load scripts/outpainting_mk_2.py": 0.0009970664978027344, "load scripts/poor_mans_outpainting.py": 0.0, "load scripts/postprocessing_caption.py": 0.0, "load scripts/postprocessing_codeformer.py": 0.0, "load scripts/postprocessing_create_flipped_copies.py": 0.0, "load scripts/postprocessing_focal_crop.py": 0.0, "load scripts/postprocessing_gfpgan.py": 0.0, "load scripts/postprocessing_split_oversized.py": 0.0, "load scripts/postprocessing_upscale.py": 0.0, "load scripts/processing_autosized_crop.py": 0.0, "load scripts/prompt_matrix.py": 0.0, "load scripts/prompts_from_file.py": 0.0009965896606445312, "load scripts/sd_upscale.py": 0.0, "load scripts/xyz_grid.py": 0.0, "load scripts/ldsr_model.py": 0.03388643264770508, "load scripts/lora_script.py": 0.05880308151245117, "load scripts/scunet_model.py": 0.009966611862182617, "load scripts/swinir_model.py": 0.009966850280761719, "load scripts/hotkey_config.py": 0.0, "load scripts/extra_options_section.py": 0.0, "load scripts/legacy_preprocessors.py": 0.0, "load scripts/preprocessor_inpaint.py": 0.0, "load scripts/preprocessor_marigold.py": 0.0009965896606445312, "load scripts/preprocessor_normalbae.py": 0.0, "load scripts/preprocessor_recolor.py": 0.0, "load scripts/forge_reference.py": 0.0, "load scripts/preprocessor_revision.py": 0.0, "load scripts/preprocessor_tile.py": 0.0, "load scripts/forge_controllllite.py": 0.0, "load scripts/controlnet.py": 0.06777334213256836, "load scripts/xyz_grid_support.py": 0.0, "load scripts/sd_forge_controlnet_example.py": 0.0, "load scripts/forge_freeu.py": 0.0, "load scripts/forge_hypertile.py": 0.0, "load scripts/forge_ipadapter.py": 0.0009968280792236328, "load scripts/kohya_hrfix.py": 0.0, "load scripts/forge_photomaker.py": 0.0, "load scripts/forge_sag.py": 0.0, "load scripts/forge_stylealign.py": 0.0, "load scripts/forge_svd.py": 0.009966611862182617, "load scripts/forge_z123.py": 0.009966611862182617, "load scripts/soft_inpainting.py": 0.0009965896606445312, "load scripts/!adetailer.py": 0.5700924396514893, "load scripts/model_keyword_support.py": 0.0009965896606445312, "load scripts/shared_paths.py": 0.0, "load scripts/tag_autocomplete_helper.py": 0.07175993919372559, "load scripts/frame2frame.py": 0.0, "load scripts/sd_tag_batch.py": 0.0, "load scripts/main.py": 0.019933223724365234, "load scripts/dynamic_prompting.py": 0.0, "load scripts/system-info.py": 0.020930051803588867, "load scripts/animatediff.py": 0.03886985778808594, "load scripts/animatediff_cn.py": 0.0, "load scripts/animatediff_i2ibatch.py": 0.0, "load scripts/animatediff_infotext.py": 0.0009965896606445312, "load scripts/animatediff_infv2v.py": 0.0, "load scripts/animatediff_latent.py": 0.0, "load scripts/animatediff_lcm.py": 0.0, "load scripts/animatediff_logger.py": 0.0, "load scripts/animatediff_lora.py": 0.0, "load scripts/animatediff_mm.py": 0.0, "load scripts/animatediff_output.py": 0.0009965896606445312, "load scripts/animatediff_prompt.py": 0.0, "load scripts/animatediff_ui.py": 0.0, "load scripts/sd_webui_aspect_ratio_helper.py": 0.0, "load scripts/cads.py": 0.009966850280761719, "load scripts/inpaint_anything.py": 0.019933223724365234, "load scripts/model_mixer.py": 0.05880331993103027, "load scripts/patches.py": 0.0, "load scripts/vxa.py": 0.0009965896606445312, "load scripts/mos_processing.py": 0.0, "load scripts/mosaic.py": 0.008970022201538086, "load scripts/stablesr.py": 0.0009965896606445312, "load scripts/tilediffusion.py": 0.0, "load scripts/tilevae.py": 0.0, "load scripts/toolkit_gui.py": 0.030896663665771484, "load scripts/api.py": 0.01096343994140625, "load scripts/postprocessing_rembg.py": 0.0, "load scripts/refiner.py": 0.0, "load scripts/seed.py": 0.0, "load scripts": 1.0744049549102783, "reload script modules": 0.01793980598449707, "load upscalers": 0.0009968280792236328, "refresh VAE": 0.11262297630310059, "refresh textual inversion templates": 0.0009965896606445312, "scripts list_optimizers": 0.0, "scripts list_unets": 0.0, "reload hypernetworks": 0.0009968280792236328, "initialize extra networks": 0.0, "scripts before_ui_callback": 0.0009965896606445312, "create ui": 0.8979952335357666, "gradio launch": 0.23321962356567383, "add APIs": 0.0019936561584472656, "app_started_callback/lora_script.py": 0.0, "app_started_callback/!adetailer.py": 0.0, "app_started_callback/tag_autocomplete_helper.py": 0.0009965896606445312, "app_started_callback/system-info.py": 0.0019931793212890625, "app_started_callback/model_mixer.py": 0.08870315551757812, "app_started_callback/api.py": 0.0, "app_started_callback": 0.09169292449951172 } }, "Packages": [ "absl-py==2.1.0", "accelerate==0.21.0", "addict==2.4.0", "aenum==3.1.15", "aiofiles==23.2.1", "aiohttp==3.9.3", "aiosignal==1.3.1", "albumentations==1.3.1", "altair==5.2.0", "antlr4-python3-runtime==4.9.3", "anyio==3.7.1", "async-timeout==4.0.3", "attrs==23.2.0", "av==11.0.0", "basicsr==1.4.2", "bidict==0.22.1", "blendmodes==2022", "certifi==2024.2.2", "cffi==1.16.0", "chardet==5.2.0", "charset-normalizer==3.3.2", "clean-fid==0.1.35", "click==8.1.7", "clip==1.0", "colorama==0.4.6", "coloredlogs==15.0.1", "colorlog==6.8.2", "contourpy==1.2.0", "controlnet-aux==0.0.3", "cssselect2==0.7.0", "cycler==0.12.1", "cython==3.0.8", "decorator==4.0.11", "deprecation==2.1.0", "depth-anything==2024.1.22.0", "diffusers==0.25.0", "dynamicprompts==0.30.4", "easydict==1.11", "einops==0.4.1", "embreex==2.17.7.post4", "exceptiongroup==1.2.0", "facexlib==0.3.0", "fastapi==0.94.0", "ffmpy==0.3.1", "filelock==3.13.1", "filterpy==1.4.5", "flask-cors==4.0.0", "flask-socketio==5.3.6", "flask==2.2.3", "flaskwebgui==0.3.5", "flatbuffers==23.5.26", "fonttools==4.47.2", "frozenlist==1.4.1", "fsspec==2024.2.0", "ftfy==6.1.3", "future==0.18.3", "fvcore==0.1.5.post20221221", "gitdb==4.0.11", "gitpython==3.1.32", "gradio-client==0.5.0", "gradio==3.41.2", "grpcio==1.60.1", "h11==0.12.0", "handrefinerportable==2024.1.18.0", "httpcore==0.15.0", "httpx==0.24.1", "huggingface-hub==0.20.3", "humanfriendly==10.0", "idna==3.6", "imageio-ffmpeg==0.4.9", "imageio==2.33.1", "importlib-metadata==7.0.1", "importlib-resources==6.1.1", "inflection==0.5.1", "insightface==0.7.3", "iopath==0.1.9", "itsdangerous==2.1.2", "jinja2==3.1.3", "joblib==1.3.2", "jsonmerge==1.8.0", "jsonschema-specifications==2023.12.1", "jsonschema==4.21.1", "kiwisolver==1.4.5", "kornia==0.6.7", "lama-cleaner==1.2.5", "lark==1.1.2", "lazy-loader==0.3", "lightning-utilities==0.10.1", "llvmlite==0.42.0", "lmdb==1.4.1", "loguru==0.7.2", "lxml==5.1.0", "mapbox-earcut==1.0.1", "markdown-it-py==3.0.0", "markdown==3.5.2", "markupsafe==2.1.5", "matplotlib==3.8.2", "mdurl==0.1.2", "mediapipe==0.10.9", "moviepy==0.2.3.2", "mpmath==1.3.0", "multidict==6.0.5", "networkx==3.2.1", "numba==0.59.0", "numpy==1.26.2", "omegaconf==2.2.3", "onnx==1.15.0", "onnxruntime==1.17.0", "open-clip-torch==2.20.0", "opencv-contrib-python==4.9.0.80", "opencv-python-headless==4.9.0.80", "opencv-python==4.9.0.80", "orjson==3.9.13", "packaging==23.2", "pandas==2.2.0", "piexif==1.1.3", "pillow==9.5.0", "pip==22.2.1", "platformdirs==4.2.0", "pooch==1.8.0", "portalocker==2.8.2", "prettytable==3.9.0", "protobuf==3.20.3", "psutil==5.9.5", "py-cpuinfo==9.0.0", "pycollada==0.8", "pycparser==2.21", "pydantic==1.10.14", "pydub==0.25.1", "pygments==2.17.2", "pymatting==1.1.12", "pyparsing==3.1.1", "pyreadline3==3.4.1", "python-dateutil==2.8.2", "python-engineio==4.9.0", "python-multipart==0.0.7", "python-socketio==5.11.1", "pytorch-lightning==1.9.4", "pytz==2024.1", "pywavelets==1.5.0", "pywin32==306", "pyyaml==6.0.1", "qudida==0.0.4", "referencing==0.33.0", "regex==2023.12.25", "rembg==2.0.50", "reportlab==4.0.9", "requests==2.31.0", "resize-right==0.0.2", "rich==13.7.0", "rpds-py==0.17.1", "rtree==1.2.0", "safetensors==0.4.2", "scikit-image==0.21.0", "scikit-learn==1.4.0", "scipy==1.12.0", "seaborn==0.13.2", "segment-anything==1.0", "semantic-version==2.10.0", "send2trash==1.8.2", "sentencepiece==0.1.99", "setuptools==63.2.0", "shapely==2.0.2", "simple-websocket==1.0.0", "six==1.16.0", "smmap==5.0.1", "sniffio==1.3.0", "sounddevice==0.4.6", "spandrel==0.1.6", "starlette==0.26.1", "svg.path==6.3", "svglib==1.5.1", "sympy==1.12", "tabulate==0.9.0", "tb-nightly==2.16.0a20240205", "tensorboard-data-server==0.7.2", "termcolor==2.4.0", "tf-keras-nightly==2.16.0.dev2024020510", "thop==0.1.1.post2209072238", "threadpoolctl==3.2.0", "tifffile==2024.1.30", "timm==0.9.12", "tinycss2==1.2.1", "tokenizers==0.13.3", "tomesd==0.1.3", "tomli==2.0.1", "toolz==0.12.1", "torch==2.1.2+cu121", "torchdiffeq==0.2.3", "torchmetrics==1.3.0.post0", "torchsde==0.2.6", "torchvision==0.16.2+cu121", "tqdm==4.66.1", "trampoline==0.1.2", "transformers==4.30.2", "trimesh==4.1.3", "typing-extensions==4.9.0", "tzdata==2023.4", "ultralytics==8.1.9", "urllib3==2.2.0", "uvicorn==0.27.0.post1", "vhacdx==0.0.5", "wcwidth==0.2.13", "webencodings==0.5.1", "websockets==11.0.3", "werkzeug==2.2.2", "whichcraft==0.6.1", "win32-setctime==1.1.0", "wsproto==1.2.0", "xxhash==3.4.1", "yacs==0.1.8", "yapf==0.40.2", "yarl==1.9.4", "zipp==3.17.0" ] } ```

lllyasviel commented 4 months ago

Note that photomaker is a special control that need you to add the trigger word "photomaker"

Your prompt should be like "a photo of photomaker"

ferrerojoao commented 4 months ago

clipvision(photomaker) this preprocessor didn't work. I couldn't find the model's filename.

CCpt5 commented 4 months ago

clipvision(photomaker) this preprocessor didn't work. I couldn't find the model's filename.

Have you downloaded Photomaker-v1.bin from here? https://huggingface.co/TencentARC/PhotoMaker/tree/main

ferrerojoao commented 4 months ago

clipvision(photomaker) this preprocessor didn't work. I couldn't find the model's filename.

Have you downloaded Photomaker-v1.bin from here? https://huggingface.co/TencentARC/PhotoMaker/tree/main

yes. It is a cn model,not a preprocessor.

Lyntai commented 4 months ago

I have the same issue. Photomaker CN doesn't seem to work at all. I used "a photo of photomaker" prompt and Photomaker-v1.bin CN. I have this error on cmd when using it, doesn't happen with other CNs:

"Warning torch.load doesn't support weights_only on this pytorch version, loading unsafely."

fm3at commented 4 months ago

Use SDXL checkpoints, not 1.5

k8kiss commented 4 months ago

Also not working for me, the image does not change after enabling photomaker with photomaker bin model plus Photomaker in the prompt, same output

jipsita commented 4 months ago

I think there is a problem, when using the required "a photo of photomaker" if a "," is just next to it for example: "a photo of photomaker, a woman in astronaut suit" that coma is ruining the activation.

Necro-mancer commented 4 months ago

I also noticed that photomaker does work when the prompt is only "a photo of photomaker". Additional words disable the effect.

Photomaker github recommends a different trigger word. I'm AFK but maybe someone can test to see if changes something.

(From their github)

Note that the trigger word img must follow the class word for personalization

prompt = "a half-body portrait of a man img wearing the sunglasses in Iron man suit, best quality" negative_prompt = "(asymmetry, worst quality, low quality, illustration, 3d, 2d, painting, cartoons, sketch), open mouth, grayscale" generator = torch.Generator(device=device).manual_seed(42) images = pipe( prompt=prompt, input_id_images=input_id_images, negative_prompt=negative_prompt, num_images_per_prompt=1, num_inference_steps=num_steps, start_merge_step=10, generator=generator, ).images[0] gen_images.save('out_photomaker.png')

Afterswish007 commented 4 months ago

clipvision(photomaker) this preprocessor didn't work. I couldn't find the model's filename.

Have you downloaded Photomaker-v1.bin from here? https://huggingface.co/TencentARC/PhotoMaker/tree/main

Thanks.... and where do we put this file?

jipsita commented 4 months ago

clipvision(photomaker) this preprocessor didn't work. I couldn't find the model's filename.

Have you downloaded Photomaker-v1.bin from here? https://huggingface.co/TencentARC/PhotoMaker/tree/main

Thanks.... and where do we put this file?

Inside the models/controlnet folder

jipsita commented 4 months ago

I also noticed that photomaker does work when the prompt is only "a photo of photomaker". Additional words disable the effect.

Photomaker github recommends a different trigger word. I'm AFK but maybe someone can test to see if changes something.

(From their github)

Note that the trigger word img must follow the class word for personalization

prompt = "a half-body portrait of a man img wearing the sunglasses in Iron man suit, best quality" negative_prompt = "(asymmetry, worst quality, low quality, illustration, 3d, 2d, painting, cartoons, sketch), open mouth, grayscale" generator = torch.Generator(device=device).manual_seed(42) images = pipe( prompt=prompt, input_id_images=input_id_images, negative_prompt=negative_prompt, num_images_per_prompt=1, num_inference_steps=num_steps, start_merge_step=10, generator=generator, ).images[0] gen_images.save('out_photomaker.png')

The "img" alone didn't work, "photomaker" alone didn't work, only "a photo of photomaker" works, at least in my test.

MNeMoNiCuZ commented 4 months ago

So, after some experimentation, I found that:

  1. It only works with SDXL models (as it's meant to, but it's not clearly labeled as such in the program).
  2. Adjusting the control net weight does very little (this is fine).
  3. You need to use the trigger word "photomaker" in the prompt.
  4. You can't have a comma right after the photomaker word. Sometimes I wasn't allowed to have a space then comma after. But sometimes I was. Not quite sure.

Example: These work:

a photo of mad scientist photomaker
a photo of mad scientist photomaker wearing a red jacket
a photo of mad scientist photomaker , wearing a green jacket
a photo of mad scientist photomaker , masterpiece, best best quality, high quality

These don't work:

a photo of mad scientist photomaker, wearing a red jacket
a photo of mad scientist photomaker, masterpiece, best best quality, high quality

@lllyasviel FYI

Ehtz commented 4 months ago

So, after some experimentation, I found that:

  1. It only works with SDXL models (as it's meant to, but it's not clearly labeled as such in the program).
  2. Adjusting the control net weight does very little (this is fine).
  3. You need to use the trigger word "photomaker" in the prompt.
  4. You can't have a comma right after the photomaker word. Sometimes I wasn't allowed to have a space then comma after. But sometimes I was. Not quite sure.

Example: These work:

a photo of mad scientist photomaker
a photo of mad scientist photomaker wearing a red jacket
a photo of mad scientist photomaker , wearing a green jacket
a photo of mad scientist photomaker , masterpiece, best best quality, high quality

These don't work:

a photo of mad scientist photomaker, wearing a red jacket
a photo of mad scientist photomaker, masterpiece, best best quality, high quality

@lllyasviel FYI

Still doesn't work very well probably better in comfyui

sdcarterchen commented 4 months ago

So, after some experimentation, I found that:

  1. It only works with SDXL models (as it's meant to, but it's not clearly labeled as such in the program).
  2. Adjusting the control net weight does very little (this is fine).
  3. You need to use the trigger word "photomaker" in the prompt.
  4. You can't have a comma right after the photomaker word. Sometimes I wasn't allowed to have a space then comma after. But sometimes I was. Not quite sure.

Example: These work:

a photo of mad scientist photomaker
a photo of mad scientist photomaker wearing a red jacket
a photo of mad scientist photomaker , wearing a green jacket
a photo of mad scientist photomaker , masterpiece, best best quality, high quality

These don't work:

a photo of mad scientist photomaker, wearing a red jacket
a photo of mad scientist photomaker, masterpiece, best best quality, high quality

@lllyasviel FYI

Still doesn't work very well probably better in comfyui

"A photo of a woman wearing a jacket img photomaker img", I used these prompt words, and the total number and total length of all prompt words cannot be too long. You can try to reduce the number or start from the length.

sdcarterchen commented 4 months ago

a photo of woman img photomaker wearing a jacket img,photo inset,solo,brown hair,bag,smile,looking at viewer,long hair,suit,skirt,formal,brown eyes,photo background,outdoors,jacket,ground vehicle,shirt,office lady,Cinematic Lighting,,

MatthiasStockert commented 3 months ago

Also working: the photo was shot on Kodak Ektachrome 64 film with a Nikon F SLR camera and a Nikkor f/1.4 50mm lens, shutter speed 1/250s, ISO 64. It shows a man photomaker wearing a red jacket, in the forest

It seems to me that the trigger word "photomaker" just needs a space behind it, no matter what follows afterwards. "img" is not needed as a trigger (at least in my tries).

Adahm83 commented 3 months ago

I've noticed that it does not work when you hit "enter" after trigger word "photomaker" (if case you want to continue typing prompts in the new line). Even when there is no more prompts in new line.

So, it seem like only "space" can be used after trigger word "photomaker".

mr-september commented 2 months ago

Did some quick testing as well, findings:

  1. As above, space after photomaker is crucial. If you don't want any further prompts, add a space then comma.
  2. Resize + Fill tends to work best.
  3. Input photomaker composition, expression, pose (if any) has a strong influence on the output. A separate controlnet pose might be useful. Trying to change it with just prompts doesn't work well.
  4. Race words like "asian" will overpower photomaker input and output very distinctive-generic SD faces.
  5. "Full" SDXL checkpoints adhere much better than Lightning (and possibly Distilled, LCM as well, didn't test those)
  6. Can't handle too many prompts or too long. Best to generate something close enough and inpaint the rest.
CasualDev242 commented 1 month ago

I finally got it to work. I took a screengrab from the movie "A Scanner Darkly" (rotoscoped real actors).

Photos of params used are attached. I didn't have any luck until I set cfg scale low (3.5), no independent control image (I'm using img-to-img), and the only denoise strength that would work is 0.65.

photomaker_works - Copy photomaker_settings - Copy