search

vladmandic / automatic

SD.Next: Advanced Implementation of Stable Diffusion and other Diffusion-based generative image models
https://github.com/vladmandic/automatic
GNU Affero General Public License v3.0
5.48k stars 400 forks source link

[Issue]: ERROR Failed loading refiner in --backend diffusers mode #2243

Closed ShmuelRonen closed 11 months ago

ShmuelRonen commented 11 months ago

Issue Description

After --upgrade to: updated=2023-09-20 hash=89ba8e3c I got this message:

05:34:22-937130 ERROR Failed loading refiner: models\Diffusers\models--stabilityai--stable-diffusion-xl-refiner-1.0\snapshots\93b080bbdc8e fbeb862e29e15316cff53f9bef86 Pipeline <class

I try to new install the refiner but with same resoults.

Version Platform Description

05:31:30-526811 INFO Starting SD.Next 05:31:30-535812 INFO Python 3.10.7 on Windows 05:31:30-861811 INFO Version: app=sd.next updated=2023-09-20 hash=89ba8e3c url=https://github.com/vladmandic/automatic/tree/master 05:31:31-579810 INFO Platform: arch=AMD64 cpu=AMD64 Family 25 Model 68 Stepping 1, AuthenticAMD system=Windows release=Windows-10-10.0.19045-SP0 python=3.10.7 05:31:31-605814

Relevant log output

W:\V\automatic>webui.bat --backend diffusers --medvram --experimental --upgrade
Using VENV: W:\V\automatic\venv
05:31:30-526811 INFO     Starting SD.Next
05:31:30-535812 INFO     Python 3.10.7 on Windows
05:31:30-861811 INFO     Version: app=sd.next updated=2023-09-20 hash=89ba8e3c
                         url=https://github.com/vladmandic/automatic/tree/master
05:31:31-579810 INFO     Platform: arch=AMD64 cpu=AMD64 Family 25 Model 68 Stepping 1, AuthenticAMD system=Windows
                         release=Windows-10-10.0.19045-SP0 python=3.10.7
05:31:31-605814 INFO     nVidia CUDA toolkit detected
05:31:31-788811 INFO     Verifying requirements
05:31:31-813813 INFO     Verifying packages
05:31:31-819815 INFO     Verifying repositories
05:31:36-810815 INFO     Verifying submodules
05:33:10-717691 ERROR    Error running extension installer: W:\V\automatic\extensions\animator_extension\install.py
05:33:14-211691 ERROR    Error running git: extensions\Mask2Background / pull origin None --rebase --force
05:33:14-216691 ERROR    Local changes detected: check log for details: W:\V\automatic\sdnext.log
05:33:45-073535 ERROR    Error running extension installer: W:\V\automatic\extensions\sd-webui-roop\install.py
05:33:45-246537 INFO     Extensions enabled: ['clip-interrogator-ext', 'LDSR', 'Lora', 'ScuNET',
                         'sd-extension-system-info', 'stable-diffusion-webui-rembg', 'SwinIR', 'adetailer',
                         'animator_extension', 'deforum-for-automatic1111-webui',
                         'infinite-zoom-automatic1111-webui', 'Mask2Background', 'sd-face-editor',
                         'sd-webui-aspect-ratio-helper', 'sd-webui-infinite-image-browsing', 'sd-webui-roop']
05:33:45-274536 INFO     Verifying packages
05:33:45-279536 INFO     Updating Wiki
05:33:46-273537 WARNING  Setup complete with errors: 3
05:33:46-278537 WARNING  See log file for more details: W:\V\automatic\sdnext.log
05:33:46-291538 INFO     Extension preload: {'extensions-builtin': 0.01, 'extensions': 0.0}
05:33:46-301539 INFO     Command line args: ['--backend', 'diffusers', '--medvram', '--experimental', '--upgrade']
                         medvram=True backend=diffusers upgrade=True experimental=True
05:33:54-630536 INFO     Engine: backend=Backend.DIFFUSERS compute=cuda mode=no_grad device=cuda
05:33:54-744537 INFO     Device: device=NVIDIA GeForce RTX 3090 n=1 arch=compute_37 cap=(8, 6) cuda=11.8 cudnn=8700
                         driver=536.23
05:33:55-592536 INFO     Available VAEs: models\VAE items=3
05:33:55-600536 INFO     Diffusers disabling uncompatible extensions: []
05:33:55-613536 INFO     Available models: ..\..\stable-diffusion-webui\models\Stable-diffusion items=23 time=0.01s
05:34:02-331764 INFO     Extension: script='extensions\adetailer\scripts\!adetailer.py' [-] ADetailer initialized.
                         version: 23.9.2, num models: 9
05:34:04-544763 INFO     Extensions time: 8.83s { clip-interrogator-ext=1.23s LDSR=0.07s Lora=0.36s
                         sd-extension-system-info=0.05s stable-diffusion-webui-rembg=0.74s SwinIR=0.06s
                         adetailer=4.08s animator_extension=0.14s deforum-for-automatic1111-webui=0.16s
                         infinite-zoom-automatic1111-webui=0.12s Mask2Background=0.07s sd-face-editor=1.01s
                         sd-webui-aspect-ratio-helper=0.13s sd-webui-infinite-image-browsing=0.11s
                         sd-webui-roop=0.40s ScuNET=0.05s }
05:34:04-826766 INFO     Loading UI theme: name=black-teal style=Auto
05:34:05-201768 INFO     Themes: builtin=6 default=5 external=54
05:34:08-639966 INFO     Local URL: http://127.0.0.1:7860/
05:34:08-648964 INFO     Initializing middleware
05:34:08-802962 INFO     Setting Torch parameters: device=cuda dtype=torch.float16 vae=torch.float16
                         unet=torch.float16 context=no_grad fp16=True bf16=False
05:34:20-960128 INFO     Loaded embeddings: loaded=0 skipped=0
05:34:20-971130 INFO     Model loaded in 12.17s { load=12.17s } native=1024
05:34:21-382132 INFO     Model load finished model: {'ram': {'used': 7.55, 'total': 31.24}, 'gpu': {'used': 1.39,
                         'total': 24.0}, 'retries': 0, 'oom': 0}
05:34:21-411130 INFO     Setting Torch parameters: device=cuda dtype=torch.float16 vae=torch.float16
                         unet=torch.float16 context=no_grad fp16=True bf16=False
Loading pipeline components...: 100%|██████████████████████████████████████████████████| 5/5 [00:01<00:00,  3.35it/s]
05:34:22-937130 ERROR    Failed loading refiner:
                         models\Diffusers\models--stabilityai--stable-diffusion-xl-refiner-1.0\snapshots\93b080bbdc8e
                         fbeb862e29e15316cff53f9bef86 Pipeline <class
                         'diffusers.pipelines.stable_diffusion_xl.pipeline_stable_diffusion_xl.StableDiffusionXLPipel
                         ine'> expected {'unet', 'tokenizer_2', 'text_encoder_2', 'text_encoder', 'tokenizer', 'vae',
                         'scheduler'}, but only {'unet', 'tokenizer_2', 'text_encoder_2', 'vae', 'scheduler'} were
                         passed.
05:34:22-999132 INFO     Startup time: 36.66s { torch=5.92s gradio=0.95s diffusers=0.73s libraries=1.64s
                         extensions=8.83s codeformer=0.07s upscalers=0.06s onchange=0.23s ui-txt2img=0.15s
                         ui-img2img=0.09s ui-settings=0.12s ui-extensions=2.82s ui-defaults=0.37s launch=0.20s
                         api=0.09s app-started=0.06s checkpoint=14.20s }
05:41:48-424214 INFO     Themes: builtin=6 default=5 external=54

Backend

Diffusers

Model

SD-XL

Acknowledgements

vladmandic commented 11 months ago

there is some information missing, please retry but add --debug flag as well for more verbose log.

ShmuelRonen commented 11 months ago

there is some information missing, please retry but add --debug flag as well for more verbose log.

W:\V\automatic>webui.bat --backend diffusers --medvram --experimental --debug --upgrade
Using VENV: W:\V\automatic\venv
09:15:49-316844 INFO     Starting SD.Next
09:15:49-325848 INFO     Python 3.10.7 on Windows
09:15:49-728845 INFO     Version: app=sd.next updated=2023-09-20 hash=89ba8e3c
                         url=https://github.com/vladmandic/automatic/tree/master
09:15:50-426847 INFO     Platform: arch=AMD64 cpu=AMD64 Family 25 Model 68 Stepping 1, AuthenticAMD system=Windows
                         release=Windows-10-10.0.19045-SP0 python=3.10.7
09:15:50-456846 DEBUG    Setting environment tuning
09:15:50-462845 DEBUG    Torch overrides: cuda=False rocm=False ipex=False diml=False openvino=False
09:15:50-478846 DEBUG    Torch allowed: cuda=True rocm=True ipex=True diml=True openvino=True
09:15:50-494847 INFO     nVidia CUDA toolkit detected
09:15:50-762845 INFO     Verifying requirements
09:15:50-783845 INFO     Verifying packages
09:15:50-789845 INFO     Verifying repositories
09:15:56-240844 INFO     Verifying submodules
09:16:11-504389 DEBUG    Installed packages: 253
09:16:11-510388 DEBUG    Extensions all: ['clip-interrogator-ext', 'LDSR', 'Lora', 'ScuNET',
                         'sd-extension-system-info', 'stable-diffusion-webui-rembg', 'SwinIR']
09:16:12-424388 DEBUG    Running extension installer:
                         W:\V\automatic\extensions-builtin\clip-interrogator-ext\install.py
09:16:30-519598 DEBUG    Running extension installer:
                         W:\V\automatic\extensions-builtin\sd-extension-system-info\install.py
09:16:32-007599 DEBUG    Running extension installer:
                         W:\V\automatic\extensions-builtin\stable-diffusion-webui-rembg\install.py
09:16:33-751100 DEBUG    Extensions all: ['adetailer', 'animator_extension', 'deforum-for-automatic1111-webui',
                         'infinite-zoom-automatic1111-webui', 'Mask2Background', 'sd-face-editor',
                         'sd-webui-aspect-ratio-helper', 'sd-webui-infinite-image-browsing', 'sd-webui-roop']
09:16:34-686099 DEBUG    Running extension installer: W:\V\automatic\extensions\adetailer\install.py
09:16:36-210566 DEBUG    Running extension installer: W:\V\automatic\extensions\animator_extension\install.py
09:17:37-895553 ERROR    Error running extension installer: W:\V\automatic\extensions\animator_extension\install.py
09:17:37-899553 DEBUG
                         Traceback (most recent call last):
                           File "W:\V\automatic\extensions\animator_extension\install.py", line 4, in <module>
                             launch.run_pip("install glob", "requirements for AnimatorAnon Extension")
                           File "W:\V\automatic\launch.py", line 101, in run_pip
                             return run(f'"{sys.executable}" -m pip {pkg} --prefer-binary{index_url_line}',
                         desc=f"Installing {desc}", errdesc=f"Couldn't install {desc}")
                           File "W:\V\automatic\launch.py", line 69, in run
                             raise RuntimeError(f"""{errdesc or 'Error running command'}: {command} code:
                         {result.returncode}
                         RuntimeError: Couldn't install requirements for AnimatorAnon Extension:
                         "W:\V\automatic\venv\Scripts\python.exe" -m pip install glob --prefer-binary code: 1

                         ERROR: Could not find a version that satisfies the requirement glob (from versions: none)
                         ERROR: No matching distribution found for glob

09:17:39-133552 DEBUG    Running extension installer:
                         W:\V\automatic\extensions\deforum-for-automatic1111-webui\install.py
09:17:40-617554 DEBUG    Running extension installer:
                         W:\V\automatic\extensions\infinite-zoom-automatic1111-webui\install.py
09:17:41-403559 ERROR    Error running git: extensions\Mask2Background / pull origin None --rebase --force
09:17:41-411555 ERROR    Local changes detected: check log for details: W:\V\automatic\sdnext.log
09:17:41-417554 DEBUG    Git output: error: cannot pull with rebase: You have unstaged changes.
                         error: Please commit or stash them.
09:17:41-429554 DEBUG    Running extension installer: W:\V\automatic\extensions\Mask2Background\install.py
09:17:47-469076 DEBUG    Running extension installer: W:\V\automatic\extensions\sd-face-editor\install.py
09:18:03-613460 DEBUG    Running extension installer:
                         W:\V\automatic\extensions\sd-webui-infinite-image-browsing\install.py
09:18:12-132456 DEBUG    Running extension installer: W:\V\automatic\extensions\sd-webui-roop\install.py
09:18:12-890455 ERROR    Error running extension installer: W:\V\automatic\extensions\sd-webui-roop\install.py
09:18:12-895455 DEBUG
                         Traceback (most recent call last):
                           File "W:\V\automatic\extensions\sd-webui-roop\install.py", line 25, in <module>
                             download(model_url, model_path)
                           File "W:\V\automatic\extensions\sd-webui-roop\install.py", line 16, in download
                             request = urllib.request.urlopen(url)
                           File "C:\Users\derec\AppData\Local\Programs\Python\Python310\lib\urllib\request.py", line
                         216, in urlopen
                             return opener.open(url, data, timeout)
                           File "C:\Users\derec\AppData\Local\Programs\Python\Python310\lib\urllib\request.py", line
                         525, in open
                             response = meth(req, response)
                           File "C:\Users\derec\AppData\Local\Programs\Python\Python310\lib\urllib\request.py", line
                         634, in http_response
                             response = self.parent.error(
                           File "C:\Users\derec\AppData\Local\Programs\Python\Python310\lib\urllib\request.py", line
                         563, in error
                             return self._call_chain(*args)
                           File "C:\Users\derec\AppData\Local\Programs\Python\Python310\lib\urllib\request.py", line
                         496, in _call_chain
                             result = func(*args)
                           File "C:\Users\derec\AppData\Local\Programs\Python\Python310\lib\urllib\request.py", line
                         643, in http_error_default
                             raise HTTPError(req.full_url, code, msg, hdrs, fp)
                         urllib.error.HTTPError: HTTP Error 401: Unauthorized

09:18:13-246459 INFO     Extensions enabled: ['clip-interrogator-ext', 'LDSR', 'Lora', 'ScuNET',
                         'sd-extension-system-info', 'stable-diffusion-webui-rembg', 'SwinIR', 'adetailer',
                         'animator_extension', 'deforum-for-automatic1111-webui',
                         'infinite-zoom-automatic1111-webui', 'Mask2Background', 'sd-face-editor',
                         'sd-webui-aspect-ratio-helper', 'sd-webui-infinite-image-browsing', 'sd-webui-roop']
09:18:13-307456 INFO     Verifying packages
09:18:13-315460 INFO     Updating Wiki
09:18:14-216456 WARNING  Setup complete with errors: 3
09:18:14-222456 WARNING  See log file for more details: W:\V\automatic\sdnext.log
09:18:14-237456 INFO     Extension preload: {'extensions-builtin': 0.01, 'extensions': 0.0}
09:18:14-249457 DEBUG    Starting module: <module 'webui' from 'W:\\V\\automatic\\webui.py'>
09:18:14-259455 INFO     Command line args: ['--backend', 'diffusers', '--medvram', '--experimental', '--debug',
                         '--upgrade'] medvram=True backend=diffusers debug=True upgrade=True experimental=True
09:18:22-209456 DEBUG    Loaded packages: torch=2.0.1+cu118 diffusers=0.20.2 gradio=3.43.2
09:18:22-906458 DEBUG    Reading: config.json len=31
09:18:22-915458 DEBUG    Unknown settings: ['infzoom_defPrompt', 'animatoranon_film_folder',
                         'animatoranon_prop_folder', 'animatoranon_output_folder']
09:18:22-932457 INFO     Engine: backend=Backend.DIFFUSERS compute=cuda mode=no_grad device=cuda
09:18:23-048457 INFO     Device: device=NVIDIA GeForce RTX 3090 n=1 arch=compute_37 cap=(8, 6) cuda=11.8 cudnn=8700
                         driver=536.23
09:18:24-986459 DEBUG    Entering start sequence
09:18:24-996461 DEBUG    Initializing
09:18:25-006456 INFO     Available VAEs: models\VAE items=3
09:18:25-015456 INFO     Diffusers disabling uncompatible extensions: []
09:18:25-025460 DEBUG    Scanning diffusers cache: models\Diffusers models\Diffusers items=2 time=0.00s
09:18:25-036460 DEBUG    Reading: cache.json len=2
09:18:25-048457 DEBUG    Reading: metadata.json len=77
09:18:25-057456 INFO     Available models: ..\..\stable-diffusion-webui\models\Stable-diffusion items=23 time=0.03s
09:18:25-151457 DEBUG    Loading extensions
09:18:31-641509 INFO     Extension: script='extensions\adetailer\scripts\!adetailer.py' [-] ADetailer initialized.
                         version: 23.9.2, num models: 9
09:18:34-529509 INFO     Extensions time: 9.37s { clip-interrogator-ext=1.21s LDSR=0.06s Lora=0.30s
                         sd-extension-system-info=0.06s stable-diffusion-webui-rembg=0.92s SwinIR=0.07s
                         adetailer=3.87s animator_extension=0.14s deforum-for-automatic1111-webui=0.18s
                         infinite-zoom-automatic1111-webui=0.12s Mask2Background=0.10s sd-face-editor=1.05s
                         sd-webui-aspect-ratio-helper=0.13s sd-webui-infinite-image-browsing=0.10s
                         sd-webui-roop=1.01s }
09:18:34-607512 DEBUG    Loaded upscalers: items=14
09:18:34-784510 INFO     Loading UI theme: name=black-teal style=Auto
09:18:34-818509 DEBUG    Loaded styles: folder=models\styles items=148
09:18:34-831510 DEBUG    Creating UI
09:18:34-844509 DEBUG    Reading: ui-config.json len=1943
09:18:34-863508 DEBUG    Extra networks: page='model' items=23 subdirs=2 tab=txt2img
                         dirs=['..\\..\\stable-diffusion-webui\\models\\Stable-diffusion', 'models\\Diffusers',
                         'W:\\V\\automatic\\models\\Stable-diffusion'] time=0.01
09:18:34-916508 DEBUG    Extra networks: page='style' items=148 subdirs=6 tab=txt2img dirs=['models\\styles']
                         time=0.02
09:18:34-947508 DEBUG    Extra networks: page='embedding' items=0 subdirs=0 tab=txt2img dirs=['models\\embeddings']
                         time=0.0
09:18:34-974507 DEBUG    Extra networks: page='hypernetwork' items=0 subdirs=0 tab=txt2img
                         dirs=['models\\hypernetworks'] time=0.0
09:18:35-010509 DEBUG    Extra networks: page='lora' items=17 subdirs=2 tab=txt2img dirs=['models\\Lora'] time=0.01
09:18:35-282509 DEBUG    Reading: ui-config.json len=1943
09:18:35-326508 INFO     Themes: builtin=6 default=5 external=54
09:18:35-524509 DEBUG    Script: 0.11s ui_tabs W:\V\automatic\extensions\animator_extension\scripts\animator.py
09:18:35-733509 DEBUG    Script: 0.2s ui_tabs
                         W:\V\automatic\extensions\deforum-for-automatic1111-webui\scripts\deforum.py
09:18:38-186507 DEBUG    Extension list refresh: processed=220 installed=22 enabled=15 disabled=7 visible=220
                         hidden=0
09:18:38-787508 INFO     Local URL: http://127.0.0.1:7860/
09:18:38-794508 DEBUG    Gradio registered functions: 1152
09:18:38-802509 INFO     Initializing middleware
09:18:38-811511 DEBUG    Creating API
09:18:38-947508 DEBUG    Scripts setup: ['Face Editor:0.053s', 'ADetailer:0.022s', 'Face Editor EX:0.036s']
09:18:38-959511 DEBUG    Model metadata: metadata.json no changes
09:18:38-967508 DEBUG    Desired Torch parameters: dtype=FP16 no-half=False no-half-vae=False upscast=False
09:18:38-982511 INFO     Setting Torch parameters: device=cuda dtype=torch.float16 vae=torch.float16
                         unet=torch.float16 context=no_grad fp16=True bf16=False
09:18:39-008509 DEBUG    Select checkpoint: model="realvisxlV10_v10VAE.safetensors [8b379c4a8b]"
09:18:48-022580 DEBUG    Setting model: pipeline=StableDiffusionXLPipeline config={'low_cpu_mem_usage': True,
                         'torch_dtype': torch.float16, 'load_connected_pipeline': True, 'variant': 'fp16',
                         'extract_ema': True, 'force_zeros_for_empty_prompt ': True, 'requires_aesthetics_score':
                         False, 'use_safetensors': True}
09:18:48-071580 DEBUG    Setting model: enable model CPU offload
09:18:48-099581 DEBUG    Setting model: enable VAE tiling
09:18:48-121581 DEBUG    Setting model VAE: name=None upcast=True
09:18:48-132582 INFO     Loaded embeddings: loaded=0 skipped=0
09:18:48-143580 INFO     Model loaded in 9.18s { load=9.18s } native=1024
09:18:48-530584 DEBUG    gc: collected=5831 device=cuda {'ram': {'used': 7.58, 'total': 31.24}, 'gpu': {'used': 1.39,
                         'total': 24.0}, 'retries': 0, 'oom': 0}
09:18:48-563583 INFO     Model load finished model: {'ram': {'used': 7.58, 'total': 31.24}, 'gpu': {'used': 1.39,
                         'total': 24.0}, 'retries': 0, 'oom': 0}
09:18:48-592582 DEBUG    Desired Torch parameters: dtype=FP16 no-half=False no-half-vae=False upscast=False
09:18:48-605581 INFO     Setting Torch parameters: device=cuda dtype=torch.float16 vae=torch.float16
                         unet=torch.float16 context=no_grad fp16=True bf16=False
09:18:48-633581 DEBUG    Select checkpoint: refiner="stabilityai/stable-diffusion-xl-refiner-1.0 [93b080bbdc]"
Loading pipeline components...: 100%|██████████████████████████████████████████████████| 5/5 [00:01<00:00,  3.39it/s]
09:18:50-129822 ERROR    Failed loading refiner:
                         models\Diffusers\models--stabilityai--stable-diffusion-xl-refiner-1.0\snapshots\93b080bbdc8e
                         fbeb862e29e15316cff53f9bef86 Pipeline <class
                         'diffusers.pipelines.stable_diffusion_xl.pipeline_stable_diffusion_xl.StableDiffusionXLPipel
                         ine'> expected {'text_encoder_2', 'tokenizer_2', 'unet', 'text_encoder', 'scheduler', 'vae',
                         'tokenizer'}, but only {'text_encoder_2', 'tokenizer_2', 'unet', 'scheduler', 'vae'} were
                         passed.
09:18:50-199823 DEBUG    Saving: config.json len=2802
09:18:50-208825 INFO     Startup time: 35.88s { torch=6.13s gradio=1.04s diffusers=0.72s libraries=2.78s
                         extensions=9.37s codeformer=0.06s upscalers=0.09s onchange=0.18s ui-txt2img=0.28s
                         ui-img2img=0.10s ui-settings=0.12s ui-extensions=2.84s ui-defaults=0.37s launch=0.20s
                         api=0.08s app-started=0.06s checkpoint=11.25s }
vladmandic commented 11 months ago

what is your settings -> diffusers -> diffusers pipeline set to? it should be autodetect and i don't see autodetect unless you have a reason not to? and i don't see autodetect being triggered in the log.

ShmuelRonen commented 11 months ago

It's was on Stable Diffusion XL I moov it to Autodetect and restart but the same resaults come:

W:\V\automatic>webui.bat --backend diffusers --medvram --experimental --debug --upgrade Using VENV: W:\V\automatic\venv 07:45:34-493524 INFO Starting SD.Next 07:45:34-502524 INFO Python 3.10.7 on Windows 07:45:34-760524 INFO Version: app=sd.next updated=2023-09-20 hash=89ba8e3c url=https://github.com/vladmandic/automatic/tree/master 07:45:35-263522 INFO Platform: arch=AMD64 cpu=AMD64 Family 25 Model 68 Stepping 1, AuthenticAMD system=Windows release=Windows-10-10.0.19045-SP0 python=3.10.7 07:45:35-268522 DEBUG Setting environment tuning 07:45:35-269523 DEBUG Torch overrides: cuda=False rocm=False ipex=False diml=False openvino=False 07:45:35-272523 DEBUG Torch allowed: cuda=True rocm=True ipex=True diml=True openvino=True 07:45:35-277522 INFO nVidia CUDA toolkit detected 07:45:35-457523 INFO Verifying requirements 07:45:35-477523 INFO Verifying packages 07:45:35-480524 INFO Verifying repositories 07:45:40-277525 INFO Verifying submodules 07:45:53-705520 DEBUG Installed packages: 253 07:45:53-707523 DEBUG Extensions all: ['clip-interrogator-ext', 'LDSR', 'Lora', 'ScuNET', 'sd-extension-system-info', 'stable-diffusion-webui-rembg', 'SwinIR'] 07:45:54-659521 DEBUG Running extension installer: W:\V\automatic\extensions-builtin\clip-interrogator-ext\install.py 07:46:05-356522 DEBUG Running extension installer: W:\V\automatic\extensions-builtin\sd-extension-system-info\install.py 07:46:06-806523 DEBUG Running extension installer: W:\V\automatic\extensions-builtin\stable-diffusion-webui-rembg\install.py 07:46:08-453524 DEBUG Extensions all: ['adetailer', 'animator_extension', 'deforum-for-automatic1111-webui', 'infinite-zoom-automatic1111-webui', 'Mask2Background', 'sd-face-editor', 'sd-webui-aspect-ratio-helper', 'sd-webui-infinite-image-browsing', 'sd-webui-roop'] 07:46:09-335527 DEBUG Running extension installer: W:\V\automatic\extensions\adetailer\install.py 07:46:10-806521 DEBUG Running extension installer: W:\V\automatic\extensions\animator_extension\install.py 07:47:12-326030 ERROR Error running extension installer: W:\V\automatic\extensions\animator_extension\install.py 07:47:12-328028 DEBUG Traceback (most recent call last): File "W:\V\automatic\extensions\animator_extension\install.py", line 4, in launch.run_pip("install glob", "requirements for AnimatorAnon Extension") File "W:\V\automatic\launch.py", line 101, in run_pip return run(f'"{sys.executable}" -m pip {pkg} --prefer-binary{index_url_line}', desc=f"Installing {desc}", errdesc=f"Couldn't install {desc}") File "W:\V\automatic\launch.py", line 69, in run raise RuntimeError(f"""{errdesc or 'Error running command'}: {command} code: {result.returncode} RuntimeError: Couldn't install requirements for AnimatorAnon Extension: "W:\V\automatic\venv\Scripts\python.exe" -m pip install glob --prefer-binary code: 1

                     ERROR: Could not find a version that satisfies the requirement glob (from versions: none)
                     ERROR: No matching distribution found for glob

07:47:13-539028 DEBUG Running extension installer: W:\V\automatic\extensions\deforum-for-automatic1111-webui\install.py 07:47:14-998029 DEBUG Running extension installer: W:\V\automatic\extensions\infinite-zoom-automatic1111-webui\install.py 07:47:15-720028 ERROR Error running git: extensions\Mask2Background / pull origin None --rebase --force 07:47:15-722028 ERROR Local changes detected: check log for details: W:\V\automatic\sdnext.log 07:47:15-724027 DEBUG Git output: error: cannot pull with rebase: You have unstaged changes. error: Please commit or stash them. 07:47:15-727027 DEBUG Running extension installer: W:\V\automatic\extensions\Mask2Background\install.py 07:47:21-727027 DEBUG Running extension installer: W:\V\automatic\extensions\sd-face-editor\install.py 07:47:35-901027 DEBUG Running extension installer: W:\V\automatic\extensions\sd-webui-infinite-image-browsing\install.py 07:47:43-840028 DEBUG Running extension installer: W:\V\automatic\extensions\sd-webui-roop\install.py 07:47:44-536027 ERROR Error running extension installer: W:\V\automatic\extensions\sd-webui-roop\install.py 07:47:44-538029 DEBUG Traceback (most recent call last): File "W:\V\automatic\extensions\sd-webui-roop\install.py", line 25, in download(model_url, model_path) File "W:\V\automatic\extensions\sd-webui-roop\install.py", line 16, in download request = urllib.request.urlopen(url) File "C:\Users\derec\AppData\Local\Programs\Python\Python310\lib\urllib\request.py", line 216, in urlopen return opener.open(url, data, timeout) File "C:\Users\derec\AppData\Local\Programs\Python\Python310\lib\urllib\request.py", line 525, in open response = meth(req, response) File "C:\Users\derec\AppData\Local\Programs\Python\Python310\lib\urllib\request.py", line 634, in http_response response = self.parent.error( File "C:\Users\derec\AppData\Local\Programs\Python\Python310\lib\urllib\request.py", line 563, in error return self._call_chain(args) File "C:\Users\derec\AppData\Local\Programs\Python\Python310\lib\urllib\request.py", line 496, in _call_chain result = func(args) File "C:\Users\derec\AppData\Local\Programs\Python\Python310\lib\urllib\request.py", line 643, in http_error_default raise HTTPError(req.full_url, code, msg, hdrs, fp) urllib.error.HTTPError: HTTP Error 401: Unauthorized

07:47:44-769030 INFO Extensions enabled: ['clip-interrogator-ext', 'LDSR', 'Lora', 'ScuNET', 'sd-extension-system-info', 'stable-diffusion-webui-rembg', 'SwinIR', 'adetailer', 'animator_extension', 'deforum-for-automatic1111-webui', 'infinite-zoom-automatic1111-webui', 'Mask2Background', 'sd-face-editor', 'sd-webui-aspect-ratio-helper', 'sd-webui-infinite-image-browsing', 'sd-webui-roop'] 07:47:44-780028 INFO Verifying packages 07:47:44-783030 INFO Updating Wiki 07:47:45-687028 WARNING Setup complete with errors: 3 07:47:45-689028 WARNING See log file for more details: W:\V\automatic\sdnext.log 07:47:45-702026 INFO Extension preload: {'extensions-builtin': 0.01, 'extensions': 0.0} 07:47:45-705026 DEBUG Starting module: <module 'webui' from 'W:\V\automatic\webui.py'> 07:47:45-709028 INFO Command line args: ['--backend', 'diffusers', '--medvram', '--experimental', '--debug', '--upgrade'] medvram=True backend=diffusers debug=True upgrade=True experimental=True 07:47:53-011029 DEBUG Loaded packages: torch=2.0.1+cu118 diffusers=0.20.2 gradio=3.43.2 07:47:53-665031 DEBUG Reading: config.json len=30 07:47:53-668028 DEBUG Unknown settings: ['infzoom_defPrompt', 'animatoranon_film_folder', 'animatoranon_prop_folder', 'animatoranon_output_folder'] 07:47:53-673028 INFO Engine: backend=Backend.DIFFUSERS compute=cuda mode=no_grad device=cuda 07:47:53-759027 INFO Device: device=NVIDIA GeForce RTX 3090 n=1 arch=compute_37 cap=(8, 6) cuda=11.8 cudnn=8700 driver=536.23 07:47:54-532029 DEBUG Entering start sequence 07:47:54-537027 DEBUG Initializing 07:47:54-540029 INFO Available VAEs: models\VAE items=3 07:47:54-545027 INFO Diffusers disabling uncompatible extensions: [] 07:47:54-549027 DEBUG Scanning diffusers cache: models\Diffusers models\Diffusers items=2 time=0.00s 07:47:54-553027 DEBUG Reading: cache.json len=2 07:47:54-560028 DEBUG Reading: metadata.json len=77 07:47:54-565027 INFO Available models: ....\stable-diffusion-webui\models\Stable-diffusion items=23 time=0.02s 07:47:54-651027 DEBUG Loading extensions 07:48:00-514029 INFO Extension: script='extensions\adetailer\scripts!adetailer.py' [-] ADetailer initialized. version: 23.9.2, num models: 9 07:48:02-494026 INFO Extensions time: 7.84s { clip-interrogator-ext=1.14s Lora=0.23s stable-diffusion-webui-rembg=0.67s adetailer=3.67s animator_extension=0.10s deforum-for-automatic1111-webui=0.14s infinite-zoom-automatic1111-webui=0.10s Mask2Background=0.06s sd-face-editor=1.00s sd-webui-aspect-ratio-helper=0.09s sd-webui-infinite-image-browsing=0.08s sd-webui-roop=0.36s } 07:48:02-513028 DEBUG Loaded upscalers: items=14 07:48:02-739030 INFO Loading UI theme: name=black-teal style=Auto 07:48:02-764031 DEBUG Loaded styles: folder=models\styles items=148 07:48:02-769030 DEBUG Creating UI 07:48:02-779031 DEBUG Reading: ui-config.json len=1943 07:48:02-792027 DEBUG Extra networks: page='model' items=23 subdirs=2 tab=txt2img dirs=['..\..\stable-diffusion-webui\models\Stable-diffusion', 'models\Diffusers', 'W:\V\automatic\models\Stable-diffusion'] time=0.01 07:48:02-822032 DEBUG Extra networks: page='style' items=148 subdirs=6 tab=txt2img dirs=['models\styles'] time=0.02 07:48:02-830026 DEBUG Extra networks: page='embedding' items=0 subdirs=0 tab=txt2img dirs=['models\embeddings'] time=0.0 07:48:02-839026 DEBUG Extra networks: page='hypernetwork' items=0 subdirs=0 tab=txt2img dirs=['models\hypernetworks'] time=0.0 07:48:02-854031 DEBUG Extra networks: page='lora' items=17 subdirs=2 tab=txt2img dirs=['models\Lora'] time=0.01 07:48:03-101028 DEBUG Reading: ui-config.json len=1943 07:48:03-138026 INFO Themes: builtin=6 default=5 external=54 07:48:03-498027 DEBUG Script: 0.19s ui_tabs W:\V\automatic\extensions\deforum-for-automatic1111-webui\scripts\deforum.py 07:48:05-789028 DEBUG Extension list refresh: processed=220 installed=22 enabled=15 disabled=7 visible=220 hidden=0 07:48:06-312028 INFO Local URL: http://127.0.0.1:7860/ 07:48:06-315028 DEBUG Gradio registered functions: 1152 07:48:06-317028 INFO Initializing middleware 07:48:06-322027 DEBUG Creating API 07:48:06-451028 DEBUG Scripts setup: ['X/Y/Z Grid:0.006s', 'Face Editor:0.049s', 'ADetailer:0.022s', 'Face Editor EX:0.035s'] 07:48:06-456028 DEBUG Model metadata: metadata.json no changes 07:48:06-459028 DEBUG Desired Torch parameters: dtype=FP16 no-half=False no-half-vae=False upscast=False 07:48:06-464026 INFO Setting Torch parameters: device=cuda dtype=torch.float16 vae=torch.float16 unet=torch.float16 context=no_grad fp16=True bf16=False 07:48:06-470031 DEBUG Select checkpoint: model="realvisxlV10_v10VAE.safetensors [8b379c4a8b]" 07:48:06-474028 DEBUG Model autodetect model: W:\stable-diffusion-webui\models\Stable-diffusion\realvisxlV10_v10VAE.safetensors pipeline=Stable Diffusion XL size=6.46 GB 07:48:12-874028 DEBUG Setting model: pipeline=StableDiffusionXLPipeline config={'low_cpu_mem_usage': True, 'torch_dtype': torch.float16, 'load_connected_pipeline': True, 'variant': 'fp16', 'extract_ema': True, 'force_zeros_for_empty_prompt ': True, 'requires_aesthetics_score': False, 'use_safetensors': True} 07:48:12-886028 DEBUG Setting model: enable model CPU offload 07:48:12-911027 DEBUG Setting model: enable VAE tiling 07:48:12-923026 DEBUG Setting model VAE: name=None upcast=True 07:48:12-927029 INFO Loaded embeddings: loaded=0 skipped=0 07:48:12-933026 INFO Model loaded in 6.47s { load=6.47s } native=1024 07:48:13-297026 DEBUG gc: collected=5831 device=cuda {'ram': {'used': 7.58, 'total': 31.24}, 'gpu': {'used': 1.39, 'total': 24.0}, 'retries': 0, 'oom': 0} 07:48:13-304028 INFO Model load finished model: {'ram': {'used': 7.58, 'total': 31.24}, 'gpu': {'used': 1.39, 'total': 24.0}, 'retries': 0, 'oom': 0} 07:48:13-312028 DEBUG Desired Torch parameters: dtype=FP16 no-half=False no-half-vae=False upscast=False 07:48:13-317026 INFO Setting Torch parameters: device=cuda dtype=torch.float16 vae=torch.float16 unet=torch.float16 context=no_grad fp16=True bf16=False 07:48:13-322027 DEBUG Select checkpoint: refiner="stabilityai/stable-diffusion-xl-refiner-1.0 [93b080bbdc]" Loading pipeline components...: 100%|██████████████████████████████████████████████████| 5/5 [00:01<00:00, 4.32it/s] 07:48:14-489028 ERROR Failed loading refiner: models\Diffusers\models--stabilityai--stable-diffusion-xl-refiner-1.0\snapshots\93b080bbdc8e fbeb862e29e15316cff53f9bef86 Pipeline <class 'diffusers.pipelines.stable_diffusion_xl.pipeline_stable_diffusion_xl.StableDiffusionXLPipel ine'> expected {'scheduler', 'text_encoder_2', 'unet', 'tokenizer_2', 'text_encoder', 'vae', 'tokenizer'}, but only {'scheduler', 'text_encoder_2', 'unet', 'tokenizer_2', 'vae'} were passed. 07:48:14-515030 DEBUG Saving: config.json len=2755 07:48:14-517027 INFO Startup time: 28.77s { torch=5.66s gradio=0.95s diffusers=0.67s libraries=1.52s extensions=7.84s codeformer=0.06s onchange=0.23s ui-txt2img=0.18s ui-img2img=0.09s ui-settings=0.10s ui-extensions=2.62s ui-defaults=0.34s launch=0.18s api=0.07s app-started=0.06s checkpoint=8.06s } 07:49:16-392576 INFO Themes: builtin=6 default=5 external=54 07:49:59-591983 DEBUG Server alive=True jobs=1 requests=21 uptime=126s memory used=7.59 total=31.24 idle

ShmuelRonen commented 11 months ago

Select checkpoint: refiner="stabilityai/stable-diffusion-xl-refiner-1.0 [93b080bbdc]" Loading pipeline components...: 100%|██████████████████████████████████████████████████| 5/5 [00:01<00:00, 4.32it/s] 07:48:14-489028 ERROR Failed loading refiner: models\Diffusers\models--stabilityai--stable-diffusion-xl-refiner-1.0\snapshots\93b080bbdc8e fbeb862e29e15316cff53f9bef86 Pipeline <class 'diffusers.pipelines.stable_diffusion_xl.pipeline_stable_diffusion_xl.StableDiffusionXLPipel ine'> expected {'scheduler', 'text_encoder_2', 'unet', 'tokenizer_2', 'text_encoder', 'vae', 'tokenizer'}, but only {'scheduler', 'text_encoder_2', 'unet', 'tokenizer_2', 'vae'} were passed. 07:48:14-515030 DEBUG Saving: config.json len=2755 07:48:14-517027 INFO Startup time: 28.77s { torch=5.66s gradio=0.95s diffusers=0.67s libraries=1.52s extensions=7.84s codeformer=0.06s onchange=0.23s ui-txt2img=0.18s ui-img2img=0.09s ui-settings=0.10s ui-extensions=2.62s ui-defaults=0.34s launch=0.18s api=0.07s app-started=0.06s checkpoint=8.06s } 07:49:16-392576 INFO Themes: builtin=6 default=5 external=54 07:49:59-591983 DEBUG Server alive=True jobs=1 requests=21 uptime=126s memory used=7.59 total=31.24 idle 07:51:59-664494 DEBUG Server alive=True jobs=1 requests=34 uptime=246s memory used=7.59 total=31.24 idle 07:53:11-697495 DEBUG txt2img: id_task=task(h1pg3a8cf1nj3kc)|prompt=girl|negative_prompt=|prompt_styles=[]|steps=20|sampler _index=0|latent_index=None|full_quality=True|restore_faces=False|tiling=False|n_iter=1|batch _size=1|cfg_scale=6|clip_skip=1|seed=-1.0|subseed=-1.0|subseed_strength=0|seed_resize_from_h =0|seed_resize_from_w=0||height=1024|width=1024|enable_hr=False|denoising_strength=0.7|hr_sc ale=2|hr_upscaler=Latent|hr_force=False|hr_second_pass_steps=0|hr_resize_x=0|hr_resize_y=0|i mage_cfg_scale=6|diffusers_guidance_rescale=0.7|refiner_steps=5|refiner_start=0.8|refiner_pr ompt=|refiner_negative=|override_settings_texts=[] 07:53:11-733494 DEBUG Sampler: sampler=UniPC config={'num_train_timesteps': 1000, 'beta_start': 0.00085, 'beta_end': 0.012, 'beta_schedule': 'scaled_linear', 'prediction_type': 'epsilon', 'solver_order': 2, 'thresholding': False, 'sample_max_value': 1.0, 'predict_x0': 'bh1', 'lower_order_final': True} 07:53:14-284492 DEBUG Diffuser pipeline: StableDiffusionXLPipeline task=DiffusersTaskType.TEXT_2_IMAGE set={'prompt_embeds': torch.Size([1, 77, 2048]), 'pooled_prompt_embeds': torch.Size([1, 1280]), 'negative_prompt_embeds': torch.Size([1, 77, 2048]), 'negative_pooled_prompt_embeds': torch.Size([1, 1280]), 'guidance_scale': 6, 'generator': device(type='cuda'), 'output_type': 'latent', 'num_inference_steps': 20, 'eta': 0.0, 'guidance_rescale': 0.7, 'denoising_end': None, 'height': 1024, 'width': 1024, 'parser': 'Full parser'} Progress 2.03s/it ███▍ 10% 2/20 00:04 00:36 Base07:53:19-389491 INFO Loaded VAE-approx model: models\VAE-approx\model.pt Progress 2.04it/s █████████████████████████████████ 100% 20/20 00:09 00:00 Base 07:53:30-100495 DEBUG VAE decode: name=baked dtype=torch.float32 upcast=False images=1 latents=torch.Size([1, 4, 128, 128]) time=5.917s 07:53:30-186492 DEBUG Saving: image="outputs\text\01225-girl.png" type=PNG size=1024x1024 07:53:31-051492 INFO Processed: images=1 time=19.33s its=1.03 memory={'ram': {'used': 7.95, 'total': 31.24}, 'gpu': {'used': 3.05, 'total': 24.0}, 'retries': 0, 'oom': 0} 07:53:39-270491 DEBUG txt2img: id_task=task(4ypwev3hf9ft43s)|prompt=girl|negative_prompt=|prompt_styles=[]|steps=20|sampler _index=0|latent_index=None|full_quality=True|restore_faces=False|tiling=False|n_iter=1|batch _size=1|cfg_scale=6|clip_skip=1|seed=-1.0|subseed=-1.0|subseed_strength=0|seed_resize_from_h =0|seed_resize_from_w=0||height=1024|width=1024|enable_hr=False|denoising_strength=0.7|hr_sc ale=2|hr_upscaler=Latent|hr_force=False|hr_second_pass_steps=0|hr_resize_x=0|hr_resize_y=0|i mage_cfg_scale=6|diffusers_guidance_rescale=0.7|refiner_steps=5|refiner_start=0.8|refiner_pr ompt=|refiner_negative=|override_settings_texts=[] 07:53:41-129494 DEBUG Diffuser pipeline: StableDiffusionXLPipeline task=DiffusersTaskType.TEXT_2_IMAGE set={'prompt_embeds': torch.Size([1, 77, 2048]), 'pooled_prompt_embeds': torch.Size([1, 1280]), 'negative_prompt_embeds': torch.Size([1, 77, 2048]), 'negative_pooled_prompt_embeds': torch.Size([1, 1280]), 'guidance_scale': 6, 'generator': device(type='cuda'), 'output_type': 'latent', 'num_inference_steps': 20, 'eta': 0.0, 'guidance_rescale': 0.7, 'denoising_end': None, 'height': 1024, 'width': 1024, 'parser': 'Full parser'} Progress 2.44it/s █████████████████████████████████ 100% 20/20 00:08 00:00 Base 07:53:51-139491 DEBUG VAE decode: name=baked dtype=torch.float32 upcast=False images=1 latents=torch.Size([1, 4, 128, 128]) time=1.8s 07:53:51-551490 DEBUG Saving: image="outputs\text\01226-girl.png" type=PNG size=1024x1024 07:53:53-286499 INFO Processed: images=1 time=13.99s its=1.43 memory={'ram': {'used': 7.97, 'total': 31.24}, 'gpu': {'used': 15.38, 'total': 24.0}, 'retries': 0, 'oom': 0} 07:53:59-724491 DEBUG Server alive=True jobs=3 requests=118 uptime=366s memory used=7.97 total=31.24 idle

vladmandic commented 11 months ago

you're loading base model from safetensors file, but refiner as diffusers folder-style model. no reason why that shouldn't work, but its less tested combo. i'll take a look at that, but in the meantime i suggest to download refiner safetensors file and simply load it as safetensors file (just like you're loading base) as that is most common and most tested combo.

inktomi commented 11 months ago

I have the same error - both the refiner and model were downloaded via the UI . 

00:16:12-778736 ERROR    Failed loading refiner:
                         models\Diffusers\models--stabilityai--stable-diffusion-xl-refiner-1.0\snapshots\93b080bbdc8efbe
                         b862e29e15316cff53f9bef86 Pipeline <class
                         'diffusers.pipelines.stable_diffusion_xl.pipeline_stable_diffusion_xl.StableDiffusionXLPipeline
                         '> expected {'text_encoder', 'vae', 'tokenizer_2', 'scheduler', 'unet', 'tokenizer',
                         'text_encoder_2'}, but only {'vae', 'tokenizer_2', 'scheduler', 'unet', 'text_encoder_2'} were
                         passed.
vladmandic commented 11 months ago

that is not what i said - you're still trying to load model using diffusers model format. yes, thats a problem that i need to fix, but workaround is to just download safetensors file and load that. for example: https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0/blob/main/sd_xl_refiner_1.0.safetensors

vladmandic commented 11 months ago

this should be now fixed in dev branch. i still strongly suggest what i said earlier - download and use safetensors file for refiner.