vladmandic / automatic

SD.Next: Advanced Implementation Generative Image Models
https://github.com/vladmandic/automatic
GNU Affero General Public License v3.0
5.79k stars 434 forks source link

[Issue]: Diffuser Model not loading after downloading #3516

Closed sk3nn1xxx closed 1 month ago

sk3nn1xxx commented 1 month ago

Issue Description

I download the Model but it just says 0mb size i tried without directml and with.

Version Platform Description

Windows, librewolf

Relevant log output

(venv) C:\Users\sk3nn1x\Documents\SDNEXT>webui.bat
Using VENV: C:\Users\sk3nn1x\Documents\SDNEXT\venv
17:11:27-190930 INFO     Starting SD.Next
17:11:27-192936 INFO     Logger: file="C:\Users\sk3nn1x\Documents\SDNEXT\sdnext.log" level=INFO size=57244 mode=append
17:11:27-193936 INFO     Python: version=3.12.3 platform=Windows
                         bin="C:\Users\sk3nn1x\Documents\SDNEXT\venv\Scripts\python.exe"
                         venv="C:\Users\sk3nn1x\Documents\SDNEXT\venv"
17:11:27-326833 INFO     Version: app=sd.next updated=2024-10-23 hash=0d332ca7 branch=master
                         url=https://github.com/vladmandic/automatic.git/tree/master ui=main
17:11:27-862634 INFO     Platform: arch=AMD64 cpu=AMD64 Family 25 Model 97 Stepping 2, AuthenticAMD system=Windows
                         release=Windows-11-10.0.22631-SP0 python=3.12.3
17:11:27-873883 INFO     Python: version=3.12.3 platform=Windows
                         bin="C:\Users\sk3nn1x\Documents\SDNEXT\venv\Scripts\python.exe"
                         venv="C:\Users\sk3nn1x\Documents\SDNEXT\venv"
17:11:27-875884 INFO     OpenVINO: selected
17:11:27-876883 INFO     Install: package="onnxruntime-openvino" mode=pip
17:11:29-068861 INFO     Verifying requirements
17:11:29-071937 INFO     Verifying packages
17:11:29-107985 INFO     Extensions: disabled=[]
17:11:29-108985 INFO     Extensions: enabled=['Lora', 'sd-extension-chainner', 'sd-extension-system-info',
                         'sd-webui-agent-scheduler', 'sdnext-modernui', 'stable-diffusion-webui-rembg']
                         extensions-builtin
17:11:29-111500 INFO     Extensions: enabled=[] extensions
17:11:29-112657 INFO     Startup: quick launch
17:11:29-113662 INFO     Extensions: disabled=[]
17:11:29-113662 INFO     Extensions: enabled=['Lora', 'sd-extension-chainner', 'sd-extension-system-info',
                         'sd-webui-agent-scheduler', 'sdnext-modernui', 'stable-diffusion-webui-rembg']
                         extensions-builtin
17:11:29-116753 INFO     Extensions: enabled=[] extensions
17:11:29-119866 INFO     Command line args: []
17:11:33-533628 INFO     System packages: {'torch': '2.4.1+cpu', 'diffusers': '0.32.0.dev0', 'gradio': '3.43.2',
                         'transformers': '4.45.2', 'accelerate': '1.0.0'}
17:11:33-862670 INFO     Engine: backend=Backend.DIFFUSERS compute=cpu device=cpu attention="Scaled-Dot-Product"
                         mode=no_grad
17:11:33-864982 INFO     Torch parameters: backend=cpu device=cpu config=Auto dtype=torch.bfloat16 vae=torch.bfloat16
                         unet=torch.bfloat16 context=no_grad nohalf=False nohalfvae=False upscast=False
                         deterministic=False test-fp16=True test-bf16=True optimization="Scaled-Dot-Product"
17:11:34-191198 INFO     Device:
17:11:34-289549 INFO     Available VAEs: path="models\VAE" items=0
17:11:34-291615 INFO     Available UNets: path="models\UNET" items=0
17:11:34-291615 INFO     Available TEs: path="models\Text-encoder" items=0
17:11:34-292622 INFO     Disabled extensions: ['sdnext-modernui']
17:11:34-293704 INFO     Available Models: path="models\Stable-diffusion" items=0 time=0.00
17:11:34-350637 INFO     Available Yolo: path="models\yolo items=6 downloaded=0
17:11:34-498969 INFO     Extension: script='extensions-builtin\Lora\scripts\lora_script.py'
                         [2;36m17:11:34-396947[0m[2;36m [0m[34mINFO    [0m Available LoRAs: [33mitems[0m=[1;36m0[0m
                         [33mfolders[0m=[1;36m2[0m
17:11:34-929370 INFO     Extension: script='extensions-builtin\sd-webui-agent-scheduler\scripts\task_scheduler.py' Using
                         sqlite file: extensions-builtin\sd-webui-agent-scheduler\task_scheduler.sqlite3
17:11:34-947685 INFO     Available Upscalers: items=53 downloaded=0 user=0 time=0.01 types=['None', 'Lanczos',
                         'Nearest', 'ChaiNNer', 'AuraSR', 'ESRGAN', 'LDSR', 'RealESRGAN', 'SCUNet', 'SD', 'SwinIR']
17:11:34-957697 INFO     Available Styles: folder="models\styles" items=288 time=0.01
17:11:34-960698 INFO     UI theme: type=Standard name="black-teal"
17:11:35-716013 INFO     Extension list is empty: refresh required
17:11:36-185532 INFO     Local URL: http://127.0.0.1:7860/
INFO:nncf:NNCF initialized successfully. Supported frameworks detected: torch, onnx, openvino
17:11:37-178776 WARNING  OpenVINO: No compatible GPU detected! Using CPU
17:11:37-455912 INFO     [AgentScheduler] Task queue is empty
17:11:37-456913 INFO     [AgentScheduler] Registering APIs
17:11:37-526322 WARNING  Cannot generate without a checkpoint
17:11:37-527323 INFO     Set system paths to use existing folders
17:11:37-527323 INFO       or use --models-dir <path-to-folder> to specify base folder with all models
17:11:37-528322 INFO       or use --ckpt-dir <path-to-folder> to specify folder with sd models
17:11:37-528322 INFO       or use --ckpt <path-to-checkpoint> to force using specific model
17:11:37-529323 INFO     Startup time: 8.41 torch=3.27 gradio=0.84 diffusers=0.07 libraries=0.95 extensions=0.58
                         detailer=0.06 ui-networks=0.11 ui-txt2img=0.06 ui-img2img=0.06 ui-control=0.09 ui-settings=0.17
                         ui-extensions=0.55 launch=0.08 app-started=1.29
17:11:39-880796 INFO     MOTD: N/A
17:11:45-714366 INFO     Browser session: user=None client=127.0.0.1 agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64;
                         rv:129.0) Gecko/20100101 Firefox/129.0
17:12:09-409806 INFO     HF login: token="C:\Users\sk3nn1x\.cache\huggingface\token" Token is valid (permission: read).
model_index.json: 100%|███████████████████████████████████████████████████████████████████████| 577/577 [00:00<?, ?B/s]
tokenizer/special_tokens_map.json: 100%|██████████████████████████████████████████████████████| 460/460 [00:00<?, ?B/s]
scheduler/scheduler_config.json: 100%|████████████████████████████████████████████████████████| 341/341 [00:00<?, ?B/s]
(…)ature_extractor/preprocessor_config.json: 100%|████████████████████████████████████████████| 518/518 [00:00<?, ?B/s]
safety_checker/config.json: 100%|█████████████████████████████████████████████████████████| 4.89k/4.89k [00:00<?, ?B/s]
tokenizer/tokenizer_config.json: 100%|████████████████████████████████████████████████████████| 819/819 [00:00<?, ?B/s]
text_encoder/config.json: 100%|███████████████████████████████████████████████████████████████| 620/620 [00:00<?, ?B/s]
tokenizer/merges.txt: 100%|█████████████████████████████████████████████████████████| 525k/525k [00:00<00:00, 1.39MB/s]
vae/config.json: 100%|████████████████████████████████████████████████████████████████████████| 601/601 [00:00<?, ?B/s]
unet/config.json: 100%|███████████████████████████████████████████████████████████████████| 1.00k/1.00k [00:00<?, ?B/s]
tokenizer/vocab.json: 100%|███████████████████████████████████████████████████████| 1.06M/1.06M [00:00<00:00, 1.17MB/s]
diffusion_pytorch_model.safetensors: 100%|██████████████████████████████████████████| 335M/335M [00:55<00:00, 5.98MB/s]
model.safetensors: 100%|██████████████████████████████████████████████████████████| 1.36G/1.36G [02:15<00:00, 10.1MB/s]
model.safetensors: 100%|██████████████████████████████████████████████████████████| 1.22G/1.22G [02:23<00:00, 8.45MB/s]
diffusion_pytorch_model.safetensors: 100%|████████████████████████████████████████| 3.46G/3.46G [03:28<00:00, 16.6MB/s]
Diffusers 13.94s/it ███████████████████ 100% 15/15 03:29 00:00 Fetching 15 files  | 1.50G/3.46G [02:23<02:09, 15.1MB/s]
17:15:40-006434 INFO     Available Models: path="models\Stable-diffusion" items=1 time=0.01
17:15:40-006434 INFO     Diffuser model downloaded: model="hakurei/waifu-diffusion"
17:16:14-114739 INFO     Available Models: path="models\Stable-diffusion" items=1 time=0.00
17:16:16-038486 INFO     Load model: select="Diffusers\hakurei/waifu-diffusion [87a6d830b9]"
17:16:16-040992 INFO     Autodetect model: detect="Stable Diffusion" class=StableDiffusionPipeline
                         file="models\Diffusers\models--hakurei--waifu-diffusion\snapshots\87a6d830b9b23f7e5727f162782cf
                         3f4a7a84be1" size=0MB
17:16:16-042996 ERROR    Diffuser model not loaded

Backend

Diffusers

UI

Standard

Branch

Master

Model

Other

Acknowledgements

sk3nn1xxx commented 1 month ago

it worked with the normal 3.5 stable diffusion model but this just eats too much ressources

vladmandic commented 1 month ago

need more info why model load failed - it just says not loaded

sk3nn1xxx commented 1 month ago

(venv) C:\Users\sk3nn1x\Documents\SDNEXT>webui.bat --use-directml --debug Using VENV: C:\Users\sk3nn1x\Documents\SDNEXT\venv 18:22:45-837585 INFO Starting SD.Next 18:22:45-840988 INFO Logger: file="C:\Users\sk3nn1x\Documents\SDNEXT\sdnext.log" level=DEBUG size=65 mode=create 18:22:45-840988 INFO Python: version=3.12.3 platform=Windows bin="C:\Users\sk3nn1x\Documents\SDNEXT\venv\Scripts\python.exe" venv="C:\Users\sk3nn1x\Documents\SDNEXT\venv" 18:22:45-977658 INFO Version: app=sd.next updated=2024-10-23 hash=0d332ca7 branch=master url=https://github.com/vladmandic/automatic.git/tree/master ui=main 18:22:46-511170 INFO Platform: arch=AMD64 cpu=AMD64 Family 25 Model 97 Stepping 2, AuthenticAMD system=Windows release=Windows-11-10.0.22631-SP0 python=3.12.3 18:22:46-523628 DEBUG Setting environment tuning 18:22:46-524285 DEBUG Torch allocator: "garbage_collection_threshold:0.80,max_split_size_mb:512" 18:22:46-528330 DEBUG Torch overrides: cuda=False rocm=False ipex=False directml=True openvino=False zluda=False 18:22:46-529329 INFO DirectML: selected 18:22:46-624224 INFO Verifying requirements 18:22:46-626223 INFO Verifying packages 18:22:46-657750 DEBUG Timestamp repository update time: Wed Oct 23 20:59:10 2024 18:22:46-658755 INFO Startup: standard 18:22:46-659754 INFO Verifying submodules 18:22:48-330620 DEBUG Git submodule: extensions-builtin/sd-extension-chainner / main 18:22:48-388233 DEBUG Git submodule: extensions-builtin/sd-extension-system-info / main 18:22:48-445276 DEBUG Git submodule: extensions-builtin/sd-webui-agent-scheduler / main 18:22:48-502422 DEBUG Git submodule: extensions-builtin/sdnext-modernui / main 18:22:48-559040 DEBUG Git submodule: extensions-builtin/stable-diffusion-webui-rembg / master 18:22:48-627151 DEBUG Git submodule: modules/k-diffusion / master 18:22:48-687027 DEBUG Git submodule: wiki / master 18:22:48-722211 DEBUG Register paths 18:22:48-763235 DEBUG Installed packages: 198 18:22:48-764233 DEBUG Extensions all: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info', 'sd-webui-agent-scheduler', 'sdnext-modernui', 'stable-diffusion-webui-rembg'] 18:22:48-885108 DEBUG Extension installer: C:\Users\sk3nn1x\Documents\SDNEXT\extensions-builtin\sd-webui-agent-scheduler\install.py 18:22:50-726982 DEBUG Extension installer: C:\Users\sk3nn1x\Documents\SDNEXT\extensions-builtin\stable-diffusion-webui-rembg\install.py 18:22:56-820574 DEBUG Extensions all: [] 18:22:56-821573 INFO Extensions enabled: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info', 'sd-webui-agent-scheduler', 'sdnext-modernui', 'stable-diffusion-webui-rembg'] 18:22:56-822781 INFO Verifying requirements 18:22:56-822781 DEBUG Setup complete without errors: 1729786977 18:22:56-826289 DEBUG Extension preload: {'extensions-builtin': 0.0, 'extensions': 0.0} 18:22:56-827290 DEBUG Starting module: <module 'webui' from 'C:\Users\sk3nn1x\Documents\SDNEXT\webui.py'> 18:22:56-828288 INFO Command line args: ['--use-directml', '--debug'] use_directml=True debug=True 18:22:56-829290 DEBUG Env flags: ['SD_LOAD_DEBUG=true'] 18:23:01-552775 INFO System packages: {'torch': '2.4.1+cpu', 'diffusers': '0.32.0.dev0', 'gradio': '3.43.2', 'transformers': '4.45.2', 'accelerate': '1.0.0'} 18:23:01-891562 DEBUG Huggingface cache: folder="C:\Users\sk3nn1x.cache\huggingface\hub" 18:23:01-961412 INFO Device detect: memory=8.0 ptimization=medvram 18:23:01-962411 DEBUG Read: file="config.json" json=33 bytes=1455 time=0.000 18:23:01-964411 INFO Engine: backend=Backend.DIFFUSERS compute=directml device=privateuseone:0 attention="Dynamic Attention BMM" mode=no_grad 18:23:01-964411 DEBUG Read: file="html\reference.json" json=58 bytes=30996 time=0.000 18:23:02-027291 INFO Torch parameters: backend=directml device=privateuseone:0 config=Auto dtype=torch.float16 vae=torch.float16 unet=torch.float16 context=no_grad nohalf=False nohalfvae=False upscast=False deterministic=False test-fp16=True test-bf16=False optimization="Dynamic Attention BMM" 18:23:02-341842 DEBUG ONNX: version=1.19.2 provider=DmlExecutionProvider, available=['AzureExecutionProvider', 'CPUExecutionProvider'] 18:23:02-384494 INFO Device: device=AMD Radeon RX 7800 XT n=2 directml=0.2.5.dev240914 18:23:02-447118 DEBUG Importing LDM 18:23:02-458125 DEBUG Entering start sequence 18:23:02-460129 DEBUG Initializing 18:23:02-478743 INFO Available VAEs: path="models\VAE" items=0 18:23:02-480742 INFO Available UNets: path="models\UNET" items=0 18:23:02-480742 INFO Available TEs: path="models\Text-encoder" items=0 18:23:02-481741 INFO Disabled extensions: ['sdnext-modernui'] 18:23:02-484755 DEBUG Read: file="metadata.json" json=4 bytes=800 time=0.000 18:23:02-485759 DEBUG Scanning diffusers cache: folder="models\Diffusers" items=1 time=0.00 18:23:02-486758 INFO Available Models: path="models\Stable-diffusion" items=5 time=0.01 18:23:02-540463 INFO Available Yolo: path="models\yolo items=6 downloaded=0 18:23:02-541464 DEBUG Load extensions 18:23:02-697399 INFO Extension: script='extensions-builtin\Lora\scripts\lora_script.py' [2;36m18:23:02-588319[0m[2;36m [0m[34mINFO [0m Available LoRAs: [33mitems[0m=[1;36m0[0m [33mfolders[0m=[1;36m2[0m 18:23:03-150558 INFO Extension: script='extensions-builtin\sd-webui-agent-scheduler\scripts\task_scheduler.py' Using sqlite file: extensions-builtin\sd-webui-agent-scheduler\task_scheduler.sqlite3 18:23:03-154063 DEBUG Extensions init time: 0.61 Lora=0.12 sd-webui-agent-scheduler=0.42 18:23:03-167088 DEBUG Read: file="html/upscalers.json" json=4 bytes=2672 time=0.000 18:23:03-168087 DEBUG Read: file="extensions-builtin\sd-extension-chainner\models.json" json=24 bytes=2719 time=0.000 18:23:03-169086 DEBUG chaiNNer models: path="models\chaiNNer" defined=24 discovered=0 downloaded=0 18:23:03-172086 INFO Available Upscalers: items=53 downloaded=0 user=0 time=0.02 types=['None', 'Lanczos', 'Nearest', 'ChaiNNer', 'AuraSR', 'ESRGAN', 'LDSR', 'RealESRGAN', 'SCUNet', 'SD', 'SwinIR'] 18:23:03-182597 INFO Available Styles: folder="models\styles" items=288 time=0.01 18:23:03-186638 DEBUG Creating UI 18:23:03-187642 DEBUG UI themes available: type=Standard themes=12 18:23:03-188641 INFO UI theme: type=Standard name="black-teal" 18:23:03-192160 DEBUG UI theme: css="C:\Users\sk3nn1x\Documents\SDNEXT\javascript\black-teal.css" base="sdnext.css" user="None" 18:23:03-194176 DEBUG UI initialize: txt2img 18:23:03-219260 DEBUG Networks: page='model' items=62 subfolders=2 tab=txt2img folders=['models\Stable-diffusion', 'models\Diffusers', 'models\Reference'] list=0.01 thumb=0.00 desc=0.00 info=0.00 workers=8 sort=Default 18:23:03-221260 DEBUG Networks: page='lora' items=0 subfolders=0 tab=txt2img folders=['models\Lora', 'models\LyCORIS'] list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=8 sort=Default 18:23:03-226292 DEBUG Networks: page='style' items=288 subfolders=1 tab=txt2img folders=['models\styles', 'html'] list=0.01 thumb=0.00 desc=0.00 info=0.00 workers=8 sort=Default 18:23:03-229294 DEBUG Networks: page='embedding' items=0 subfolders=0 tab=txt2img folders=['models\embeddings'] list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=8 sort=Default 18:23:03-231291 DEBUG Networks: page='vae' items=0 subfolders=0 tab=txt2img folders=['models\VAE'] list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=8 sort=Default 18:23:03-232291 DEBUG Networks: page='history' items=0 subfolders=0 tab=txt2img folders=[] list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=8 sort=Default 18:23:03-305007 DEBUG UI initialize: img2img 18:23:03-387352 DEBUG UI initialize: control models=models\control 18:23:03-605375 DEBUG Read: file="ui-config.json" json=0 bytes=2 time=0.000 18:23:03-701179 DEBUG UI themes available: type=Standard themes=12 18:23:03-994941 DEBUG Reading failed: C:\Users\sk3nn1x\Documents\SDNEXT\html\extensions.json [Errno 2] No such file or directory: 'C:\Users\sk3nn1x\Documents\SDNEXT\html\extensions.json' 18:23:03-995944 INFO Extension list is empty: refresh required 18:23:04-322281 DEBUG Extension list: processed=6 installed=6 enabled=5 disabled=1 visible=6 hidden=0 18:23:04-409875 DEBUG Root paths: ['C:\Users\sk3nn1x\Documents\SDNEXT'] 18:23:04-466977 INFO Local URL: http://127.0.0.1:7860/ 18:23:04-467974 DEBUG Gradio functions: registered=1895 18:23:04-469975 DEBUG FastAPI middleware: ['Middleware', 'Middleware'] 18:23:04-470974 DEBUG Creating API INFO:nncf:NNCF initialized successfully. Supported frameworks detected: torch, onnx, openvino 18:23:05-551466 WARNING OpenVINO: No compatible GPU detected! Using CPU 18:23:05-843091 INFO [AgentScheduler] Task queue is empty 18:23:05-844599 INFO [AgentScheduler] Registering APIs 18:23:05-917808 DEBUG Scripts setup: ['IP Adapters:0.017', 'XYZ Grid:0.02', 'Face:0.01', 'CogVideoX:0.005'] 18:23:05-918809 DEBUG Model metadata: file="metadata.json" no changes 18:23:06-049969 DEBUG Model requested: fn=run: 18:23:06-050967 INFO Load model: select="Diffusers\hakurei/waifu-diffusion [87a6d830b9]" 18:23:06-051968 INFO Autodetect model: detect="Stable Diffusion" class=StableDiffusionPipeline file="models\Diffusers\models--hakurei--waifu-diffusion\snapshots\87a6d830b9b23f7e5727f162782cf 3f4a7a84be1" size=0MB 18:23:06-053523 ERROR Diffuser model not loaded 18:23:06-054476 DEBUG Script callback init time: task_scheduler.py:ui_tabs=0.21 system-info.py:app_started=1.07 task_scheduler.py:app_started=0.32 18:23:06-055506 INFO Startup time: 9.22 torch=3.52 gradio=0.86 diffusers=0.08 libraries=1.16 extensions=0.61 detailer=0.05 ui-networks=0.12 ui-txt2img=0.06 ui-img2img=0.06 ui-control=0.10 ui-settings=0.19 ui-extensions=0.55 launch=0.09 api=0.05 app-started=1.39 checkpoint=0.14 18:23:06-057101 DEBUG Save: file="config.json" json=33 bytes=1405 time=0.003

sk3nn1xxx commented 1 month ago

with a normal python script all the models work just fine just not in SDNEXT idk why

vladmandic commented 1 month ago

should be resolved in the lastest update.