vladmandic / automatic

SD.Next: Advanced Implementation of Stable Diffusion and other Diffusion-based generative image models
https://github.com/vladmandic/automatic
GNU Affero General Public License v3.0
5.68k stars 421 forks source link

[Issue]: diffusers can not load model by openvino:"ERROR Load {op}: no model loaded" #3522

Closed zhongyanke closed 6 days ago

zhongyanke commented 6 days ago

Issue Description

Using VENV: E:\vladmandic\automatic-2024-10-25\venv 08:49:37-563890 INFO Starting SD.Next 08:49:37-566940 INFO Logger: file="E:\vladmandic\automatic-2024-10-25\sdnext.log" level=DEBUG size=65 mode=create 08:49:37-567890 INFO Python: version=3.10.11 platform=Windows bin="E:\vladmandic\automatic-2024-10-25\venv\Scripts\python.exe" venv="E:\vladmandic\automatic-2024-10-25\venv" 08:49:38-985078 INFO Version: app=sd.next updated=2024-10-24 hash=06dd9e5f branch=master url=https://github.com/vladmandic/automatic/tree/master ui=main 08:49:39-590633 INFO Platform: arch=AMD64 cpu=Intel64 Family 6 Model 186 Stepping 2, GenuineIntel system=Windows release=Windows-10-10.0.22631-SP0 python=3.10.11 08:49:39-595239 DEBUG Setting environment tuning 08:49:39-596537 DEBUG Torch allocator: "garbage_collection_threshold:0.80,max_split_size_mb:512" 08:49:39-602532 DEBUG Torch overrides: cuda=False rocm=False ipex=False directml=False openvino=False zluda=False 08:49:39-611241 INFO Python: version=3.10.11 platform=Windows bin="E:\vladmandic\automatic-2024-10-25\venv\Scripts\python.exe" venv="E:\vladmandic\automatic-2024-10-25\venv" 08:49:39-614241 INFO OpenVINO: selected 08:49:40-118691 INFO Verifying requirements 08:49:40-121664 INFO Verifying packages 08:49:40-406404 DEBUG Timestamp repository update time: Fri Oct 25 07:48:38 2024 08:49:40-408324 INFO Startup: standard 08:49:40-409321 INFO Verifying submodules 08:50:00-143446 ERROR Git: None / submodule --quiet update --init --recursive 08:50:00-145276 DEBUG Git output: fatal: Unable to find current revision in submodule path 'wiki' 08:50:07-849609 ERROR Git: None / submodule --quiet sync --recursive 08:50:07-851698 DEBUG Git output: fatal: No such ref: HEAD 08:50:08-139175 DEBUG Git submodule: extensions-builtin/sd-extension-chainner / main 08:50:08-695295 DEBUG Git submodule: extensions-builtin/sd-extension-system-info / main 08:50:09-287477 DEBUG Git submodule: extensions-builtin/sd-webui-agent-scheduler / main 08:50:10-202487 DEBUG Git detached head detected: folder="extensions-builtin/sdnext-modernui" reattach=main 08:50:10-204676 DEBUG Git submodule: extensions-builtin/sdnext-modernui / main 08:50:10-917599 DEBUG Git submodule: extensions-builtin/stable-diffusion-webui-rembg / master 08:50:11-685999 DEBUG Git submodule: modules/k-diffusion / master 08:50:12-461302 ERROR Git: wiki / branch --show-current 08:50:12-478392 DEBUG Git output: fatal: failed to resolve HEAD as a valid ref 08:50:12-485396 DEBUG Git submodule: wiki / fatal: failed to resolve HEAD as a valid ref 08:50:12-875312 DEBUG Register paths 08:50:12-924196 DEBUG Installed packages: 202 08:50:12-926118 DEBUG Extensions all: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info', 'sd-webui-agent-scheduler', 'sdnext-modernui', 'stable-diffusion-webui-rembg'] 08:50:13-069989 DEBUG Extension installer: E:\vladmandic\automatic-2024-10-25\extensions-builtin\sd-webui-agent-scheduler\install.py 08:50:15-239955 DEBUG Extension installer: E:\vladmandic\automatic-2024-10-25\extensions-builtin\stable-diffusion-webui-rembg\install.py 08:50:21-867067 DEBUG Extensions all: [] 08:50:21-869197 INFO Extensions enabled: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info', 'sd-webui-agent-scheduler', 'sdnext-modernui', 'stable-diffusion-webui-rembg'] 08:50:21-870367 INFO Verifying requirements 08:50:21-871369 WARNING Setup complete with errors: 3 08:50:21-871369 WARNING See log file for more details: E:\vladmandic\automatic-2024-10-25\sdnext.log 08:50:21-874127 DEBUG Extension preload: {'extensions-builtin': 0.0, 'extensions': 0.0} 08:50:21-877073 DEBUG Starting module: <module 'webui' from 'E:\vladmandic\automatic-2024-10-25\webui.py'> 08:50:21-878075 INFO Command line args: ['--debug'] debug=True 08:50:21-878075 DEBUG Env flags: [] 08:50:25-276711 INFO System packages: {'torch': '2.3.1+cpu', 'diffusers': '0.31.0', 'gradio': '3.43.2', 'transformers': '4.45.2', 'accelerate': '1.0.0'} 08:50:26-422826 DEBUG Huggingface cache: folder="C:\Users\15168.cache\huggingface\hub" 08:50:26-434578 DEBUG Read: file="config.json" json=33 bytes=1445 time=0.000 08:50:26-436859 INFO Engine: backend=Backend.DIFFUSERS compute=cpu device=cpu attention="Scaled-Dot-Product" mode=no_grad 08:50:26-439501 DEBUG Read: file="html\reference.json" json=58 bytes=30996 time=0.000 08:50:26-443076 INFO Torch parameters: backend=cpu device=cpu config=Auto dtype=torch.bfloat16 vae=torch.bfloat16 unet=torch.bfloat16 context=no_grad nohalf=False nohalfvae=False upscast=False deterministic=False test-fp16=True test-bf16=True optimization="Scaled-Dot-Product" 08:50:26-681399 DEBUG ONNX: version=1.19.2 provider=CPUExecutionProvider, available=['AzureExecutionProvider', 'CPUExecutionProvider'] 08:50:26-718747 INFO Device: 08:50:26-789459 DEBUG Importing LDM 08:50:26-799548 DEBUG Entering start sequence 08:50:26-802461 DEBUG Initializing 08:50:26-830544 INFO Available VAEs: path="models\VAE" items=0 08:50:26-833541 INFO Available UNets: path="models\UNET" items=0 08:50:26-835622 INFO Available TEs: path="models\Text-encoder" items=0 08:50:26-837641 INFO Disabled extensions: ['sdnext-modernui'] 08:50:26-840855 DEBUG Scanning diffusers cache: folder="models\Diffusers" items=2 time=0.00 08:50:26-842669 INFO Available Models: path="models\Stable-diffusion" items=2 time=0.00 08:50:26-880389 INFO Available Yolo: path="models\yolo" items=6 downloaded=0 08:50:26-882154 DEBUG Load extensions 08:50:27-053816 INFO Extension: script='extensions-builtin\Lora\scripts\lora_script.py' [2;36m08:50:26-942341[0m[2;36m [0m[34mINFO [0m Available LoRAs: [33mitems[0m=[1;36m0[0m [33mfolders[0m=[1;36m2[0m 08:50:27-425810 INFO Extension: script='extensions-builtin\sd-webui-agent-scheduler\scripts\task_scheduler.py' Using sqlite file: extensions-builtin\sd-webui-agent-scheduler\task_scheduler.sqlite3 08:50:27-429810 DEBUG Extensions init time: 0.55 Lora=0.12 sd-webui-agent-scheduler=0.35 08:50:27-445810 DEBUG Read: file="html/upscalers.json" json=4 bytes=2672 time=0.000 08:50:27-448809 DEBUG Read: file="extensions-builtin\sd-extension-chainner\models.json" json=24 bytes=2719 time=0.001 08:50:27-449810 DEBUG chaiNNer models: path="models\chaiNNer" defined=24 discovered=0 downloaded=0 08:50:27-452993 INFO Available Upscalers: items=53 downloaded=0 user=0 time=0.02 types=['None', 'Lanczos', 'Nearest', 'ChaiNNer', 'AuraSR', 'ESRGAN', 'LDSR', 'RealESRGAN', 'SCUNet', 'SD', 'SwinIR'] 08:50:27-466187 INFO Available Styles: folder="models\styles" items=288 time=0.01 08:50:27-469190 DEBUG Creating UI 08:50:27-471456 DEBUG UI themes available: type=Standard themes=12 08:50:27-471456 INFO UI theme: type=Standard name="black-teal" 08:50:27-478325 DEBUG UI theme: css="E:\vladmandic\automatic-2024-10-25\javascript\black-teal.css" base="sdnext.css" user="None" 08:50:27-480325 DEBUG UI initialize: txt2img 08:50:27-499732 ERROR Extra networks error listing items: class=ExtraNetworksPageCheckpoints tab=txt2img 'NoneType' object is not subscriptable 08:50:27-515120 ERROR Extra networks error listing items: class=ExtraNetworksPageCheckpoints tab=txt2img 'NoneType' object is not subscriptable 08:50:27-517407 DEBUG Networks: page='model' items=0 subfolders=14 tab=txt2img folders=['models\Stable-diffusion', 'models\Diffusers', 'models\Reference'] list=0.02 thumb=0.00 desc=0.00 info=0.00 workers=8 sort=Default 08:50:27-518498 DEBUG Networks: page='lora' items=0 subfolders=0 tab=txt2img folders=['models\Lora', 'models\LyCORIS'] list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=8 sort=Default 08:50:27-525079 DEBUG Networks: page='style' items=288 subfolders=1 tab=txt2img folders=['models\styles', 'html'] list=0.01 thumb=0.00 desc=0.00 info=0.00 workers=8 sort=Default 08:50:27-529530 DEBUG Networks: page='embedding' items=0 subfolders=0 tab=txt2img folders=['models\embeddings'] list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=8 sort=Default 08:50:27-530632 DEBUG Networks: page='vae' items=0 subfolders=0 tab=txt2img folders=['models\VAE'] list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=8 sort=Default 08:50:27-532995 DEBUG Networks: page='history' items=0 subfolders=0 tab=txt2img folders=[] list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=8 sort=Default 08:50:27-622493 DEBUG UI initialize: img2img 08:50:27-638856 ERROR Extra networks error listing items: class=ExtraNetworksPageCheckpoints tab=img2img 'NoneType' object is not subscriptable 08:50:27-718677 DEBUG UI initialize: control models=models\control 08:50:27-761782 ERROR Extra networks error listing items: class=ExtraNetworksPageCheckpoints tab=control 'NoneType' object is not subscriptable 08:50:27-955175 DEBUG Read: file="ui-config.json" json=0 bytes=2 time=0.000 08:50:28-054971 DEBUG UI themes available: type=Standard themes=12 08:50:28-156158 DEBUG Reading failed: E:\vladmandic\automatic-2024-10-25\html\extensions.json [Errno 2] No such file or directory: 'E:\vladmandic\automatic-2024-10-25\html\extensions.json' 08:50:28-157899 INFO Extension list is empty: refresh required 08:50:35-414944 DEBUG Extension list: processed=6 installed=6 enabled=5 disabled=1 visible=6 hidden=0 08:50:35-668382 DEBUG Root paths: ['E:\vladmandic\automatic-2024-10-25'] 08:50:35-726811 INFO Local URL: http://127.0.0.1:7860/ 08:50:35-734737 DEBUG Gradio functions: registered=1897 08:50:35-735833 DEBUG FastAPI middleware: ['Middleware', 'Middleware'] 08:50:35-738834 DEBUG Creating API INFO:nncf:NNCF initialized successfully. Supported frameworks detected: torch, onnx, openvino 08:50:36-555224 INFO [AgentScheduler] Task queue is empty 08:50:36-624722 INFO [AgentScheduler] Registering APIs 08:50:36-910853 DEBUG Scripts setup: ['IP Adapters:0.019', 'XYZ Grid:0.022', 'Face:0.014', 'AnimateDiff:0.007', 'CogVideoX:0.006', 'Image-to-Video:0.005'] 08:50:36-912810 DEBUG Model metadata: file="metadata.json" no changes 08:50:36-914848 DEBUG Model requested: fn=run: 08:50:36-916816 INFO Load model: select="Diffusers\sayakpaul/flux.1-dev-nf4 [b054bc66ae]" 08:50:36-918892 INFO Autodetect model: detect="FLUX" class=FluxPipeline file="models\Diffusers\models--sayakpaul--flux.1-dev-nf4\snapshots\b054bc66ae1097b811848c3739ec d673a864bda1" size=0MB 08:50:36-920844 DEBUG Load model: type=FLUX model="Diffusers\sayakpaul/flux.1-dev-nf4" repo="sayakpaul/flux.1-dev-nf4" unet="None" te="None" vae="Automatic" quant=nf4 offload=none dtype=torch.bfloat16 08:50:36-921891 DEBUG HF login: no token provided 08:50:37-010693 DEBUG Quantization: type=bitsandbytes fn=load_flux_nf4:_replace_with_bnb_linear 08:50:37-111483 ERROR Load model: type=FLUX failed to load UNET: Torch not compiled with CUDA enabled 08:50:37-320676 DEBUG GC: utilization={'gpu': 0, 'ram': 2, 'threshold': 80} gc={'collected': 15701, 'saved': 0} before={'gpu': 0, 'ram': 0.66} after={'gpu': 0, 'ram': 0.66, 'retries': 0, 'oom': 0} device=cpu fn=load_flux:load_flux_nf4 time=0.21 08:50:37-326413 DEBUG Load model: type=FLUX preloaded=[] 08:50:38-128476 ERROR Load model: path="models\Diffusers\models--sayakpaul--flux.1-dev-nf4\snapshots\b054bc66ae1097b811848c3739ec d673a864bda1" 401 Client Error. (Request ID: Root=1-671c3cdd-3b733f447490c56c34beab4b;13cc8d72-8c2e-4264-b4eb-540e1cce1a08)

                     Cannot access gated repo for url
                     https://hf-mirror.com/black-forest-labs/FLUX.1-dev/resolve/main/model_index.json.
                     Access to model black-forest-labs/FLUX.1-dev is restricted. You must have access to it and be
                     authenticated to access it. Please log in.

08:50:38-136472 ERROR Load {op}: no model loaded 08:50:38-141953 DEBUG Script callback init time: system-info.py:app_started=0.74 task_scheduler.py:app_started=0.37 08:50:38-144165 INFO Startup time: 16.26 torch=2.66 gradio=0.56 diffusers=0.08 libraries=1.61 extensions=0.55 ui-networks=0.16 ui-txt2img=0.07 ui-img2img=0.06 ui-control=0.10 ui-settings=0.19 ui-extensions=7.29 ui-defaults=0.20 launch=0.10 api=0.06 app-started=1.11 checkpoint=1.23 08:50:38-146224 DEBUG Save: file="config.json" json=33 bytes=1395 time=0.004

Version Platform Description

No response

Relevant log output

No response

Backend

Diffusers

UI

Standard

Branch

Master

Model

StableDiffusion 1.5

Acknowledgements

vladmandic commented 6 days ago

you did not write anything, you just dumped the log - such issues are automatically closed. and note the error message - i'm really not sure how can it be any clearer?

Access to model black-forest-labs/FLUX.1-dev is restricted. You must have access to it and be authenticated to access it. Please log in.

zhongyanke commented 6 days ago

我已经收到你的邮件。

vladmandic commented 6 days ago

我已经收到你的邮件。

english only