vladmandic / automatic

SD.Next: Advanced Implementation of Stable Diffusion and other Diffusion-based generative image models
https://github.com/vladmandic/automatic
GNU Affero General Public License v3.0
5.7k stars 423 forks source link

[Issue]: Adding quicksettings breaks openvino and will only use CPU #3423

Open Enlightnd opened 1 month ago

Enlightnd commented 1 month ago

Issue Description

If you follow the steps in the wiki/Installation guide and add sd_model_refiner, diffusers_pipeline, and sd_backend to the quicksettings menu, suddenly openvino will always use your CPU instead of your GPU.

Version Platform Description

Issue exists on Master and Dev branch.

Relevant log output

No response

Backend

Diffusers

UI

ModernUI

Branch

Master

Model

StableDiffusion 1.5

Acknowledgements

vladmandic commented 1 month ago

this makes no sense since quicksettings are purely just a ui way of displaying it in one place vs another, it changes absolutely nothing in the server or processing. please provide logs that prove this. (i'm not closing the issue as anything is possible, but really need something to go on)

Enlightnd commented 1 month ago

When I get the time I'll record what is happening.

Before I posted this, I spent quite some time with Disty on discord trying to figure out why openvino would always only use CPU for me.

Even tried the new openvino and torch versions in the dev branch to see what was going on.

Which eventually spit out the following error when disabling the "Model compile suppress errors"

https://media.discordapp.net/attachments/1130536562422186044/1283959378709450814/image.png?ex=66e6de1a&is=66e58c9a&hm=35ad0900929d47474583efaf1645f6bf2546a983a6d0ad57b892826671cf2e92&=&format=webp&quality=lossless&width=636&height=904

Couldn't figure out what may be the cause other than maybe an artefact error from switching back and forth between openvino and ipex, or other "wrong libraries littered on the system" style issues.

So I loaded a fresh windows image, re-installed SD.Next and at first, everything worked perfectly.

Then I went ahead and re-added those quickmenu items as suggested in the installation notes and instantly, SD.next was back to only using CPU and spitting out that error when disabling "suppress errors".

Removing those items from quickmenu instantly fixed the issue too, returning to correctly using the GPU.

Enlightnd commented 1 month ago

Ps, this is on Windows 11, A770, 32GB ram and 6 Zen3 cores allotted.

I'll be installing SD.Next with ipex and openvino on WSL/Ubuntu 24 and pure Ubuntu 24 later today and I'll report if the same happens there with this hardware config.