search

lllyasviel / stable-diffusion-webui-forge

GNU Affero General Public License v3.0
7.59k stars 731 forks source link

GPU Weights Not Respected - Forge Always use Max VRAM #1773

Open Iory1998 opened 2 weeks ago

Iory1998 commented 2 weeks ago

Not all the time, but sometimes I run into this issue where I use the FLUX.1 Models (mainly Fp16) and even though I set the GPU Weights to be around 18.5 GB (Which is 75% of my VRAM capacity), Forge will use 23.8GB or VRAM, which leads it to either crash or use 100% of my RAM for minutes. Below is the screenshot of the log. Even if I reset the GPU Weights, they are not respected at all. image

Sana-A-E commented 1 week ago

I am having the same issue. I tried shutting it down and trying again to no avail. Forge keeps using max vram causing my Flux runs to be extremely slow. No matter what I set in weight, it is not respected. I was hoping that if I changed the default weight it would use it. So I tried to change defaults via settings but weight is not included in the saved defaults and when forge is restarted, weight is reset to max again.

Iory1998 commented 1 week ago

I am having the same issue. I tried shutting it down and trying again to no avail. Forge keeps using max vram causing my Flux runs to be extremely slow. No matter what I set in weight, it is not respected. I was hoping that if I changed the default weight it would use it. So I tried to change defaults via settings but weight is not included in the saved defaults and when forge is restarted, weight is reset to max again.

I know right! This is very frustrating problem that prevents me from using the FP16. The issue is mitigated if use quantized versions.