search

pkuliyi2015 / multidiffusion-upscaler-for-automatic1111

Tiled Diffusion and VAE optimize, licensed under CC BY-NC-SA 4.0
Other
4.59k stars 330 forks source link

about multi-gpu #364

Open Kotori05 opened 3 months ago

Kotori05 commented 3 months ago

Advice Request tiled vae is really a good idea, is it possible to use on multiple GPU environment? (cuda out of memory!)

Kahsolt commented 3 months ago

Yes multi-GPU can be helpful for tiled-VAE, since the main bottleneck for tiled-VAE forward is the GroupNorm sync :) but the sd-webui seems not to handle multi-GPU case, it is not considered to impl that in this repo