Refactor Multi-diffusion to support tile batch

ddPn08 / Radiata

Stable diffusion webui based on diffusers.

https://ddpn08.github.io/Radiata/

Apache License 2.0

983 stars 68 forks source link

Closed Isotr0py closed 1 year ago

Isotr0py commented 1 year ago

Still in test for TensorRT.

Recommend windows size=64 for sd-v1.4/1.5 and windows size=96 for sd-v2.
Recommend stride=8 for more detailed image and stride=16 for faster generation speed. Personally, higher stride is not recommended for Multi-diffusion.

Isotr0py commented 1 year ago

Emmm, batch tiles can improve generation speed in diffusers.

But it seems that tile batch=1 is the fastest parameter in tensorrt since we "align" unet inputs by repeating tensors...