Style Aligned Image Generation via Shared Attention

Project Page   Paper

Setup

This code was tested with Python 3.11, Pytorch 2.1 and Diffusers 0.16.

Examples

• See style_aligned_sdxl notebook for generating style aligned images using SDXL.

• See style_aligned_transfer_sdxl notebook for generating images with a style from reference image using SDXL.

• See style_aligned_w_controlnet notebook for generating style aligned and depth conditioned images using SDXL with ControlNet-Depth.

• style_aligned_w_multidiffusion can be used for generating style aligned panoramas using SD V2 with MultiDiffusion.

Demos

Thanks to @yvrjsharma for preparing the demos: style aligned text to image, ControlNet + StyleAligned and MultiDiffusion + StyleAligned

To start a demo locally, simply run

python <demo file name>.py  

and enter the demo in your browser using the provided url.

An online demo of ControlNet + StyleAligned is available here.

TODOs

• [x] Adding demo.
• [x] StyleAligned from an input image.
• [ ] Multi-style with MultiDiffusion.
• [ ] StyleAligned with DreamBooth

Disclaimer

This is not an officially supported Google product.