apapiu / transformer_latent_diffusion

Text to Image Latent Diffusion using a Transformer core
MIT License
141 stars 17 forks source link

Controlnet in transformer latent diffusion #7

Closed MauroZMJ closed 7 months ago

MauroZMJ commented 8 months ago

Thank you for your nice work! This is what I really want since training diffusion like stable diffusion is unaffordable! I would like to know if you have any plans to implement controlnet within this framework? Because it no longer uses Unet as the diffusion model under this framework, it seems infeasible to directly migrate the existing Controlnet scheme to this framework.