huggingface / diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
https://huggingface.co/docs/diffusers
Apache License 2.0
23.93k stars 4.93k forks source link

Add PAG support to SD1.5 #8710

Open yiyixuxu opened 1 week ago

yiyixuxu commented 1 week ago

We recently integrated PAG into diffusers! See this PR [here] (https://github.com/huggingface/diffusers/pull/7944) we added PAG to SDXL

we also want to add PAG support to SD1.5 pipelines! we will need:

  1. You should put it under the pag folder
  2. you can use the implementation of SDXL PAG pipelines as a reference (see this PRhttps://github.com/huggingface/diffusers/pull/7944 and you can find all the sdxl pag pipelines here https://github.com/huggingface/diffusers/tree/main/src/diffusers/pipelines/pag)
  3. you need to add AutoPipeline so that you can use this API to create it
       AutoPipelineForImage2Image.from_pretrained(repo_id, controlnet=controlnet, enable_pag=True ...)
  4. tests and docs

If you are interested in working on this, Let me know which pipeline(s) you want to work on:)

blaisedmello commented 1 week ago

Hello, I would like to have a go at it. Can I work on the StableDiffusionPAGInpaintPipeline?

yiyixuxu commented 1 week ago

@blaisedmello sure!

shauray8 commented 1 week ago

Looks rather interesting, adding support for StableDiffusionPAGPipeline.

sajadn commented 1 week ago

Hey, I'll work on StableDiffusionPAGImg2ImgPipeline

tuanh123789 commented 1 week ago

Hi, can i take StableDiffusionControlNetPAGPipeline

yiyixuxu commented 1 week ago

@tuanh123789 sure!

Bhavay-2001 commented 1 week ago

Hi @yiyixuxu, I think I can work on StableDiffusionControlNetPAGImg2ImgPipeline. Pls assign this to me.

yiyixuxu commented 1 week ago

@Bhavay-2001 sure!

AbhinavJangra29 commented 6 days ago

@yiyixuxu can i try ?