search

huggingface / diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
https://huggingface.co/docs/diffusers
Apache License 2.0
25.41k stars 5.26k forks source link

Differential Diffusion with Kolors #8813

Open chuck-ma opened 2 months ago

chuck-ma commented 2 months ago

Is your feature request related to a problem? Please describe. One might wish to soft inpaint or edit pictures with differential diffusion with Kolors .

Describe the solution you'd like. I believe we can port diff-diff to Kolors , by adding a new pipeline for it.

Describe alternatives you've considered. Diff-diff is already supported with XL and sd3 .But sd3 failed to generate full body picture of a person.A port of differential diffusion for Kolors might fill this gap as well. Besides, i think in visual quality Kolors looks more promising than sd3

@asomoza

asomoza commented 2 months ago

Let's wait until we have the actual pipeline in the diffusers core.

We'll probably leave it to the community since it will just be a copy of the SDXL Differential Diffusion adapted to the Kolors Pipeline which can be a very good first issue for the people who wants to contribute.

github-actions[bot] commented 2 weeks ago

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.