huggingface / diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
https://huggingface.co/docs/diffusers
Apache License 2.0
24.28k stars 5.02k forks source link

DDIB: Dual Diffusion Implicit Bridges for Image to Image Translation #6662

Open nityanandmathur opened 6 months ago

nityanandmathur commented 6 months ago

Is your feature request related to a problem? Please describe. Common image translation methods typically depend on joint training using data from both the source and target domains. However, DDIB addresses this challenge by independently training diffusion models on each domain, while maintaining a shared latent space across all domains. The original DDIB code lacks optimization, leading to lengthy processing times. Additionally, unlike diffusers, it presents challenges when attempting to integrate with other pre-trained models or schedulers.

Describe the solution you'd like. An implementation of DDIB with diffusers that can be run with HF accelerate could speed up the operations and will allow to work more easily with other implementations of models and schedulers on diffusers.

Describe alternatives you've considered. Tried to execute the original code but is too tedious.

Additional context.

Paper: https://openreview.net/forum?id=5HLoTvVGDe Github: https://github.com/suxuann/ddib Project Page: https://suxuann.github.io/ddib/

github-actions[bot] commented 5 months ago

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

Bhavay-2001 commented 4 months ago

Hi @sayakpaul, pls let me know how may I proceed with this issue? Thanks

github-actions[bot] commented 3 months ago

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

weirdfish23 commented 1 week ago

Hi @sayakpaul , can I work on this issue? I find interesting the original paper. Thanks

sayakpaul commented 1 week ago

Thanks for expressing your interest! I think we can start with a community pipeline.