search

huggingface / diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
https://huggingface.co/docs/diffusers
Apache License 2.0
26.4k stars 5.43k forks source link

DDIB: Dual Diffusion Implicit Bridges for Image to Image Translation #6662

Open nityanandmathur opened 10 months ago

nityanandmathur commented 10 months ago

Is your feature request related to a problem? Please describe. Common image translation methods typically depend on joint training using data from both the source and target domains. However, DDIB addresses this challenge by independently training diffusion models on each domain, while maintaining a shared latent space across all domains. The original DDIB code lacks optimization, leading to lengthy processing times. Additionally, unlike diffusers, it presents challenges when attempting to integrate with other pre-trained models or schedulers.

Describe the solution you'd like. An implementation of DDIB with diffusers that can be run with HF accelerate could speed up the operations and will allow to work more easily with other implementations of models and schedulers on diffusers.

Describe alternatives you've considered. Tried to execute the original code but is too tedious.

Additional context.

Paper: https://openreview.net/forum?id=5HLoTvVGDe Github: https://github.com/suxuann/ddib Project Page: https://suxuann.github.io/ddib/

github-actions[bot] commented 9 months ago

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

Bhavay-2001 commented 8 months ago

Hi @sayakpaul, pls let me know how may I proceed with this issue? Thanks

github-actions[bot] commented 7 months ago

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

weirdfish23 commented 4 months ago

Hi @sayakpaul , can I work on this issue? I find interesting the original paper. Thanks

sayakpaul commented 4 months ago

Thanks for expressing your interest! I think we can start with a community pipeline.

github-actions[bot] commented 2 months ago

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.