Zeqiang-Lai / OpenDMD

Open source implementation and models of One-step Diffusion with Distribution Matching Distillation
GNU General Public License v2.0
109 stars 10 forks source link

OpenDMD

Hugging Face Models Hugging Face Spaces

Open source implementation and models of One-step Diffusion with Distribution Matching Distillation

image (2) image1 image3 image2

Usage

Launch the gradio demo via:

python gradio_dmd.py

Model Release

These models are very experimental releases, all of them are only trained with very few steps, so the performance is not satisfactory.

If you are trying to reproduce the results, we recommend first testing original sd1.5 (which is fully verified), there might be some issues for fintuned model.

Model Link
dreamshaper-8-dmd-1kstep hf-model
dreamshaper-8-dmd-kl-only-6kstep hf-model

Real Time Demo

The video is not accelerated.

https://github.com/Zeqiang-Lai/OpenDMD/assets/26198430/f8069208-934d-49a2-839e-689c2e1a85fe

Citation

@article{yin2023one,
  title={One-step Diffusion with Distribution Matching Distillation},
  author={Yin, Tianwei and Gharbi, Micha{\"e}l and Zhang, Richard and Shechtman, Eli and Durand, Fredo and Freeman, William T and Park, Taesung},
  journal={arXiv preprint arXiv:2311.18828},
  year={2023}
}