[New Models] Support On Distillation of Guided Diffusion Models

open-mmlab / mmagic

OpenMMLab Multimodal Advanced, Generative, and Intelligent Creation Toolbox. Unlock the magic 🪄: Generative-AI (AIGC), easy-to-use APIs, awsome model zoo, diffusion models, for text-to-image generation, image/video restoration/enhancement, etc.

Apache License 2.0

6.72k stars 1.04k forks source link

Model/Dataset/Scheduler description

Classifier-free guided diffusion models have recently been shown to be highly effective at high-resolution image generation, and they have been widely used in large-scale diffusion frameworks including DALL-E 2, GLIDE and Imagen.

The proposed model is able to generate images visually comparable to that of the original model using as few as 4 sampling steps on ImageNet 64x64 and CIFAR-10, achieving FID/IS scores comparable to that of the original model while being up to 256 times faster to sample from.

Open source status

[ ] The model implementation is available
[ ] The model weights are available.

Provide useful links for the implementation

Paper： On Distillation of Guided Diffusion Models

open-mmlab / mmagic