Scheduler Algorithms of Stable Diffusion - Githubissues

CompVis / stable-diffusion

A latent text-to-image diffusion model

https://ommer-lab.com/research/latent-diffusion-models/

Other

67.81k stars 10.11k forks source link

Scheduler Algorithms of Stable Diffusion #178

Open buttercutter opened 2 years ago

buttercutter commented 2 years ago

For the comment box at https://colab.research.google.com/github/huggingface/notebooks/blob/main/diffusers/stable_diffusion.ipynb#scrollTo=cUBqX1sMsDR6 , which scheduler should be used in which particular scenario and why ? Reading the given paper: Elucidating the Design Space of Diffusion-Based Generative Models does not really help in understanding the issue.

Edit: Let me read more on the different papers in https://huggingface.co/docs/diffusers/api/schedulers

@crowsonkb

buttercutter commented 1 year ago

For https://lablab.ai/t/stable-diffusion-img2img , it seems that only LMSDiscreteScheduler works well in generating different variations of the pictures sketches, that is my observation so far

@crowsonkb @JustinGuese do you have any idea on this ?