search

comfyanonymous / ComfyUI

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
https://www.comfy.org/
GNU General Public License v3.0
56.41k stars 5.98k forks source link

Implement: Align Your Steps: Optimizing Sampling Schedules in Diffusion Models #3327

Open joe-aivatarz opened 6 months ago

joe-aivatarz commented 6 months ago

Align Your Steps: Optimizing Sampling Schedules in Diffusion Models is a general and principled approach to optimizing the sampling schedules of DMs for high-quality outputs. This work is presented by Nvidia labs in this paper: https://arxiv.org/abs/2404.14507

and the project page is here https://research.nvidia.com/labs/toronto-ai/AlignYourSteps/

the page propose a very small change that have big impact on the inference quality

atxoxx commented 6 months ago

already implemented here : https://github.com/comfyanonymous/ComfyUI/commit/644a3ae58d426ffbbc02ef4104034c98e8fc6513

giteeeeee commented 6 months ago

Can anyone explain how to use this node?

It has a SIGMAS output which I'm not sure where it should link to.

ltdrdata commented 6 months ago

Can anyone explain how to use this node?

It has a SIGMAS output which I'm not sure where it should link to.

image

ecpknymt commented 6 months ago

So can I use SamplerCustom node for denoise img2img? I cant find how to handle denoise step...

ltdrdata commented 6 months ago

So can I use SamplerCustom node for denoise img2img? I cant find how to handle denoise step...

Sure... That is similar to KSamplerAdvanced. You need to manipulate sigmas to mimic denoise.

frankyifei commented 6 months ago

Maybe this should be implemented in system's scheduler list, then lots workflow should benefit from it.

ErvinA-wx commented 6 months ago

Can anyone explain how to use this node? It has a SIGMAS output which I'm not sure where it should link to.

image

升级comfyui到最新版本直接就可以用这个节点。或者双击左键搜索“AlignYourStepsScheduler”，这个节点就出现了。

quixot1c commented 6 months ago

@joe-aivatarz why don'y you close the issue when it was already implemented?

427067 commented 4 months ago

AlignYourStepsScheduler 倍速高质量（质量强过lcm hypersd）10步多伦多.json

Koitenshin commented 4 months ago

This really is the most pain in the butt way to use AYS.

Hey @comfyanonymous, can you finally add AYS to the other schedulers so we can stop jumping through hoops to use it? You're already adding new samplers & schedulers we never had before.