search

comfyanonymous / ComfyUI

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
https://www.comfy.org/
GNU General Public License v3.0
55.21k stars 5.83k forks source link

ComfyUI cascade stage b implementation introduces artifacts #5297

Open cake-ml opened 1 week ago

cake-ml commented 1 week ago

The two images below were generated using the same stage c conditioning latents, and the same sampler/scheduler (euler, simple, 10 steps). The first image was generated using ComfyUI, the 2nd image using the native diffusers stage b implementation. This behaviour appears consistently across different samplers, schedulers and with different stage c conditioning. Using the diffusers implementation of stage a to decode ComfyUI stage b output latents does produce artifacts, suggesting that the issue is specifically in the stage b implementation, not stage a.

comfyui diffusers

Comfy workflow and example latents (had to zip, github doesn't like the format) workflow_test.json test_latent.zip

comfyanonymous commented 1 week ago

The correct sampler for this if I remember correctly is "euler_ancestral" so if you use that one you should get good results.