czg1225 / AsyncDiff

[NeurIPS 2024] AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising
https://czg1225.github.io/asyncdiff_page/
Apache License 2.0
155 stars 8 forks source link

(Feature request?) async anything #7

Open softyoda opened 3 months ago

softyoda commented 3 months ago

Hi, currently the difussion isn't the bottleneck, it's more the fact that I repeat the same process for each frame and the process invoke multiple part (like depth estimation, text desctiption from vision llm, etc...) some can be done once every two frame or more, some could be run on another pc in same local network, is there any ways to do that currently with comfyui (and maybe asyncdiff?) ? The diffusion process has become the fastest part (with turbo xl on 2 samples), but not the others parts.