cumulo-autumn / StreamDiffusion

StreamDiffusion: A Pipeline-Level Solution for Real-Time Interactive Generation
Apache License 2.0
9.7k stars 692 forks source link

Support for blending latents #135

Open madmaxbr5 opened 8 months ago

madmaxbr5 commented 8 months ago

Would be nice to be able to blend latents to increase frame-to-frame consistency and reduce flicker. For example, can I blend in the previously generated frame's output latent with the current frame's input latent. In theory, this should improve temporal consistency a bit.