search

buoyancy99 / diffusion-forcing

code for "Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion"
Other
617 stars 29 forks source link

Why diffusion forcing won't blow up? #28

Open xizaoqu opened 2 weeks ago

xizaoqu commented 2 weeks ago

Thanks for your interesting work. I've checked the code and found that in the temporal attention implementation, each time the newest noisy frame will condition on previous almost clean frames for denoising. I'm wondering why in this case the auto-regressively generated frames will not face quality degradation. Could you provide some insights about this? Thanks.

xizaoqu commented 2 weeks ago

BTW, I found in GameNGen (https://gamengen.github.io/) it reports that using noise augmentation can mitigate auto-regressive drift.